-- Logs begin at Tue 2022-01-25 01:55:46 UTC, end at Tue 2022-01-25 03:29:57 UTC. -- Jan 25 02:22:08.200866 dv-cinder-819778-6-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Jan 25 02:22:08.213043 dv-cinder-819778-6-iscsi devstack@keystone.service[79107]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jan 25 02:22:08.215292 dv-cinder-819778-6-iscsi devstack@keystone.service[79107]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jan 25 02:22:08 2022] *** Jan 25 02:22:08.215292 dv-cinder-819778-6-iscsi devstack@keystone.service[79107]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jan 25 02:22:08.215292 dv-cinder-819778-6-iscsi devstack@keystone.service[79107]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jan 25 02:22:08.215292 dv-cinder-819778-6-iscsi devstack@keystone.service[79107]: nodename: dv-cinder-819778-6-iscsi Jan 25 02:22:08.215292 dv-cinder-819778-6-iscsi devstack@keystone.service[79107]: machine: x86_64 Jan 25 02:22:08.215292 dv-cinder-819778-6-iscsi devstack@keystone.service[79107]: clock source: unix Jan 25 02:22:08.215292 dv-cinder-819778-6-iscsi devstack@keystone.service[79107]: pcre jit disabled Jan 25 02:22:08.215292 dv-cinder-819778-6-iscsi devstack@keystone.service[79107]: detected number of CPU cores: 4 Jan 25 02:22:08.215292 dv-cinder-819778-6-iscsi devstack@keystone.service[79107]: current working directory: / Jan 25 02:22:08.215292 dv-cinder-819778-6-iscsi devstack@keystone.service[79107]: detected binary path: /usr/bin/uwsgi-core Jan 25 02:22:08.215292 dv-cinder-819778-6-iscsi devstack@keystone.service[79107]: your processes number limit is 47680 Jan 25 02:22:08.215292 dv-cinder-819778-6-iscsi devstack@keystone.service[79107]: your memory page size is 4096 bytes Jan 25 02:22:08.216508 dv-cinder-819778-6-iscsi devstack@keystone.service[79107]: detected max file descriptor number: 2048 Jan 25 02:22:08.216508 dv-cinder-819778-6-iscsi devstack@keystone.service[79107]: lock engine: pthread robust mutexes Jan 25 02:22:08.216508 dv-cinder-819778-6-iscsi devstack@keystone.service[79107]: thunder lock: enabled Jan 25 02:22:08.216508 dv-cinder-819778-6-iscsi devstack@keystone.service[79107]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jan 25 02:22:08.216508 dv-cinder-819778-6-iscsi devstack@keystone.service[79107]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Jan 25 02:22:08.261682 dv-cinder-819778-6-iscsi devstack@keystone.service[79107]: Python main interpreter initialized at 0x563c4d02e9c0 Jan 25 02:22:08.261682 dv-cinder-819778-6-iscsi devstack@keystone.service[79107]: python threads support enabled Jan 25 02:22:08.261682 dv-cinder-819778-6-iscsi devstack@keystone.service[79107]: your server socket listen backlog is limited to 100 connections Jan 25 02:22:08.261682 dv-cinder-819778-6-iscsi devstack@keystone.service[79107]: your mercy for graceful operations on workers is 90 seconds Jan 25 02:22:08.262053 dv-cinder-819778-6-iscsi devstack@keystone.service[79107]: mapped 403077 bytes (393 KB) for 2 cores Jan 25 02:22:08.262127 dv-cinder-819778-6-iscsi devstack@keystone.service[79107]: *** Operational MODE: preforking *** Jan 25 02:22:08.262358 dv-cinder-819778-6-iscsi devstack@keystone.service[79107]: *** uWSGI is running in multiple interpreter mode *** Jan 25 02:22:08.262358 dv-cinder-819778-6-iscsi devstack@keystone.service[79107]: spawned uWSGI master process (pid: 79107) Jan 25 02:22:08.262565 dv-cinder-819778-6-iscsi systemd[1]: Started Devstack devstack@keystone.service. Jan 25 02:22:08.263146 dv-cinder-819778-6-iscsi devstack@keystone.service[79107]: spawned uWSGI worker 1 (pid: 79120, cores: 1) Jan 25 02:22:08.263716 dv-cinder-819778-6-iscsi devstack@keystone.service[79107]: spawned uWSGI worker 2 (pid: 79121, cores: 1) Jan 25 02:22:08.263987 dv-cinder-819778-6-iscsi devstack@keystone.service[79107]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jan 25 02:22:14.105031 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 25 02:22:14.105031 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: from cryptography.utils import int_from_bytes Jan 25 02:22:14.105836 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 25 02:22:14.105836 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: from cryptography.utils import int_from_bytes Jan 25 02:22:14.107257 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 25 02:22:14.107257 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: from cryptography.utils import int_from_bytes Jan 25 02:22:14.107744 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 25 02:22:14.107744 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: from cryptography.utils import int_from_bytes Jan 25 02:22:14.152574 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jan 25 02:22:14.152764 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jan 25 02:22:14.152958 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] command line args: [] {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jan 25 02:22:14.153052 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jan 25 02:22:14.153211 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jan 25 02:22:14.153296 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jan 25 02:22:14.153411 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] ================================================================================ {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jan 25 02:22:14.153518 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] command line args: [] {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jan 25 02:22:14.153706 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jan 25 02:22:14.153818 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] admin_token = **** {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 02:22:14.153947 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] ================================================================================ {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jan 25 02:22:14.154169 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] admin_token = **** {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 02:22:14.154255 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] config_dir = [] {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 02:22:14.154369 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 02:22:14.154452 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] config_dir = [] {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 02:22:14.154550 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] config_source = [] {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 02:22:14.154637 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 02:22:14.154714 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] debug = True {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 02:22:14.154790 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] config_source = [] {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 02:22:14.154897 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] debug = True {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 02:22:14.154981 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 02:22:14.155219 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 02:22:14.155354 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 02:22:14.155453 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 02:22:14.155547 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 02:22:14.155642 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 02:22:14.155789 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 02:22:14.155898 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 02:22:14.156001 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 02:22:14.156104 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 02:22:14.156205 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] list_limit = None {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 02:22:14.156307 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] list_limit = None {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 02:22:14.156411 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] log_config_append = None {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 02:22:14.156522 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] log_config_append = None {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 02:22:14.156623 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 02:22:14.156725 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 02:22:14.156819 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] log_dir = None {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 02:22:14.156925 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] log_dir = None {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 02:22:14.157032 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] log_file = None {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 02:22:14.157144 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] log_file = None {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 02:22:14.157230 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 02:22:14.157355 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 02:22:14.157437 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 02:22:14.157565 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 02:22:14.157649 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 02:22:14.157725 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 02:22:14.157840 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 02:22:14.157923 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 02:22:14.157997 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 02:22:14.158122 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 02:22:14.158205 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 02:22:14.158281 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 02:22:14.158404 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 02:22:14.158487 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 02:22:14.158557 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 02:22:14.158634 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 02:22:14.158709 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 02:22:14.158835 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 02:22:14.158918 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 02:22:14.159071 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 02:22:14.159191 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 02:22:14.159308 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 02:22:14.159392 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 02:22:14.159544 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 02:22:14.159669 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 02:22:14.159821 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 02:22:14.159897 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 02:22:14.160056 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 02:22:14.160182 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 02:22:14.160334 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 02:22:14.160556 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.117/identity {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 02:22:14.160736 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] publish_errors = False {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 02:22:14.160820 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.117/identity {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 02:22:14.160965 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 02:22:14.161050 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] publish_errors = False {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 02:22:14.161190 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 02:22:14.161262 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 02:22:14.161366 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 02:22:14.161448 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 02:22:14.161592 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 02:22:14.161738 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 02:22:14.161826 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 02:22:14.161907 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 02:22:14.162044 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] standard_threads = False {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 02:22:14.162128 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 02:22:14.162272 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 02:22:14.162349 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] standard_threads = False {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 02:22:14.162504 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 02:22:14.162585 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 02:22:14.162662 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 02:22:14.162736 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 02:22:14.162835 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] use_journal = False {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 02:22:14.162918 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 02:22:14.163007 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] use_json = False {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 02:22:14.163089 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] use_journal = False {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 02:22:14.163179 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] use_stderr = False {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 02:22:14.163255 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] use_json = False {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 02:22:14.163351 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] use_syslog = False {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 02:22:14.163428 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] use_stderr = False {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 02:22:14.163566 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] use_syslog = False {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 02:22:14.163641 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 02:22:14.163829 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 02:22:14.163907 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.164090 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.164174 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.164331 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.164409 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.164595 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.164672 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.164838 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.164917 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.165071 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.165147 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.165314 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.165390 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.165546 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.165630 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.165789 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.165872 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.166033 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.166110 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.166280 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.166362 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.166509 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.166586 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.166754 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.166831 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.166999 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.167077 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.167235 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.167318 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.167476 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.167561 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.167731 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.167846 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.167988 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.168076 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.168239 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.168328 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.168482 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.168565 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.168716 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.168799 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.169493 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.169621 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.169878 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.169972 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.170149 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.170341 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.170423 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.170608 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.170686 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.170842 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.170920 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.171075 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.171156 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.171302 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.171375 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.171528 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.171604 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.171781 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.171861 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.172035 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.172119 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.172263 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.172349 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.172495 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.172571 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.172738 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.172815 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.172983 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.173064 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.173220 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.173296 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.173465 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.173543 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.173697 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.173778 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.173931 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.174013 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.174164 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.174242 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.174393 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.174468 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.174620 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.174696 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.174848 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.174926 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.175077 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.175151 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.175310 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.175391 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.175555 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.175624 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.175805 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.175882 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.176041 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.176120 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.176269 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.176365 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.176501 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.176568 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.176730 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.176845 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.176988 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.177068 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.177200 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.177290 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.177436 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.177525 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.177670 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.177753 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.177904 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.177981 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.178136 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.178221 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.178369 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.178448 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.178595 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.178672 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.178839 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.178923 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.179070 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.179148 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.179301 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.179374 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.179530 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.179621 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.179806 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.179899 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.180040 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.180119 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.180267 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.180344 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.180507 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.180592 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.180737 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.180813 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.180997 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.181081 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.181229 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.181314 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.181473 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.181550 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.181705 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.181780 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.181947 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.182035 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.182182 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.182265 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.182414 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.182491 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.182649 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.182798 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.182872 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.182946 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.183100 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.183184 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.183332 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.183418 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.183587 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.183671 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.183849 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.183937 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.184087 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.184171 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.184316 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.184392 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.184542 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.184717 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.185379 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.185468 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.185625 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.185908 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.186038 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.186156 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.186255 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.186397 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.186487 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.186645 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.186729 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.186894 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.186971 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.187129 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.187215 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.187382 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.187466 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.187646 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.187770 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.187910 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.188000 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] auth.external = None {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.188139 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] auth.external = None {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.188217 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.188366 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.188445 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.188655 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.188741 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.188886 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.188963 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] auth.password = None {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.189112 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] auth.password = None {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.189189 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] auth.token = None {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.189337 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] auth.token = None {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.189422 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.189573 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.189649 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.189802 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.189884 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.190045 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.190129 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.190269 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.190346 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.190517 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.190595 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.190758 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.190842 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.190984 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.191073 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] credential.caching = True {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.191215 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] credential.caching = True {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.191292 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.191456 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.191539 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.191714 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.191808 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.191961 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.192041 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.192193 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.192273 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.192433 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.192518 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.192663 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.192740 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.192906 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.192983 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.193153 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.193238 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.193386 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.193469 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.193636 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.193720 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.193915 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.193994 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.194155 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.194235 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.194410 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.194492 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.194644 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.194730 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.194893 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] federation.caching = True {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.194981 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.195123 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] federation.caching = True {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.195208 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.195374 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.195454 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.195617 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.195714 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.195883 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.195972 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.196110 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.196191 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.196354 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.196432 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.196588 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.196665 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.196838 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.196916 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.197067 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.197179 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.197318 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.197396 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.197542 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.197618 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.197785 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.197864 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] identity.caching = True {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.198017 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] identity.caching = True {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.198094 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.198260 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.198340 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.198496 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.198579 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.198726 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.198803 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.198956 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.199035 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.199194 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.199271 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.199418 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.199495 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.199651 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.199761 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.199919 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.199998 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.200161 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.200248 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.200534 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.200637 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.200877 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.200961 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.201132 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.201211 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.201387 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.201467 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.201632 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.201710 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.201878 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.201957 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.202130 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.202209 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.202373 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.202450 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.202637 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.202723 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.202871 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.202955 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.203104 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.203182 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.203328 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.203413 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.203561 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.203640 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.203809 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.203889 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.204050 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.204140 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.204285 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.204363 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.204521 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.204600 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.204759 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.204845 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.204986 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.205063 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.205229 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.205308 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.205472 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.205558 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.205703 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.205789 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.205953 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.206060 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.206184 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.206285 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.206410 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.206489 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.206645 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.206724 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.206872 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.206958 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.207107 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.207186 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.207342 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.207420 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.207580 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.207666 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.207837 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.207922 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.208072 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.208150 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.208316 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.208407 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.208549 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.208627 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.208775 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.208853 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.209002 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.209089 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.209246 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.209325 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.209486 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.209564 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.209714 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.209799 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.209946 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.210024 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.210177 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] ldap.user = None {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.210255 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.210405 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] ldap.user = None {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.210490 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.210639 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.210718 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.210890 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.210969 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.211116 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.211203 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.211358 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.211437 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.211599 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.211677 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.211863 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.211963 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.212096 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.212174 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.212319 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.212397 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.212550 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.212637 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.212780 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.212859 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.213012 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.213090 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.213240 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.213326 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.213480 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.213558 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.213721 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.213799 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.213961 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.214048 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.214201 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.214279 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.214433 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.214510 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.214657 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.214744 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.214901 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.214979 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.215135 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.215214 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.215369 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.215455 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.215603 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.215681 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.216393 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.216499 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.216649 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.216802 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.216882 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.217147 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.217225 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.217383 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.217461 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.217632 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.217712 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.217870 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.217948 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.218108 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.218195 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.218331 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.218411 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.218583 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.218668 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.218822 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.218907 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.219056 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.219133 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.219294 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.219371 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.219526 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.219612 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] resource.caching = True {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.219782 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.219863 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.220020 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] resource.caching = True {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.220098 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.220270 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.220363 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.220519 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.220597 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.220752 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.221083 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.221247 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.221395 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.221496 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.221574 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.221728 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.221807 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.221970 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.222059 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.222202 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.222279 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] role.caching = True {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.222437 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.222515 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] role.driver = sql {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.222668 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.222753 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] role.caching = True {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.222907 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] role.driver = sql {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.222985 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.223133 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.223211 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.223379 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.223465 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.223621 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.223715 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.223895 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.223974 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.224137 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.224226 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.224385 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.224469 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.224624 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.224702 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.224858 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.224943 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.225099 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.225177 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.225328 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.225405 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.225570 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.225656 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.225812 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.225890 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.226052 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.226201 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.226279 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.226443 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.226664 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.226743 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.226898 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.226975 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.227143 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.227222 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.227387 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.227465 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.227631 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.227739 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.227900 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.227980 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.228130 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.228207 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.228378 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.228455 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.228612 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.228691 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.228846 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.228923 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.229073 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.229150 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.229301 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.229381 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.229529 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.229606 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.229776 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.229917 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.230028 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.230109 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.230264 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.230341 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.230500 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.230579 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.230724 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.230802 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] token.caching = True {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.230942 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.231021 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.231173 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] token.caching = True {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.231251 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.231405 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.231561 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.232356 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.232438 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.232538 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.232816 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.232910 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.233082 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.233161 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.233331 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.233410 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.233569 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.233655 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.233812 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.233891 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.234053 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.234131 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.234299 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.234386 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.234535 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.234614 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.234772 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.234852 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.235003 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.235089 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.235244 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.235326 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.235488 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.235566 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.235734 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.235829 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] database.connection = **** {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.235976 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.236055 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.236236 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.236314 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.236492 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] database.connection = **** {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.236578 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.236734 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.236811 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.236975 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.237053 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.237208 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.237293 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.237444 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.237522 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.237675 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.237753 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.237908 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.237994 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.238139 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.238222 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.238373 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.238461 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.238638 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.238716 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.238870 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.238958 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.239109 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.239191 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.239340 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.239418 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.239575 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.239660 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.239828 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.239906 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.240068 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.240147 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.240240 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jan 25 02:22:14.240330 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.240532 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.240765 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 02:22:14.240932 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jan 25 02:22:14.270707 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79120) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 25 02:22:14.270940 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79120) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 25 02:22:14.271172 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79120) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 25 02:22:14.272500 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79121) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 25 02:22:14.273552 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79121) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 25 02:22:14.273552 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79121) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 25 02:22:14.280683 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79120) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 25 02:22:14.282557 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79121) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 25 02:22:14.311426 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79120) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 25 02:22:14.311650 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79120) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 25 02:22:14.312899 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79121) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 25 02:22:14.313139 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79121) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 25 02:22:14.366283 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79121) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 25 02:22:14.366421 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79120) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 25 02:22:14.417161 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79121) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 25 02:22:14.417396 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79121) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 25 02:22:14.418481 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79120) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 25 02:22:14.418719 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79120) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 25 02:22:14.484357 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79121) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 25 02:22:14.484586 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79121) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 25 02:22:14.484811 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79121) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 25 02:22:14.485034 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79121) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 25 02:22:14.485182 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79120) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 25 02:22:14.485286 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79121) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 25 02:22:14.485415 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79120) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 25 02:22:14.485498 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79121) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 25 02:22:14.485637 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79120) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 25 02:22:14.485854 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79120) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 25 02:22:14.486071 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79120) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 25 02:22:14.486285 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79120) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 25 02:22:14.509266 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79121) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 25 02:22:14.509498 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79121) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 25 02:22:14.509722 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79121) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 25 02:22:14.509822 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79120) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 25 02:22:14.509942 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79121) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 25 02:22:14.510025 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79120) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 25 02:22:14.510157 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79121) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 25 02:22:14.510239 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79120) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 25 02:22:14.510370 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79120) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 25 02:22:14.510459 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79121) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 25 02:22:14.510580 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79121) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 25 02:22:14.510661 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79120) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 25 02:22:14.510788 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79120) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 25 02:22:14.510998 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79120) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 25 02:22:14.522644 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79121) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 25 02:22:14.523111 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79120) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 25 02:22:14.535407 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79121) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 25 02:22:14.535637 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79121) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 25 02:22:14.535902 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79121) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 25 02:22:14.536117 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79121) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 25 02:22:14.536336 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79121) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 25 02:22:14.536549 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79121) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 25 02:22:14.536631 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79120) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 25 02:22:14.536762 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79121) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 25 02:22:14.536869 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79120) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 25 02:22:14.537096 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79120) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 25 02:22:14.537318 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79120) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 25 02:22:14.537533 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79120) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 25 02:22:14.537747 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79120) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 25 02:22:14.537960 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79120) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 25 02:22:14.554007 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79121) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 02:22:14.554111 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 02:22:14.554217 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79121) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jan 25 02:22:14.554299 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jan 25 02:22:14.554550 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79121) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 02:22:14.554646 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 02:22:14.554751 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jan 25 02:22:14.554833 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79121) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jan 25 02:22:14.555018 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 02:22:14.555100 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79121) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 02:22:14.555277 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 02:22:14.555367 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79121) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 02:22:14.555533 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79121) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 02:22:14.555614 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 02:22:14.555809 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 02:22:14.555892 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79121) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 02:22:14.567234 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79121) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 02:22:14.567359 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 02:22:14.567512 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79121) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 02:22:14.567600 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 02:22:14.567813 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79121) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 02:22:14.567900 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 02:22:14.568095 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 02:22:14.568181 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79121) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 02:22:14.576809 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79121) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 25 02:22:14.576900 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79120) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 25 02:22:14.580046 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79121) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 25 02:22:14.580146 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79120) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 25 02:22:14.580328 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79121) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 02:22:14.580412 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 02:22:14.582441 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79121) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 02:22:14.582525 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 02:22:14.582732 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79121) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 02:22:14.582816 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 02:22:14.583018 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79121) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 02:22:14.583099 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 02:22:14.583283 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 02:22:14.583364 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79121) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 02:22:14.583555 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79121) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 02:22:14.583638 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 02:22:14.583854 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 02:22:14.583937 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79121) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 02:22:14.584126 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79121) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 02:22:14.584221 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 02:22:14.584399 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 02:22:14.584481 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79121) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 02:22:14.584664 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79121) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 02:22:14.584744 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 02:22:14.613952 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 02:22:14.615059 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79121) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 02:22:14.615537 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79120) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 25 02:22:14.615846 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 02:22:14.616732 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79121) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 25 02:22:14.616971 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79121) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 02:22:14.620975 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79120) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 25 02:22:14.621252 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 02:22:14.621529 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 02:22:14.622137 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79121) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 25 02:22:14.622505 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79121) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 02:22:14.622788 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79121) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 02:22:14.629029 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79120) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 25 02:22:14.629314 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 02:22:14.630079 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79121) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 25 02:22:14.630362 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79121) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 02:22:14.633793 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79120) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 25 02:22:14.634077 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 02:22:14.634354 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 02:22:14.634632 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 02:22:14.634833 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79121) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 25 02:22:14.634916 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 02:22:14.635119 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79121) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 02:22:14.635203 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 02:22:14.635399 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79121) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 02:22:14.635481 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 02:22:14.635661 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 02:22:14.635776 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79121) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 02:22:14.635969 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79121) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 02:22:14.636244 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79121) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 02:22:14.636515 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79121) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 02:22:14.636782 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79121) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 02:22:14.655237 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 02:22:14.655505 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 02:22:14.656099 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79121) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 02:22:14.656378 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79121) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 02:22:14.659951 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79120) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 25 02:22:14.660878 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79121) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 25 02:22:14.663440 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 02:22:14.663749 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 02:22:14.664464 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79121) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 02:22:14.664757 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79121) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 02:22:14.668590 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79120) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 25 02:22:14.670330 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79121) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 25 02:22:14.673089 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79120) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 25 02:22:14.674008 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79121) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 25 02:22:14.676707 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 02:22:14.676881 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 02:22:14.677162 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 02:22:14.677444 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 02:22:14.677558 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79121) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 02:22:14.677721 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 02:22:14.677857 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79121) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 02:22:14.677997 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 02:22:14.678142 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79121) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 02:22:14.678426 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79121) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 02:22:14.678722 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79121) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 02:22:14.679004 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79121) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 02:22:14.697170 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79120) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 25 02:22:14.697448 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 02:22:14.697713 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 02:22:14.697979 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 02:22:14.698334 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79121) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 25 02:22:14.698618 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79121) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 02:22:14.698911 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79121) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 02:22:14.699182 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79121) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 02:22:14.706004 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 02:22:14.706929 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79121) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 02:22:14.707672 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 02:22:14.707975 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 02:22:14.708612 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79121) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 02:22:14.708888 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79121) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 02:22:14.710903 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79120) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 25 02:22:14.711178 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 02:22:14.711463 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 02:22:14.711773 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 02:22:14.711885 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79121) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 25 02:22:14.712047 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 02:22:14.712175 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79121) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 02:22:14.712442 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79121) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 02:22:14.712721 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79121) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 02:22:14.712997 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79121) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 02:22:14.725793 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79120) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 25 02:22:14.726069 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 02:22:14.726342 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 02:22:14.726585 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79121) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 25 02:22:14.726668 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 02:22:14.726864 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79121) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 02:22:14.726946 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 02:22:14.727136 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 02:22:14.727220 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79121) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 02:22:14.727412 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79121) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 02:22:14.727495 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 02:22:14.727709 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79121) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 02:22:14.727996 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79121) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 02:22:14.728284 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79121) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 02:22:14.745711 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79120) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 25 02:22:14.746583 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79121) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 25 02:22:14.749819 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79120) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 25 02:22:14.750351 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79121) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 25 02:22:14.753133 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 02:22:14.753630 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79121) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 02:22:14.754804 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 02:22:14.755195 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79121) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 02:22:14.756414 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79120) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 25 02:22:14.756701 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 02:22:14.756783 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79121) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 25 02:22:14.756979 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 02:22:14.757063 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79121) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 02:22:14.757344 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79121) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 02:22:14.765087 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79121) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 02:22:14.765707 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 02:22:14.766651 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79121) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 25 02:22:14.767269 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79120) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 25 02:22:14.769820 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79121) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 02:22:14.770111 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79121) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 02:22:14.770413 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79121) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 02:22:14.770496 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 02:22:14.770690 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79121) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 02:22:14.770773 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 02:22:14.770996 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 02:22:14.771271 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 02:22:14.780395 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79121) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 25 02:22:14.780680 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79121) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 02:22:14.780957 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79121) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 02:22:14.781206 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79120) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 25 02:22:14.781491 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 02:22:14.781768 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 02:22:14.788634 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79121) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 25 02:22:14.788920 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79121) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 02:22:14.789207 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79121) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 02:22:14.789439 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79120) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 25 02:22:14.789523 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79121) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 02:22:14.789717 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 02:22:14.789801 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79121) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 02:22:14.790000 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 02:22:14.790093 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79121) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 02:22:14.790273 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 02:22:14.790356 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79121) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 02:22:14.790537 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79121) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 02:22:14.790619 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 02:22:14.790807 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79121) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 02:22:14.790894 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 02:22:14.791084 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 02:22:14.791177 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79121) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 02:22:14.791346 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 02:22:14.791427 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79121) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 02:22:14.791605 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79121) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 02:22:14.791688 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 02:22:14.791899 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 02:22:14.792015 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79121) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 02:22:14.792175 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 02:22:14.792269 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79121) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 02:22:14.792444 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 02:22:14.792820 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 02:22:14.793079 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79120) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 25 02:22:14.830465 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x563c4d02e9c0 pid: 79121 (default app) Jan 25 02:22:14.831353 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x563c4d02e9c0 pid: 79120 (default app) Jan 25 02:22:14.834911 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605561a9-faa0-4cf2-9c38-0f907b90effb None None] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:14.835242 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605561a9-faa0-4cf2-9c38-0f907b90effb None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:14.835527 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605561a9-faa0-4cf2-9c38-0f907b90effb None None] PATH_INFO: `/v3` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:14.840267 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1/1] 10.222.0.117 () {50 vars in 796 bytes} [Tue Jan 25 02:22:14 2022] GET /identity/v3/ => generated 256 bytes in 9 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:22:23.122799 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacfbf30-11be-4bbf-975d-c845640d5908 None None] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:23.123334 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacfbf30-11be-4bbf-975d-c845640d5908 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:23.123334 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacfbf30-11be-4bbf-975d-c845640d5908 None None] PATH_INFO: `/` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:23.128406 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1/2] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:22:23 2022] GET /identity => generated 271 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:22:23.133720 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce992d2f-805b-4b5b-b994-2f6ecc00d845 None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:23.134133 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce992d2f-805b-4b5b-b994-2f6ecc00d845 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:23.134283 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce992d2f-805b-4b5b-b994-2f6ecc00d845 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:23.165381 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG oslo_db.sqlalchemy.engines [None req-ce992d2f-805b-4b5b-b994-2f6ecc00d845 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79121) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 25 02:22:23.457087 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG passlib.handlers.bcrypt [None req-ce992d2f-805b-4b5b-b994-2f6ecc00d845 None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=79121) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jan 25 02:22:23.457507 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG passlib.handlers.bcrypt [None req-ce992d2f-805b-4b5b-b994-2f6ecc00d845 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79121) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jan 25 02:22:23.516743 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-ce992d2f-805b-4b5b-b994-2f6ecc00d845 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:22:23.518362 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-ce992d2f-805b-4b5b-b994-2f6ecc00d845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:22:23.646110 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 2/3] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:22:23 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 513 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 25 02:22:23.796916 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacfbf30-11be-4bbf-975d-c845640d5908 None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:22:23.933656 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG oslo_db.sqlalchemy.engines [None req-cacfbf30-11be-4bbf-975d-c845640d5908 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79120) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 25 02:22:24.061168 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacfbf30-11be-4bbf-975d-c845640d5908 None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:22:24.065367 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944de300-90bd-49d3-918a-d75b6a31f206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:22:24.066013 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944de300-90bd-49d3-918a-d75b6a31f206 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:24.066294 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944de300-90bd-49d3-918a-d75b6a31f206 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:24.066564 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944de300-90bd-49d3-918a-d75b6a31f206 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:24.074720 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944de300-90bd-49d3-918a-d75b6a31f206 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:22:24.127792 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: WARNING keystone.common.rbac_enforcer.enforcer [None req-944de300-90bd-49d3-918a-d75b6a31f206 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jan 25 02:22:24.128363 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944de300-90bd-49d3-918a-d75b6a31f206 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:22:24.137434 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 2/4] 10.222.0.117 () {58 vars in 1329 bytes} [Tue Jan 25 02:22:23 2022] GET /identity/v3/auth/tokens => generated 915 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jan 25 02:22:24.143825 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce992d2f-805b-4b5b-b994-2f6ecc00d845 None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:22:24.163779 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce992d2f-805b-4b5b-b994-2f6ecc00d845 None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:22:24.170060 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5316084b-94c6-4be3-ac10-e9dc7a1f2ab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:22:24.171761 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5316084b-94c6-4be3-ac10-e9dc7a1f2ab7 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:24.172196 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5316084b-94c6-4be3-ac10-e9dc7a1f2ab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:24.172625 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5316084b-94c6-4be3-ac10-e9dc7a1f2ab7 admin admin] PATH_INFO: `/v3/projects/705a3c6650674528a0096768eea3fe81` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:24.174902 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5316084b-94c6-4be3-ac10-e9dc7a1f2ab7 admin admin] RBAC: Authorizing `identity:get_project(project_id=705a3c6650674528a0096768eea3fe81)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:22:24.236567 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: WARNING keystone.common.rbac_enforcer.enforcer [None req-5316084b-94c6-4be3-ac10-e9dc7a1f2ab7 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jan 25 02:22:24.237108 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5316084b-94c6-4be3-ac10-e9dc7a1f2ab7 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:22:24.241873 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 3/5] 10.222.0.117 () {56 vars in 1212 bytes} [Tue Jan 25 02:22:24 2022] GET /identity/v3/projects/705a3c6650674528a0096768eea3fe81 => generated 345 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:22:26.447054 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66cedcf-573f-45f2-9366-d69e9fa4c23e None None] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:26.447575 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66cedcf-573f-45f2-9366-d69e9fa4c23e None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:26.447683 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66cedcf-573f-45f2-9366-d69e9fa4c23e None None] PATH_INFO: `/` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:26.452935 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 3/6] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:22:26 2022] GET /identity => generated 271 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jan 25 02:22:26.458975 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6a8773-9a2b-4f5c-804d-d78f2367da6f None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:26.458975 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6a8773-9a2b-4f5c-804d-d78f2367da6f None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:26.459817 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6a8773-9a2b-4f5c-804d-d78f2367da6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:26.478614 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-ec6a8773-9a2b-4f5c-804d-d78f2367da6f None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:22:26.480164 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-ec6a8773-9a2b-4f5c-804d-d78f2367da6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:22:26.488731 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 4/7] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:22:26 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 25 02:22:26.511232 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66cedcf-573f-45f2-9366-d69e9fa4c23e None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:22:26.523436 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66cedcf-573f-45f2-9366-d69e9fa4c23e None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:22:26.527725 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7b2fb2-5c6e-44f5-b50f-72236a56b9df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:22:26.529305 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7b2fb2-5c6e-44f5-b50f-72236a56b9df admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:26.529445 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7b2fb2-5c6e-44f5-b50f-72236a56b9df admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:26.529729 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7b2fb2-5c6e-44f5-b50f-72236a56b9df admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:26.537527 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7b2fb2-5c6e-44f5-b50f-72236a56b9df admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:22:26.539297 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7b2fb2-5c6e-44f5-b50f-72236a56b9df admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:22:26.548948 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 4/8] 10.222.0.117 () {58 vars in 1329 bytes} [Tue Jan 25 02:22:26 2022] GET /identity/v3/auth/tokens => generated 915 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 25 02:22:26.554526 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6a8773-9a2b-4f5c-804d-d78f2367da6f None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:22:26.563684 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6a8773-9a2b-4f5c-804d-d78f2367da6f None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:22:26.568089 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67abed3c-207d-4fc7-902d-e077f3167b36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:22:26.568948 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67abed3c-207d-4fc7-902d-e077f3167b36 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:26.569233 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67abed3c-207d-4fc7-902d-e077f3167b36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:26.569508 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67abed3c-207d-4fc7-902d-e077f3167b36 admin admin] PATH_INFO: `/v3/users/3db97686d01f422cb62642c302e35e45` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:26.570911 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67abed3c-207d-4fc7-902d-e077f3167b36 admin admin] RBAC: Authorizing `identity:get_user(user_id=3db97686d01f422cb62642c302e35e45)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:22:26.572785 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67abed3c-207d-4fc7-902d-e077f3167b36 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:22:26.574335 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 5/9] 10.222.0.117 () {56 vars in 1203 bytes} [Tue Jan 25 02:22:26 2022] GET /identity/v3/users/3db97686d01f422cb62642c302e35e45 => generated 248 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:22:28.891307 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c44569b-eeea-48e8-b682-ad0e6a06ba60 None None] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:28.891849 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c44569b-eeea-48e8-b682-ad0e6a06ba60 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:28.891988 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c44569b-eeea-48e8-b682-ad0e6a06ba60 None None] PATH_INFO: `/` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:28.893736 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 5/10] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:22:28 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:22:28.899015 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6300b74d-ad6d-4dde-b822-e7c3faf7b293 None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:28.899431 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6300b74d-ad6d-4dde-b822-e7c3faf7b293 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:28.899585 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6300b74d-ad6d-4dde-b822-e7c3faf7b293 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:28.917548 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-6300b74d-ad6d-4dde-b822-e7c3faf7b293 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:22:28.918727 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6181b6d-c246-4e9f-bb97-94e574277323 None None] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:28.918834 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-6300b74d-ad6d-4dde-b822-e7c3faf7b293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:22:28.919027 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6181b6d-c246-4e9f-bb97-94e574277323 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:28.919585 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6181b6d-c246-4e9f-bb97-94e574277323 None None] PATH_INFO: `/` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:28.921157 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 6/11] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:22:28 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:22:28.926251 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc8dc69-c80e-4320-bcb4-d3c2d8263f61 None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:28.926585 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc8dc69-c80e-4320-bcb4-d3c2d8263f61 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:28.926821 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc8dc69-c80e-4320-bcb4-d3c2d8263f61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:28.927154 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 6/12] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:22:28 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 25 02:22:28.951969 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6300b74d-ad6d-4dde-b822-e7c3faf7b293 None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:22:28.960784 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6300b74d-ad6d-4dde-b822-e7c3faf7b293 None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:22:28.965475 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905f39f8-2718-46a8-9b47-6a1e99cafc57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:22:28.966650 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905f39f8-2718-46a8-9b47-6a1e99cafc57 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:28.966938 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905f39f8-2718-46a8-9b47-6a1e99cafc57 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:28.967216 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905f39f8-2718-46a8-9b47-6a1e99cafc57 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:28.968360 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG passlib.handlers.bcrypt [None req-2fc8dc69-c80e-4320-bcb4-d3c2d8263f61 None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=79120) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jan 25 02:22:28.968812 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG passlib.handlers.bcrypt [None req-2fc8dc69-c80e-4320-bcb4-d3c2d8263f61 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79120) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jan 25 02:22:28.982245 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905f39f8-2718-46a8-9b47-6a1e99cafc57 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 25 02:22:28.989134 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: WARNING keystone.server.flask.application [None req-905f39f8-2718-46a8-9b47-6a1e99cafc57 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 25 02:22:28.990311 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 7/13] 10.222.0.117 () {56 vars in 1122 bytes} [Tue Jan 25 02:22:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:22:28.995862 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905f39f8-2718-46a8-9b47-6a1e99cafc57 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:22:29.005595 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905f39f8-2718-46a8-9b47-6a1e99cafc57 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:22:29.009903 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a011ce4b-3ce3-40e8-97aa-044a0238e14e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:22:29.010501 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a011ce4b-3ce3-40e8-97aa-044a0238e14e admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:29.010787 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a011ce4b-3ce3-40e8-97aa-044a0238e14e admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:29.011063 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a011ce4b-3ce3-40e8-97aa-044a0238e14e admin admin] PATH_INFO: `/v3/roles` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:29.011853 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a011ce4b-3ce3-40e8-97aa-044a0238e14e admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:22:29.012163 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a011ce4b-3ce3-40e8-97aa-044a0238e14e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:22:29.014540 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: WARNING py.warnings [None req-a011ce4b-3ce3-40e8-97aa-044a0238e14e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 25 02:22:29.014540 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: warnings.warn(msg) Jan 25 02:22:29.014540 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: Jan 25 02:22:29.015596 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a011ce4b-3ce3-40e8-97aa-044a0238e14e admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:22:29.016733 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-2fc8dc69-c80e-4320-bcb4-d3c2d8263f61 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:22:29.018370 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-2fc8dc69-c80e-4320-bcb4-d3c2d8263f61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:22:29.029421 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 8/14] 10.222.0.117 () {56 vars in 1125 bytes} [Tue Jan 25 02:22:28 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 02:22:29.034699 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a011ce4b-3ce3-40e8-97aa-044a0238e14e admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:22:29.042232 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 7/15] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:22:28 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 25 02:22:29.044582 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a011ce4b-3ce3-40e8-97aa-044a0238e14e admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:22:29.048874 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48605c6f-ffa9-4730-8719-6e166c6151c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:22:29.049709 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48605c6f-ffa9-4730-8719-6e166c6151c3 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:29.049996 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48605c6f-ffa9-4730-8719-6e166c6151c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:29.050274 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48605c6f-ffa9-4730-8719-6e166c6151c3 admin admin] PATH_INFO: `/v3/users/3db97686d01f422cb62642c302e35e45` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:29.051504 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48605c6f-ffa9-4730-8719-6e166c6151c3 admin admin] RBAC: Authorizing `identity:get_user(user_id=3db97686d01f422cb62642c302e35e45)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:22:29.053369 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48605c6f-ffa9-4730-8719-6e166c6151c3 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:22:29.054901 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 9/16] 10.222.0.117 () {56 vars in 1203 bytes} [Tue Jan 25 02:22:29 2022] GET /identity/v3/users/3db97686d01f422cb62642c302e35e45 => generated 248 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 02:22:29.060568 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc8dc69-c80e-4320-bcb4-d3c2d8263f61 None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:22:29.065241 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48605c6f-ffa9-4730-8719-6e166c6151c3 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:22:29.070241 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc8dc69-c80e-4320-bcb4-d3c2d8263f61 None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:22:29.074537 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48605c6f-ffa9-4730-8719-6e166c6151c3 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:22:29.074635 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed0e8be-502f-4b87-850c-53347c5724fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:22:29.076131 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed0e8be-502f-4b87-850c-53347c5724fb admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:29.076422 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed0e8be-502f-4b87-850c-53347c5724fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:29.076703 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed0e8be-502f-4b87-850c-53347c5724fb admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:29.078180 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed0e8be-502f-4b87-850c-53347c5724fb admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:22:29.079095 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92766747-239a-4a28-8680-90a4b74b4134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:22:29.079739 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92766747-239a-4a28-8680-90a4b74b4134 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:29.079988 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed0e8be-502f-4b87-850c-53347c5724fb admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:22:29.080070 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92766747-239a-4a28-8680-90a4b74b4134 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:29.080292 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92766747-239a-4a28-8680-90a4b74b4134 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:29.081712 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 8/17] 10.222.0.117 () {56 vars in 1134 bytes} [Tue Jan 25 02:22:29 2022] GET /identity/v3/domains/default => generated 200 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:22:29.086889 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed0e8be-502f-4b87-850c-53347c5724fb admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:22:29.088274 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92766747-239a-4a28-8680-90a4b74b4134 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:22:29.090042 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92766747-239a-4a28-8680-90a4b74b4134 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:22:29.096581 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed0e8be-502f-4b87-850c-53347c5724fb admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:22:29.099124 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 10/18] 10.222.0.117 () {58 vars in 1329 bytes} [Tue Jan 25 02:22:29 2022] GET /identity/v3/auth/tokens => generated 915 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jan 25 02:22:29.101070 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c227494c-c49b-4a7d-b549-b1e500468cc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:22:29.101690 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c227494c-c49b-4a7d-b549-b1e500468cc1 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:29.101972 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c227494c-c49b-4a7d-b549-b1e500468cc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:29.102247 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c227494c-c49b-4a7d-b549-b1e500468cc1 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:29.103095 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c227494c-c49b-4a7d-b549-b1e500468cc1 admin admin] RBAC: Adding query filter params (role.id=d8dbc6d83d9d41d28c3feb8b3485b291, scope.domain.id=default, user.id=3db97686d01f422cb62642c302e35e45) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:22:29.103391 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c227494c-c49b-4a7d-b549-b1e500468cc1 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:22:29.104227 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92766747-239a-4a28-8680-90a4b74b4134 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:22:29.105143 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: WARNING py.warnings [None req-c227494c-c49b-4a7d-b549-b1e500468cc1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_role_assignments": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 25 02:22:29.105143 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: warnings.warn(msg) Jan 25 02:22:29.105143 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: Jan 25 02:22:29.106859 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c227494c-c49b-4a7d-b549-b1e500468cc1 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:22:29.113263 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92766747-239a-4a28-8680-90a4b74b4134 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:22:29.115666 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 9/19] 10.222.0.117 () {56 vars in 1348 bytes} [Tue Jan 25 02:22:29 2022] GET /identity/v3/role_assignments?user.id=3db97686d01f422cb62642c302e35e45&scope.domain.id=default&role.id=d8dbc6d83d9d41d28c3feb8b3485b291 => generated 234 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 02:22:29.117630 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abe2855-4cea-495d-8cad-5bb9868685cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:22:29.118428 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abe2855-4cea-495d-8cad-5bb9868685cb admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:29.118715 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abe2855-4cea-495d-8cad-5bb9868685cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:29.118988 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abe2855-4cea-495d-8cad-5bb9868685cb admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:29.120218 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abe2855-4cea-495d-8cad-5bb9868685cb admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:22:29.122611 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abe2855-4cea-495d-8cad-5bb9868685cb admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:22:29.124498 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 11/20] 10.222.0.117 () {56 vars in 1134 bytes} [Tue Jan 25 02:22:29 2022] GET /identity/v3/domains/default => generated 200 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 02:22:32.129393 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf9d36e-678d-41a6-945a-3a12c2a42008 None None] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:32.130318 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf9d36e-678d-41a6-945a-3a12c2a42008 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:32.130776 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf9d36e-678d-41a6-945a-3a12c2a42008 None None] PATH_INFO: `/` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:32.132903 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 10/21] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:22:32 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:22:32.139550 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86383c35-362f-4944-9460-48e888086a1a None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:32.140115 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86383c35-362f-4944-9460-48e888086a1a None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:32.140115 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86383c35-362f-4944-9460-48e888086a1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:32.165497 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1e8ebe-4c91-4985-9c4f-24157379af74 None None] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:32.166146 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1e8ebe-4c91-4985-9c4f-24157379af74 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:32.166648 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1e8ebe-4c91-4985-9c4f-24157379af74 None None] PATH_INFO: `/` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:32.168012 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-86383c35-362f-4944-9460-48e888086a1a None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:22:32.169544 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 11/22] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:22:32 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jan 25 02:22:32.170504 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-86383c35-362f-4944-9460-48e888086a1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:22:32.179559 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719820bb-3296-4370-8e8b-6892b99d937f None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:32.180045 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719820bb-3296-4370-8e8b-6892b99d937f None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:32.180548 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719820bb-3296-4370-8e8b-6892b99d937f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:32.183519 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 12/23] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:22:32 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 25 02:22:32.210654 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-719820bb-3296-4370-8e8b-6892b99d937f None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:22:32.212057 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-719820bb-3296-4370-8e8b-6892b99d937f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:22:32.224431 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f21cf5-a334-460f-a211-af7bf15bae5d None None] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:32.224574 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 12/24] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:22:32 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 25 02:22:32.225331 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f21cf5-a334-460f-a211-af7bf15bae5d None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:32.225806 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f21cf5-a334-460f-a211-af7bf15bae5d None None] PATH_INFO: `/` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:32.228292 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 13/25] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:22:32 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:22:32.235767 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f21cf5-a334-460f-a211-af7bf15bae5d None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:22:32.236337 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030d15a5-8b13-47de-9e4b-eaf007847cc9 None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:32.236618 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030d15a5-8b13-47de-9e4b-eaf007847cc9 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:32.236908 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030d15a5-8b13-47de-9e4b-eaf007847cc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:32.257318 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f21cf5-a334-460f-a211-af7bf15bae5d None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:22:32.266715 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50ac2aa-a36a-4109-ad3c-98b653eb137b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:22:32.267844 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50ac2aa-a36a-4109-ad3c-98b653eb137b admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:32.268399 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50ac2aa-a36a-4109-ad3c-98b653eb137b admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:32.268873 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50ac2aa-a36a-4109-ad3c-98b653eb137b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:32.269349 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-030d15a5-8b13-47de-9e4b-eaf007847cc9 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:22:32.271348 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-030d15a5-8b13-47de-9e4b-eaf007847cc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:22:32.285503 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50ac2aa-a36a-4109-ad3c-98b653eb137b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:22:32.287687 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50ac2aa-a36a-4109-ad3c-98b653eb137b admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:22:32.292285 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 13/26] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:22:32 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 25 02:22:32.293391 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030d15a5-8b13-47de-9e4b-eaf007847cc9 None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:22:32.309278 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: WARNING keystone.server.flask.application [None req-e50ac2aa-a36a-4109-ad3c-98b653eb137b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 25 02:22:32.310345 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030d15a5-8b13-47de-9e4b-eaf007847cc9 None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:22:32.312091 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 14/27] 10.222.0.117 () {56 vars in 1134 bytes} [Tue Jan 25 02:22:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:22:32.320931 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50ac2aa-a36a-4109-ad3c-98b653eb137b admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:22:32.327962 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eca6e5b-4268-4afb-93e4-30dbdb2e698c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:22:32.328992 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eca6e5b-4268-4afb-93e4-30dbdb2e698c admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:32.329411 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eca6e5b-4268-4afb-93e4-30dbdb2e698c admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:32.329820 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eca6e5b-4268-4afb-93e4-30dbdb2e698c admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:32.335634 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50ac2aa-a36a-4109-ad3c-98b653eb137b admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:22:32.347474 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2918fc3-f756-4f76-b67b-d412cb980f30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:22:32.348515 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2918fc3-f756-4f76-b67b-d412cb980f30 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:32.349001 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2918fc3-f756-4f76-b67b-d412cb980f30 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:32.349489 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2918fc3-f756-4f76-b67b-d412cb980f30 admin admin] PATH_INFO: `/v3/domains` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:32.350067 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eca6e5b-4268-4afb-93e4-30dbdb2e698c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 25 02:22:32.350464 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2918fc3-f756-4f76-b67b-d412cb980f30 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:22:32.350776 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2918fc3-f756-4f76-b67b-d412cb980f30 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:22:32.355994 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: WARNING py.warnings [None req-c2918fc3-f756-4f76-b67b-d412cb980f30 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 25 02:22:32.355994 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: warnings.warn(msg) Jan 25 02:22:32.355994 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: Jan 25 02:22:32.358199 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2918fc3-f756-4f76-b67b-d412cb980f30 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:22:32.359406 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: WARNING keystone.server.flask.application [None req-6eca6e5b-4268-4afb-93e4-30dbdb2e698c admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 25 02:22:32.361332 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 14/28] 10.222.0.117 () {56 vars in 1122 bytes} [Tue Jan 25 02:22:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:22:32.362396 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eca6e5b-4268-4afb-93e4-30dbdb2e698c admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:22:32.378076 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eca6e5b-4268-4afb-93e4-30dbdb2e698c admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:22:32.378414 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 15/29] 10.222.0.117 () {56 vars in 1135 bytes} [Tue Jan 25 02:22:32 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:22:32.379283 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2918fc3-f756-4f76-b67b-d412cb980f30 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:22:32.393988 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2918fc3-f756-4f76-b67b-d412cb980f30 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:22:32.394883 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2549f45d-e8bd-4e19-a5b9-284fae47fcec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:22:32.395820 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2549f45d-e8bd-4e19-a5b9-284fae47fcec admin admin] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:32.396314 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2549f45d-e8bd-4e19-a5b9-284fae47fcec admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:32.396842 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2549f45d-e8bd-4e19-a5b9-284fae47fcec admin admin] PATH_INFO: `/v3/roles` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:32.397825 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2549f45d-e8bd-4e19-a5b9-284fae47fcec admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:22:32.399071 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: WARNING py.warnings [None req-2549f45d-e8bd-4e19-a5b9-284fae47fcec admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 25 02:22:32.399071 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: warnings.warn(msg) Jan 25 02:22:32.399071 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: Jan 25 02:22:32.400392 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2549f45d-e8bd-4e19-a5b9-284fae47fcec admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:22:32.408386 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a406891-97a2-4549-8daa-c5538e46381a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:22:32.409391 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a406891-97a2-4549-8daa-c5538e46381a admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:32.409938 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a406891-97a2-4549-8daa-c5538e46381a admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:32.410421 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a406891-97a2-4549-8daa-c5538e46381a admin admin] PATH_INFO: `/v3/roles` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:32.411490 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a406891-97a2-4549-8daa-c5538e46381a admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:22:32.412030 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a406891-97a2-4549-8daa-c5538e46381a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:22:32.413878 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a406891-97a2-4549-8daa-c5538e46381a admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:22:32.441711 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 16/30] 10.222.0.117 () {56 vars in 1125 bytes} [Tue Jan 25 02:22:32 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:22:32.442883 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a406891-97a2-4549-8daa-c5538e46381a admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:22:32.453861 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a406891-97a2-4549-8daa-c5538e46381a admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:22:32.458801 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f043bce-b7e8-4b4a-af7a-b667a853091f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:22:32.459688 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f043bce-b7e8-4b4a-af7a-b667a853091f admin admin] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:32.460208 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f043bce-b7e8-4b4a-af7a-b667a853091f admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:32.460713 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f043bce-b7e8-4b4a-af7a-b667a853091f admin admin] PATH_INFO: `/v3/projects` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:32.461664 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f043bce-b7e8-4b4a-af7a-b667a853091f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:22:32.462905 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: WARNING py.warnings [None req-9f043bce-b7e8-4b4a-af7a-b667a853091f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 25 02:22:32.462905 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: warnings.warn(msg) Jan 25 02:22:32.462905 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: Jan 25 02:22:32.464558 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f043bce-b7e8-4b4a-af7a-b667a853091f admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:22:32.542060 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 15/31] 10.222.0.117 () {60 vars in 1157 bytes} [Tue Jan 25 02:22:32 2022] POST /identity/v3/roles => generated 220 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 02:22:32.542060 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6f95d7-182f-4656-9bb3-378dfb371a9d None None] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:32.542060 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6f95d7-182f-4656-9bb3-378dfb371a9d None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:32.542060 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6f95d7-182f-4656-9bb3-378dfb371a9d None None] PATH_INFO: `/` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:32.542060 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 16/32] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:22:32 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:22:32.546716 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6f95d7-182f-4656-9bb3-378dfb371a9d None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:22:32.561577 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6f95d7-182f-4656-9bb3-378dfb371a9d None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:22:32.566536 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1851798a-2f6c-4b8b-97f2-e750c834a970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:22:32.567815 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1851798a-2f6c-4b8b-97f2-e750c834a970 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:32.568315 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1851798a-2f6c-4b8b-97f2-e750c834a970 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:32.568799 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1851798a-2f6c-4b8b-97f2-e750c834a970 admin admin] PATH_INFO: `/v3/users/3db97686d01f422cb62642c302e35e45` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:32.570764 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1851798a-2f6c-4b8b-97f2-e750c834a970 admin admin] RBAC: Authorizing `identity:get_user(user_id=3db97686d01f422cb62642c302e35e45)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:22:32.573209 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1851798a-2f6c-4b8b-97f2-e750c834a970 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:22:32.575887 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 17/33] 10.222.0.117 () {56 vars in 1203 bytes} [Tue Jan 25 02:22:32 2022] GET /identity/v3/users/3db97686d01f422cb62642c302e35e45 => generated 248 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:22:32.577414 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdec6e4-c5e9-456d-b175-8a593c89637a None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:32.577912 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdec6e4-c5e9-456d-b175-8a593c89637a None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:32.578393 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdec6e4-c5e9-456d-b175-8a593c89637a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:32.604360 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-4bdec6e4-c5e9-456d-b175-8a593c89637a None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:22:32.606276 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-4bdec6e4-c5e9-456d-b175-8a593c89637a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:22:32.617729 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 18/34] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:22:32 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 25 02:22:32.623723 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdec6e4-c5e9-456d-b175-8a593c89637a None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:22:32.637190 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdec6e4-c5e9-456d-b175-8a593c89637a None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:22:32.649888 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922eba81-f028-4cc4-b1e4-da278ab6fb92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:22:32.651020 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922eba81-f028-4cc4-b1e4-da278ab6fb92 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:32.651551 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922eba81-f028-4cc4-b1e4-da278ab6fb92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:32.652093 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922eba81-f028-4cc4-b1e4-da278ab6fb92 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:32.656614 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922eba81-f028-4cc4-b1e4-da278ab6fb92 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:22:32.658694 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922eba81-f028-4cc4-b1e4-da278ab6fb92 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:22:32.660630 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 19/35] 10.222.0.117 () {56 vars in 1134 bytes} [Tue Jan 25 02:22:32 2022] GET /identity/v3/domains/default => generated 200 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:22:32.666765 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922eba81-f028-4cc4-b1e4-da278ab6fb92 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:22:32.670258 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 17/36] 10.222.0.117 () {60 vars in 1167 bytes} [Tue Jan 25 02:22:32 2022] POST /identity/v3/projects => generated 302 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 02:22:32.672095 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f043bce-b7e8-4b4a-af7a-b667a853091f admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:22:32.686985 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922eba81-f028-4cc4-b1e4-da278ab6fb92 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:22:32.768924 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec43f960-5b2d-4e5c-9bfd-b845b106e51d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:22:32.769830 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec43f960-5b2d-4e5c-9bfd-b845b106e51d admin admin] REQUEST_METHOD: `PUT` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:32.770115 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec43f960-5b2d-4e5c-9bfd-b845b106e51d admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:32.770403 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec43f960-5b2d-4e5c-9bfd-b845b106e51d admin admin] PATH_INFO: `/v3/domains/default/users/3db97686d01f422cb62642c302e35e45/roles/d8dbc6d83d9d41d28c3feb8b3485b291` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:32.772581 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec43f960-5b2d-4e5c-9bfd-b845b106e51d admin admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=3db97686d01f422cb62642c302e35e45, role_id=d8dbc6d83d9d41d28c3feb8b3485b291)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:22:32.773742 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: WARNING py.warnings [None req-ec43f960-5b2d-4e5c-9bfd-b845b106e51d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 25 02:22:32.773742 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: warnings.warn(msg) Jan 25 02:22:32.773742 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: Jan 25 02:22:32.776307 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec43f960-5b2d-4e5c-9bfd-b845b106e51d admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:22:32.780534 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f043bce-b7e8-4b4a-af7a-b667a853091f admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:22:32.792637 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51b05b2-9b91-405e-98a1-5f4478f65b06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:22:32.793394 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51b05b2-9b91-405e-98a1-5f4478f65b06 admin admin] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:32.794290 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51b05b2-9b91-405e-98a1-5f4478f65b06 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:32.794734 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51b05b2-9b91-405e-98a1-5f4478f65b06 admin admin] PATH_INFO: `/v3/roles` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:32.795560 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51b05b2-9b91-405e-98a1-5f4478f65b06 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:22:32.797496 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: WARNING py.warnings [None req-f51b05b2-9b91-405e-98a1-5f4478f65b06 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 25 02:22:32.797496 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: warnings.warn(msg) Jan 25 02:22:32.797496 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: Jan 25 02:22:32.798855 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51b05b2-9b91-405e-98a1-5f4478f65b06 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:22:32.808756 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 20/37] 10.222.0.117 () {58 vars in 1387 bytes} [Tue Jan 25 02:22:32 2022] PUT /identity/v3/domains/default/users/3db97686d01f422cb62642c302e35e45/roles/d8dbc6d83d9d41d28c3feb8b3485b291 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 25 02:22:32.834469 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 18/38] 10.222.0.117 () {60 vars in 1157 bytes} [Tue Jan 25 02:22:32 2022] POST /identity/v3/roles => generated 226 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 25 02:22:33.602911 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb469cf-12fe-4616-bfff-2d10137fdacd None None] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:33.604346 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb469cf-12fe-4616-bfff-2d10137fdacd None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:33.604346 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb469cf-12fe-4616-bfff-2d10137fdacd None None] PATH_INFO: `/` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:33.605392 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 21/39] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:22:33 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:22:33.611156 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58959d9-33f3-4e87-a5a9-c5ec8fc92cd0 None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:33.611576 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58959d9-33f3-4e87-a5a9-c5ec8fc92cd0 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:33.611646 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d72656b-02ef-484a-9d74-42d76eb3024d None None] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:33.611961 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58959d9-33f3-4e87-a5a9-c5ec8fc92cd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:33.612063 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d72656b-02ef-484a-9d74-42d76eb3024d None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:33.612131 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d72656b-02ef-484a-9d74-42d76eb3024d None None] PATH_INFO: `/` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:33.613860 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 22/40] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:22:33 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jan 25 02:22:33.618575 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300f79b1-43e1-4cc5-8299-0be189e5b77f None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:33.618869 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300f79b1-43e1-4cc5-8299-0be189e5b77f None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:33.619147 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300f79b1-43e1-4cc5-8299-0be189e5b77f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:33.630202 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-c58959d9-33f3-4e87-a5a9-c5ec8fc92cd0 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:22:33.632115 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-c58959d9-33f3-4e87-a5a9-c5ec8fc92cd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:22:33.636694 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-300f79b1-43e1-4cc5-8299-0be189e5b77f None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:22:33.638831 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-300f79b1-43e1-4cc5-8299-0be189e5b77f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:22:33.699014 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 23/41] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:22:33 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 25 02:22:33.699355 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 19/42] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:22:33 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 25 02:22:33.722429 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300f79b1-43e1-4cc5-8299-0be189e5b77f None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:22:33.723397 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58959d9-33f3-4e87-a5a9-c5ec8fc92cd0 None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:22:33.732758 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300f79b1-43e1-4cc5-8299-0be189e5b77f None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:22:33.733053 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58959d9-33f3-4e87-a5a9-c5ec8fc92cd0 None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:22:33.737184 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf2464e-051c-4879-a451-52efb02fdf12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:22:33.737303 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06a0ac9-5e0c-4a4d-ae7f-ec5d0f48944d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:22:33.737855 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf2464e-051c-4879-a451-52efb02fdf12 admin admin] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:33.738076 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06a0ac9-5e0c-4a4d-ae7f-ec5d0f48944d admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:33.738168 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf2464e-051c-4879-a451-52efb02fdf12 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:33.738359 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06a0ac9-5e0c-4a4d-ae7f-ec5d0f48944d admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:33.738449 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf2464e-051c-4879-a451-52efb02fdf12 admin admin] PATH_INFO: `/v3/roles` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:33.738633 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06a0ac9-5e0c-4a4d-ae7f-ec5d0f48944d admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:33.739168 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf2464e-051c-4879-a451-52efb02fdf12 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:22:33.739841 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06a0ac9-5e0c-4a4d-ae7f-ec5d0f48944d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:22:33.740846 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf2464e-051c-4879-a451-52efb02fdf12 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:22:33.741557 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06a0ac9-5e0c-4a4d-ae7f-ec5d0f48944d admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:22:33.743297 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 20/43] 10.222.0.117 () {56 vars in 1134 bytes} [Tue Jan 25 02:22:33 2022] GET /identity/v3/domains/default => generated 200 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 02:22:33.750656 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06a0ac9-5e0c-4a4d-ae7f-ec5d0f48944d admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:22:33.762887 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 24/44] 10.222.0.117 () {60 vars in 1157 bytes} [Tue Jan 25 02:22:33 2022] POST /identity/v3/roles => generated 224 bytes in 33 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 02:22:33.763079 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06a0ac9-5e0c-4a4d-ae7f-ec5d0f48944d admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:22:33.766087 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd82fbd9-1390-4089-9cea-56596ead0fcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:22:33.766808 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd82fbd9-1390-4089-9cea-56596ead0fcc admin admin] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:33.767222 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd82fbd9-1390-4089-9cea-56596ead0fcc admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:33.767532 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd82fbd9-1390-4089-9cea-56596ead0fcc admin admin] PATH_INFO: `/v3/projects` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:33.768343 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd82fbd9-1390-4089-9cea-56596ead0fcc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:22:33.770359 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd82fbd9-1390-4089-9cea-56596ead0fcc admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:22:33.800089 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 21/45] 10.222.0.117 () {60 vars in 1167 bytes} [Tue Jan 25 02:22:33 2022] POST /identity/v3/projects => generated 313 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 25 02:22:35.216500 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bc41b1-4fa6-4590-a3b6-17f427ff82cb None None] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:35.217092 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bc41b1-4fa6-4590-a3b6-17f427ff82cb None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:35.217092 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bc41b1-4fa6-4590-a3b6-17f427ff82cb None None] PATH_INFO: `/` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:35.218826 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 25/46] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:22:35 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:22:35.224520 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7662220-9752-4fa7-b2ba-0f057ad6690d None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:35.224925 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7662220-9752-4fa7-b2ba-0f057ad6690d None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:35.225172 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7662220-9752-4fa7-b2ba-0f057ad6690d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:35.243369 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-e7662220-9752-4fa7-b2ba-0f057ad6690d None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:22:35.244605 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-e7662220-9752-4fa7-b2ba-0f057ad6690d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:22:35.300231 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 22/47] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:22:35 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 25 02:22:35.324112 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bc41b1-4fa6-4590-a3b6-17f427ff82cb None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:22:35.336379 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bc41b1-4fa6-4590-a3b6-17f427ff82cb None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:22:35.341220 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de8bd86-0d4c-480b-8969-35c013bbe1a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:22:35.342095 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de8bd86-0d4c-480b-8969-35c013bbe1a9 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:35.342446 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de8bd86-0d4c-480b-8969-35c013bbe1a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:35.342790 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de8bd86-0d4c-480b-8969-35c013bbe1a9 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:35.353089 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de8bd86-0d4c-480b-8969-35c013bbe1a9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 25 02:22:35.360529 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: WARNING keystone.server.flask.application [None req-2de8bd86-0d4c-480b-8969-35c013bbe1a9 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 25 02:22:35.361701 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 26/48] 10.222.0.117 () {56 vars in 1122 bytes} [Tue Jan 25 02:22:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:22:35.367287 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7662220-9752-4fa7-b2ba-0f057ad6690d None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:22:35.376382 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7662220-9752-4fa7-b2ba-0f057ad6690d None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:22:35.380859 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc26dace-e419-472a-b58b-fb72de107c66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:22:35.381607 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc26dace-e419-472a-b58b-fb72de107c66 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:35.381989 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc26dace-e419-472a-b58b-fb72de107c66 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:35.382276 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc26dace-e419-472a-b58b-fb72de107c66 admin admin] PATH_INFO: `/v3/roles` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:35.383083 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc26dace-e419-472a-b58b-fb72de107c66 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:22:35.383396 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc26dace-e419-472a-b58b-fb72de107c66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:22:35.385201 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc26dace-e419-472a-b58b-fb72de107c66 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:22:35.393576 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 23/49] 10.222.0.117 () {56 vars in 1125 bytes} [Tue Jan 25 02:22:35 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 02:22:35.398526 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de8bd86-0d4c-480b-8969-35c013bbe1a9 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:22:35.409399 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de8bd86-0d4c-480b-8969-35c013bbe1a9 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:22:35.413778 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a597172b-57c9-4657-89c1-17ca571df24d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:22:35.414630 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a597172b-57c9-4657-89c1-17ca571df24d admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:35.414916 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a597172b-57c9-4657-89c1-17ca571df24d admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:35.415198 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a597172b-57c9-4657-89c1-17ca571df24d admin admin] PATH_INFO: `/v3/users/3db97686d01f422cb62642c302e35e45` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:35.416441 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a597172b-57c9-4657-89c1-17ca571df24d admin admin] RBAC: Authorizing `identity:get_user(user_id=3db97686d01f422cb62642c302e35e45)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:22:35.418269 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a597172b-57c9-4657-89c1-17ca571df24d admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:22:35.420612 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 27/50] 10.222.0.117 () {56 vars in 1203 bytes} [Tue Jan 25 02:22:35 2022] GET /identity/v3/users/3db97686d01f422cb62642c302e35e45 => generated 248 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:22:35.425796 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc26dace-e419-472a-b58b-fb72de107c66 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:22:35.436226 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc26dace-e419-472a-b58b-fb72de107c66 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:22:35.440637 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b6b14d-03e6-4244-9498-6ce5684d7e30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:22:35.441431 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b6b14d-03e6-4244-9498-6ce5684d7e30 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:35.441722 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b6b14d-03e6-4244-9498-6ce5684d7e30 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:35.442317 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b6b14d-03e6-4244-9498-6ce5684d7e30 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:35.443191 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b6b14d-03e6-4244-9498-6ce5684d7e30 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:22:35.444964 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b6b14d-03e6-4244-9498-6ce5684d7e30 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:22:35.446549 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 24/51] 10.222.0.117 () {56 vars in 1134 bytes} [Tue Jan 25 02:22:35 2022] GET /identity/v3/domains/default => generated 200 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:22:35.456204 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a597172b-57c9-4657-89c1-17ca571df24d admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:22:35.466281 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a597172b-57c9-4657-89c1-17ca571df24d admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:22:35.470985 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a4bfce-ccb7-4b74-b545-872d12179cd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:22:35.471567 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a4bfce-ccb7-4b74-b545-872d12179cd7 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:35.471885 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a4bfce-ccb7-4b74-b545-872d12179cd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:35.472168 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a4bfce-ccb7-4b74-b545-872d12179cd7 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:35.473011 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a4bfce-ccb7-4b74-b545-872d12179cd7 admin admin] RBAC: Adding query filter params (role.id=d8dbc6d83d9d41d28c3feb8b3485b291, scope.domain.id=default, user.id=3db97686d01f422cb62642c302e35e45) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:22:35.473323 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a4bfce-ccb7-4b74-b545-872d12179cd7 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:22:35.475211 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a4bfce-ccb7-4b74-b545-872d12179cd7 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:22:35.480987 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 28/52] 10.222.0.117 () {56 vars in 1348 bytes} [Tue Jan 25 02:22:35 2022] GET /identity/v3/role_assignments?user.id=3db97686d01f422cb62642c302e35e45&scope.domain.id=default&role.id=d8dbc6d83d9d41d28c3feb8b3485b291 => generated 532 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:22:36.149690 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a1e975-4924-457c-a72e-429fd03b2c14 None None] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:36.149977 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a1e975-4924-457c-a72e-429fd03b2c14 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:36.150255 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a1e975-4924-457c-a72e-429fd03b2c14 None None] PATH_INFO: `/` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:36.152052 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 25/53] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:22:36 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:22:36.158063 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0d22c0-a995-4fd3-8580-08e8b3d4dab1 None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:36.158363 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0d22c0-a995-4fd3-8580-08e8b3d4dab1 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:36.158648 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0d22c0-a995-4fd3-8580-08e8b3d4dab1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:36.176512 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-cf0d22c0-a995-4fd3-8580-08e8b3d4dab1 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:22:36.177708 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-cf0d22c0-a995-4fd3-8580-08e8b3d4dab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:22:36.187148 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 29/54] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:22:36 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 25 02:22:36.210409 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a1e975-4924-457c-a72e-429fd03b2c14 None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:22:36.223345 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a1e975-4924-457c-a72e-429fd03b2c14 None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:22:36.227510 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459f6906-ceda-49e3-aae3-4c769ad124ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:22:36.228302 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459f6906-ceda-49e3-aae3-4c769ad124ed admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:36.228582 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459f6906-ceda-49e3-aae3-4c769ad124ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:36.228850 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459f6906-ceda-49e3-aae3-4c769ad124ed admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:36.230022 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459f6906-ceda-49e3-aae3-4c769ad124ed admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:22:36.232675 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459f6906-ceda-49e3-aae3-4c769ad124ed admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:22:36.234200 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 26/55] 10.222.0.117 () {56 vars in 1134 bytes} [Tue Jan 25 02:22:36 2022] GET /identity/v3/domains/default => generated 200 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:22:36.239472 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0d22c0-a995-4fd3-8580-08e8b3d4dab1 None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:22:36.248871 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0d22c0-a995-4fd3-8580-08e8b3d4dab1 None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:22:36.253303 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd34309f-3861-42f2-8b4f-6266714dbe76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:22:36.253955 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd34309f-3861-42f2-8b4f-6266714dbe76 admin admin] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:36.254245 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd34309f-3861-42f2-8b4f-6266714dbe76 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:36.254527 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd34309f-3861-42f2-8b4f-6266714dbe76 admin admin] PATH_INFO: `/v3/projects` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:36.255248 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd34309f-3861-42f2-8b4f-6266714dbe76 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:22:36.256318 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: WARNING py.warnings [None req-cd34309f-3861-42f2-8b4f-6266714dbe76 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 25 02:22:36.256318 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: warnings.warn(msg) Jan 25 02:22:36.256318 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: Jan 25 02:22:36.257528 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd34309f-3861-42f2-8b4f-6266714dbe76 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:22:36.283725 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 30/56] 10.222.0.117 () {60 vars in 1166 bytes} [Tue Jan 25 02:22:36 2022] POST /identity/v3/projects => generated 299 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 02:22:38.493248 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf38040-c1dc-4714-bb7a-9de18a99a67f None None] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:38.493766 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf38040-c1dc-4714-bb7a-9de18a99a67f None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:38.493848 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf38040-c1dc-4714-bb7a-9de18a99a67f None None] PATH_INFO: `/` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:38.495567 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 27/57] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:22:38 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:22:38.501391 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0c408c-c4ef-4f66-8102-95ba175d7ef4 None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:38.501787 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0c408c-c4ef-4f66-8102-95ba175d7ef4 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:38.501955 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0c408c-c4ef-4f66-8102-95ba175d7ef4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:38.520156 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-7f0c408c-c4ef-4f66-8102-95ba175d7ef4 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:22:38.521328 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-7f0c408c-c4ef-4f66-8102-95ba175d7ef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:22:38.578057 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 31/58] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:22:38 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 25 02:22:38.603460 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf38040-c1dc-4714-bb7a-9de18a99a67f None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:22:38.616053 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf38040-c1dc-4714-bb7a-9de18a99a67f None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:22:38.620241 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ccc3de-3f1d-47c0-8ddd-524d3cbe34fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:22:38.621023 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ccc3de-3f1d-47c0-8ddd-524d3cbe34fc admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:38.621311 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ccc3de-3f1d-47c0-8ddd-524d3cbe34fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:38.621591 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ccc3de-3f1d-47c0-8ddd-524d3cbe34fc admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:38.623358 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ccc3de-3f1d-47c0-8ddd-524d3cbe34fc admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:22:38.625095 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ccc3de-3f1d-47c0-8ddd-524d3cbe34fc admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:22:38.626634 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 28/59] 10.222.0.117 () {56 vars in 1134 bytes} [Tue Jan 25 02:22:38 2022] GET /identity/v3/domains/default => generated 200 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:22:38.631748 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0c408c-c4ef-4f66-8102-95ba175d7ef4 None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:22:38.641347 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0c408c-c4ef-4f66-8102-95ba175d7ef4 None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:22:38.645675 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565401b9-fe0d-41cd-85fa-46225b90819f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:22:38.646323 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565401b9-fe0d-41cd-85fa-46225b90819f admin admin] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:38.646603 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565401b9-fe0d-41cd-85fa-46225b90819f admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:38.646875 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565401b9-fe0d-41cd-85fa-46225b90819f admin admin] PATH_INFO: `/v3/users` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:38.647601 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565401b9-fe0d-41cd-85fa-46225b90819f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:22:38.648662 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: WARNING py.warnings [None req-565401b9-fe0d-41cd-85fa-46225b90819f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 25 02:22:38.648662 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: warnings.warn(msg) Jan 25 02:22:38.648662 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: Jan 25 02:22:38.649873 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565401b9-fe0d-41cd-85fa-46225b90819f admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:22:38.675564 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 32/60] 10.222.0.117 () {60 vars in 1158 bytes} [Tue Jan 25 02:22:38 2022] POST /identity/v3/users => generated 276 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 25 02:22:42.129006 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2471a022-169c-4648-8db0-78ca7b91b56f None None] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:42.129578 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2471a022-169c-4648-8db0-78ca7b91b56f None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:42.129578 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2471a022-169c-4648-8db0-78ca7b91b56f None None] PATH_INFO: `/` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:42.131548 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 29/61] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:22:42 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:22:42.136963 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f19df9-b973-4b5e-b1cf-b331d8c6bc5a None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:42.138405 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f19df9-b973-4b5e-b1cf-b331d8c6bc5a None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:42.138890 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f19df9-b973-4b5e-b1cf-b331d8c6bc5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:42.169536 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-28f19df9-b973-4b5e-b1cf-b331d8c6bc5a None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:22:42.171242 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-28f19df9-b973-4b5e-b1cf-b331d8c6bc5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:22:42.179371 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 33/62] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:22:42 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 25 02:22:42.203532 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2471a022-169c-4648-8db0-78ca7b91b56f None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:22:42.216490 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2471a022-169c-4648-8db0-78ca7b91b56f None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:22:42.221437 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a394bd-d091-4714-90f8-7559d1d761ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:22:42.222466 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a394bd-d091-4714-90f8-7559d1d761ee admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:42.222960 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a394bd-d091-4714-90f8-7559d1d761ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:42.223437 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a394bd-d091-4714-90f8-7559d1d761ee admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:42.235302 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a394bd-d091-4714-90f8-7559d1d761ee admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 25 02:22:42.242534 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: WARNING keystone.server.flask.application [None req-05a394bd-d091-4714-90f8-7559d1d761ee admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 25 02:22:42.244004 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 30/63] 10.222.0.117 () {56 vars in 1125 bytes} [Tue Jan 25 02:22:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:22:42.261491 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f19df9-b973-4b5e-b1cf-b331d8c6bc5a None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:22:42.271220 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f19df9-b973-4b5e-b1cf-b331d8c6bc5a None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:22:42.284165 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91650de-a7b2-44bd-8f5b-09cd564d4997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:22:42.284845 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91650de-a7b2-44bd-8f5b-09cd564d4997 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:42.285131 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91650de-a7b2-44bd-8f5b-09cd564d4997 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:42.285412 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91650de-a7b2-44bd-8f5b-09cd564d4997 admin admin] PATH_INFO: `/v3/roles` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:42.286189 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91650de-a7b2-44bd-8f5b-09cd564d4997 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:22:42.286497 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91650de-a7b2-44bd-8f5b-09cd564d4997 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:22:42.287532 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: WARNING py.warnings [None req-a91650de-a7b2-44bd-8f5b-09cd564d4997 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 25 02:22:42.287532 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: warnings.warn(msg) Jan 25 02:22:42.287532 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: Jan 25 02:22:42.288468 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91650de-a7b2-44bd-8f5b-09cd564d4997 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:22:42.313790 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 34/64] 10.222.0.117 () {56 vars in 1127 bytes} [Tue Jan 25 02:22:42 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:22:42.319447 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a394bd-d091-4714-90f8-7559d1d761ee admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:22:42.338850 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a394bd-d091-4714-90f8-7559d1d761ee admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:22:42.342740 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b831b94-60c0-4903-8951-e118c971e014 None None] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:42.343350 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b831b94-60c0-4903-8951-e118c971e014 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:42.343865 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b831b94-60c0-4903-8951-e118c971e014 None None] PATH_INFO: `/` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:42.345107 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1e1968-d845-4582-9416-36d178a38e05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:22:42.346274 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1e1968-d845-4582-9416-36d178a38e05 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:42.346559 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1e1968-d845-4582-9416-36d178a38e05 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:42.346839 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1e1968-d845-4582-9416-36d178a38e05 admin admin] PATH_INFO: `/v3/users/6680b5cac28b4aa1b86cbea15dc3c7be` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:42.347446 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 35/65] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:22:42 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:22:42.352963 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097c1b53-42a6-4eed-9d99-6907d39524f1 None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:42.353573 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097c1b53-42a6-4eed-9d99-6907d39524f1 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:42.354040 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097c1b53-42a6-4eed-9d99-6907d39524f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:42.363404 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1e1968-d845-4582-9416-36d178a38e05 admin admin] RBAC: Authorizing `identity:get_user(user_id=6680b5cac28b4aa1b86cbea15dc3c7be)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:22:42.366037 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1e1968-d845-4582-9416-36d178a38e05 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:22:42.368473 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 31/66] 10.222.0.117 () {56 vars in 1203 bytes} [Tue Jan 25 02:22:42 2022] GET /identity/v3/users/6680b5cac28b4aa1b86cbea15dc3c7be => generated 276 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:22:42.387812 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1e1968-d845-4582-9416-36d178a38e05 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:22:42.388256 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-097c1b53-42a6-4eed-9d99-6907d39524f1 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:22:42.389887 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-097c1b53-42a6-4eed-9d99-6907d39524f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:22:42.400581 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1e1968-d845-4582-9416-36d178a38e05 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:22:42.405227 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 36/67] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:22:42 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 25 02:22:42.413720 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff81d2f-2eb9-4de1-ac38-a4c0b31f9b2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:22:42.414632 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff81d2f-2eb9-4de1-ac38-a4c0b31f9b2e admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:42.415124 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff81d2f-2eb9-4de1-ac38-a4c0b31f9b2e admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:42.415635 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff81d2f-2eb9-4de1-ac38-a4c0b31f9b2e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:42.425199 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff81d2f-2eb9-4de1-ac38-a4c0b31f9b2e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:22:42.427290 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff81d2f-2eb9-4de1-ac38-a4c0b31f9b2e admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:22:42.429075 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097c1b53-42a6-4eed-9d99-6907d39524f1 None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:22:42.441603 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097c1b53-42a6-4eed-9d99-6907d39524f1 None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:22:42.451509 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 32/68] 10.222.0.117 () {58 vars in 1329 bytes} [Tue Jan 25 02:22:42 2022] GET /identity/v3/auth/tokens => generated 915 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jan 25 02:22:42.452985 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0016dc10-13f8-4fcb-baf4-2f9b9b54d155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:22:42.454028 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0016dc10-13f8-4fcb-baf4-2f9b9b54d155 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:42.454530 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0016dc10-13f8-4fcb-baf4-2f9b9b54d155 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:42.455002 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0016dc10-13f8-4fcb-baf4-2f9b9b54d155 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:42.457979 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff81d2f-2eb9-4de1-ac38-a4c0b31f9b2e admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:22:42.472089 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff81d2f-2eb9-4de1-ac38-a4c0b31f9b2e admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:22:42.477544 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0016dc10-13f8-4fcb-baf4-2f9b9b54d155 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 25 02:22:42.485276 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: WARNING keystone.server.flask.application [None req-0016dc10-13f8-4fcb-baf4-2f9b9b54d155 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 25 02:22:42.488065 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24649984-61d1-4ade-9a5e-8bc1a4604686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:22:42.489180 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24649984-61d1-4ade-9a5e-8bc1a4604686 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:42.489674 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24649984-61d1-4ade-9a5e-8bc1a4604686 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:42.490172 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24649984-61d1-4ade-9a5e-8bc1a4604686 admin admin] PATH_INFO: `/v3/projects/26e358bfb5294c7f9855f86b5dbeedac` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:42.492131 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 37/69] 10.222.0.117 () {56 vars in 1122 bytes} [Tue Jan 25 02:22:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 25 02:22:42.493009 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24649984-61d1-4ade-9a5e-8bc1a4604686 admin admin] RBAC: Authorizing `identity:get_project(project_id=26e358bfb5294c7f9855f86b5dbeedac)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:22:42.495318 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24649984-61d1-4ade-9a5e-8bc1a4604686 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:22:42.497338 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 33/70] 10.222.0.117 () {56 vars in 1212 bytes} [Tue Jan 25 02:22:42 2022] GET /identity/v3/projects/26e358bfb5294c7f9855f86b5dbeedac => generated 299 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:22:42.498409 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0016dc10-13f8-4fcb-baf4-2f9b9b54d155 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:22:42.504593 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24649984-61d1-4ade-9a5e-8bc1a4604686 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:22:42.514746 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0016dc10-13f8-4fcb-baf4-2f9b9b54d155 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:22:42.521615 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24649984-61d1-4ade-9a5e-8bc1a4604686 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:22:42.526267 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee695f9-1db6-4808-8a7f-05052d48d270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:22:42.526930 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee695f9-1db6-4808-8a7f-05052d48d270 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:42.527210 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee695f9-1db6-4808-8a7f-05052d48d270 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:42.527485 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee695f9-1db6-4808-8a7f-05052d48d270 admin admin] PATH_INFO: `/v3/roles` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:42.529205 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee695f9-1db6-4808-8a7f-05052d48d270 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:22:42.529651 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee695f9-1db6-4808-8a7f-05052d48d270 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:22:42.531285 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee695f9-1db6-4808-8a7f-05052d48d270 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:22:42.534822 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ab0554-43b3-4f53-adda-6e2414250711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:22:42.535475 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ab0554-43b3-4f53-adda-6e2414250711 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:42.535778 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ab0554-43b3-4f53-adda-6e2414250711 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:42.536056 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ab0554-43b3-4f53-adda-6e2414250711 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:42.536909 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ab0554-43b3-4f53-adda-6e2414250711 admin admin] RBAC: Adding query filter params (role.id=33a8e87420ed423f9cb29e0084eab5d2, scope.project.id=26e358bfb5294c7f9855f86b5dbeedac, user.id=6680b5cac28b4aa1b86cbea15dc3c7be) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:22:42.537219 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ab0554-43b3-4f53-adda-6e2414250711 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:22:42.538254 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: WARNING py.warnings [None req-25ab0554-43b3-4f53-adda-6e2414250711 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_role_assignments": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 25 02:22:42.538254 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: warnings.warn(msg) Jan 25 02:22:42.538254 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: Jan 25 02:22:42.539383 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ab0554-43b3-4f53-adda-6e2414250711 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:22:42.555155 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 34/71] 10.222.0.117 () {56 vars in 1400 bytes} [Tue Jan 25 02:22:42 2022] GET /identity/v3/role_assignments?user.id=6680b5cac28b4aa1b86cbea15dc3c7be&scope.project.id=26e358bfb5294c7f9855f86b5dbeedac&role.id=33a8e87420ed423f9cb29e0084eab5d2 => generated 260 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:22:42.555467 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 38/72] 10.222.0.117 () {56 vars in 1125 bytes} [Tue Jan 25 02:22:42 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:22:42.561348 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ab0554-43b3-4f53-adda-6e2414250711 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:22:42.570258 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbf1619-05d3-4b8e-8334-948226260ed0 None None] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:42.570551 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbf1619-05d3-4b8e-8334-948226260ed0 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:42.570808 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbf1619-05d3-4b8e-8334-948226260ed0 None None] PATH_INFO: `/` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:42.572819 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 39/73] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:22:42 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:22:42.578370 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ab0554-43b3-4f53-adda-6e2414250711 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:22:42.579332 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8f19e9-5d3a-4927-b73d-bf610bf5a2a6 None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:42.579961 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8f19e9-5d3a-4927-b73d-bf610bf5a2a6 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:42.580451 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8f19e9-5d3a-4927-b73d-bf610bf5a2a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:42.593762 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781b15d3-c237-442d-824e-f1a1d781f9a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:22:42.594665 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781b15d3-c237-442d-824e-f1a1d781f9a1 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:42.594956 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781b15d3-c237-442d-824e-f1a1d781f9a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:42.595237 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781b15d3-c237-442d-824e-f1a1d781f9a1 admin admin] PATH_INFO: `/v3/users/3db97686d01f422cb62642c302e35e45` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:42.600672 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781b15d3-c237-442d-824e-f1a1d781f9a1 admin admin] RBAC: Authorizing `identity:get_user(user_id=3db97686d01f422cb62642c302e35e45)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:22:42.602562 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781b15d3-c237-442d-824e-f1a1d781f9a1 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:22:42.603914 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-ee8f19e9-5d3a-4927-b73d-bf610bf5a2a6 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:22:42.604303 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 35/74] 10.222.0.117 () {56 vars in 1203 bytes} [Tue Jan 25 02:22:42 2022] GET /identity/v3/users/3db97686d01f422cb62642c302e35e45 => generated 248 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:22:42.605670 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-ee8f19e9-5d3a-4927-b73d-bf610bf5a2a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:22:42.610652 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781b15d3-c237-442d-824e-f1a1d781f9a1 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:22:42.622944 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 40/75] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:22:42 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 25 02:22:42.631652 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781b15d3-c237-442d-824e-f1a1d781f9a1 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:22:42.647502 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8f19e9-5d3a-4927-b73d-bf610bf5a2a6 None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:22:42.648571 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7370047b-001a-46d2-b755-e05c618f0cb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:22:42.649260 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7370047b-001a-46d2-b755-e05c618f0cb8 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:42.649549 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7370047b-001a-46d2-b755-e05c618f0cb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:42.649831 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7370047b-001a-46d2-b755-e05c618f0cb8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:42.659265 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8f19e9-5d3a-4927-b73d-bf610bf5a2a6 None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:22:42.659634 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7370047b-001a-46d2-b755-e05c618f0cb8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:22:42.661531 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7370047b-001a-46d2-b755-e05c618f0cb8 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:22:42.676922 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197f0727-7b52-47e3-b217-821777322db0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:22:42.678117 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197f0727-7b52-47e3-b217-821777322db0 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:42.678648 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197f0727-7b52-47e3-b217-821777322db0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:42.678939 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 36/76] 10.222.0.117 () {58 vars in 1329 bytes} [Tue Jan 25 02:22:42 2022] GET /identity/v3/auth/tokens => generated 915 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jan 25 02:22:42.679324 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197f0727-7b52-47e3-b217-821777322db0 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:42.680516 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2478cc47-5f0a-4c09-a153-16733b17dd0f None None] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:42.683962 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2478cc47-5f0a-4c09-a153-16733b17dd0f None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:42.683962 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2478cc47-5f0a-4c09-a153-16733b17dd0f None None] PATH_INFO: `/` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:42.683962 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 37/77] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:22:42 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:22:42.690655 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2478cc47-5f0a-4c09-a153-16733b17dd0f None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:22:42.697711 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197f0727-7b52-47e3-b217-821777322db0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 25 02:22:42.704222 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2478cc47-5f0a-4c09-a153-16733b17dd0f None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:22:42.705862 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: WARNING keystone.server.flask.application [None req-197f0727-7b52-47e3-b217-821777322db0 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 25 02:22:42.707455 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 41/78] 10.222.0.117 () {56 vars in 1125 bytes} [Tue Jan 25 02:22:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 25 02:22:42.708833 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a965d410-fe37-4e65-b018-211e3742aeaf None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:42.709129 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a965d410-fe37-4e65-b018-211e3742aeaf None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:42.709227 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b33ea4-ec94-48e2-9863-dc60d430bf65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:22:42.709406 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a965d410-fe37-4e65-b018-211e3742aeaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:42.709998 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b33ea4-ec94-48e2-9863-dc60d430bf65 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:42.710287 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b33ea4-ec94-48e2-9863-dc60d430bf65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:42.710569 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b33ea4-ec94-48e2-9863-dc60d430bf65 admin admin] PATH_INFO: `/v3/projects/26e358bfb5294c7f9855f86b5dbeedac` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:42.711834 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b33ea4-ec94-48e2-9863-dc60d430bf65 admin admin] RBAC: Authorizing `identity:get_project(project_id=26e358bfb5294c7f9855f86b5dbeedac)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:22:42.714019 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b33ea4-ec94-48e2-9863-dc60d430bf65 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:22:42.716545 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 38/79] 10.222.0.117 () {56 vars in 1212 bytes} [Tue Jan 25 02:22:42 2022] GET /identity/v3/projects/26e358bfb5294c7f9855f86b5dbeedac => generated 299 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:22:42.717514 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b33ea4-ec94-48e2-9863-dc60d430bf65 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:22:42.733462 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b33ea4-ec94-48e2-9863-dc60d430bf65 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:22:42.735990 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-a965d410-fe37-4e65-b018-211e3742aeaf None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:22:42.737427 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-a965d410-fe37-4e65-b018-211e3742aeaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:22:42.738208 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a52d612-4d69-4e2f-be11-422a72a50b99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:22:42.738901 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a52d612-4d69-4e2f-be11-422a72a50b99 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:42.739189 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a52d612-4d69-4e2f-be11-422a72a50b99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:42.739470 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a52d612-4d69-4e2f-be11-422a72a50b99 admin admin] PATH_INFO: `/v3/roles` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:42.740508 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a52d612-4d69-4e2f-be11-422a72a50b99 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:22:42.740832 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a52d612-4d69-4e2f-be11-422a72a50b99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:22:42.742485 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a52d612-4d69-4e2f-be11-422a72a50b99 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:22:42.748511 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 42/80] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:22:42 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 25 02:22:42.756411 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a965d410-fe37-4e65-b018-211e3742aeaf None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:22:42.759829 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 39/81] 10.222.0.117 () {56 vars in 1127 bytes} [Tue Jan 25 02:22:42 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:22:42.766400 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a52d612-4d69-4e2f-be11-422a72a50b99 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:22:42.769645 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a965d410-fe37-4e65-b018-211e3742aeaf None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:22:42.777793 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a52d612-4d69-4e2f-be11-422a72a50b99 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:22:42.779305 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02df4688-c785-4be8-a9a0-227e2017a986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:22:42.780134 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02df4688-c785-4be8-a9a0-227e2017a986 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:42.780419 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02df4688-c785-4be8-a9a0-227e2017a986 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:42.780699 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02df4688-c785-4be8-a9a0-227e2017a986 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:42.781555 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02df4688-c785-4be8-a9a0-227e2017a986 admin admin] RBAC: Adding query filter params (role.id=d8dbc6d83d9d41d28c3feb8b3485b291, scope.project.id=26e358bfb5294c7f9855f86b5dbeedac, user.id=3db97686d01f422cb62642c302e35e45) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:22:42.782967 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02df4688-c785-4be8-a9a0-227e2017a986 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:22:42.783824 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02df4688-c785-4be8-a9a0-227e2017a986 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:22:42.786909 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbba3f42-e32d-46f5-9fff-c0cb4d609965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:22:42.787861 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbba3f42-e32d-46f5-9fff-c0cb4d609965 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:42.788153 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbba3f42-e32d-46f5-9fff-c0cb4d609965 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:42.788433 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbba3f42-e32d-46f5-9fff-c0cb4d609965 admin admin] PATH_INFO: `/v3/users/6680b5cac28b4aa1b86cbea15dc3c7be` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:42.789757 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbba3f42-e32d-46f5-9fff-c0cb4d609965 admin admin] RBAC: Authorizing `identity:get_user(user_id=6680b5cac28b4aa1b86cbea15dc3c7be)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:22:42.792076 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbba3f42-e32d-46f5-9fff-c0cb4d609965 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:22:42.794671 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 40/82] 10.222.0.117 () {56 vars in 1203 bytes} [Tue Jan 25 02:22:42 2022] GET /identity/v3/users/6680b5cac28b4aa1b86cbea15dc3c7be => generated 276 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 02:22:42.799347 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbba3f42-e32d-46f5-9fff-c0cb4d609965 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:22:42.801546 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 43/83] 10.222.0.117 () {56 vars in 1400 bytes} [Tue Jan 25 02:22:42 2022] GET /identity/v3/role_assignments?user.id=3db97686d01f422cb62642c302e35e45&scope.project.id=26e358bfb5294c7f9855f86b5dbeedac&role.id=d8dbc6d83d9d41d28c3feb8b3485b291 => generated 260 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:22:42.802619 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02df4688-c785-4be8-a9a0-227e2017a986 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:22:42.806739 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbba3f42-e32d-46f5-9fff-c0cb4d609965 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:22:42.812585 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f799128-c30f-499e-8dae-8445f92fb650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:22:42.813494 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f799128-c30f-499e-8dae-8445f92fb650 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:42.813783 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f799128-c30f-499e-8dae-8445f92fb650 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:42.814065 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f799128-c30f-499e-8dae-8445f92fb650 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:42.815490 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02df4688-c785-4be8-a9a0-227e2017a986 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:22:42.820467 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981f4d59-ef02-487d-8f13-7fa585578707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:22:42.821630 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981f4d59-ef02-487d-8f13-7fa585578707 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:42.822100 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981f4d59-ef02-487d-8f13-7fa585578707 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:42.822547 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981f4d59-ef02-487d-8f13-7fa585578707 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:42.827753 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f799128-c30f-499e-8dae-8445f92fb650 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 25 02:22:42.833394 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981f4d59-ef02-487d-8f13-7fa585578707 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:22:42.835032 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: WARNING keystone.server.flask.application [None req-2f799128-c30f-499e-8dae-8445f92fb650 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jan 25 02:22:42.835662 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981f4d59-ef02-487d-8f13-7fa585578707 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:22:42.836602 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 41/84] 10.222.0.117 () {56 vars in 1140 bytes} [Tue Jan 25 02:22:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:22:42.846872 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f799128-c30f-499e-8dae-8445f92fb650 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:22:42.852529 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 44/85] 10.222.0.117 () {58 vars in 1329 bytes} [Tue Jan 25 02:22:42 2022] GET /identity/v3/auth/tokens => generated 915 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 25 02:22:42.859471 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981f4d59-ef02-487d-8f13-7fa585578707 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:22:42.862648 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f799128-c30f-499e-8dae-8445f92fb650 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:22:42.869198 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981f4d59-ef02-487d-8f13-7fa585578707 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:22:42.878569 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f55da9-15ce-47c5-9f82-efa8fe88ffbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:22:42.879954 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f55da9-15ce-47c5-9f82-efa8fe88ffbc admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:42.880464 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f55da9-15ce-47c5-9f82-efa8fe88ffbc admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:42.880937 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f55da9-15ce-47c5-9f82-efa8fe88ffbc admin admin] PATH_INFO: `/v3/projects/23e2ef72742d4a2cb64f8a286c6d034d` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:42.881188 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31056614-de1b-4859-816e-49c732a78db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:22:42.881956 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31056614-de1b-4859-816e-49c732a78db4 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:42.882231 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31056614-de1b-4859-816e-49c732a78db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:42.882528 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31056614-de1b-4859-816e-49c732a78db4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:42.883282 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f55da9-15ce-47c5-9f82-efa8fe88ffbc admin admin] RBAC: Authorizing `identity:get_project(project_id=23e2ef72742d4a2cb64f8a286c6d034d)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:22:42.883506 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31056614-de1b-4859-816e-49c732a78db4 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:22:42.883849 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31056614-de1b-4859-816e-49c732a78db4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:22:42.885671 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31056614-de1b-4859-816e-49c732a78db4 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:22:42.886328 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f55da9-15ce-47c5-9f82-efa8fe88ffbc admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:22:42.889415 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 45/86] 10.222.0.117 () {56 vars in 1212 bytes} [Tue Jan 25 02:22:42 2022] GET /identity/v3/projects/23e2ef72742d4a2cb64f8a286c6d034d => generated 313 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 02:22:42.895372 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f55da9-15ce-47c5-9f82-efa8fe88ffbc admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:22:42.903989 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 42/87] 10.222.0.117 () {56 vars in 1137 bytes} [Tue Jan 25 02:22:42 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:22:42.910645 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31056614-de1b-4859-816e-49c732a78db4 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:22:42.912400 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f55da9-15ce-47c5-9f82-efa8fe88ffbc admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:22:42.917217 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca5aa95-f04d-4156-a8d1-13fa9cf0b51f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:22:42.918196 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca5aa95-f04d-4156-a8d1-13fa9cf0b51f admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:42.919355 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca5aa95-f04d-4156-a8d1-13fa9cf0b51f admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:42.920147 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca5aa95-f04d-4156-a8d1-13fa9cf0b51f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:42.921538 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca5aa95-f04d-4156-a8d1-13fa9cf0b51f admin admin] RBAC: Adding query filter params (role.id=33a8e87420ed423f9cb29e0084eab5d2, scope.project.id=23e2ef72742d4a2cb64f8a286c6d034d, user.id=6680b5cac28b4aa1b86cbea15dc3c7be) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:22:42.922096 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca5aa95-f04d-4156-a8d1-13fa9cf0b51f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:22:42.924437 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca5aa95-f04d-4156-a8d1-13fa9cf0b51f admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:22:42.932643 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 46/88] 10.222.0.117 () {56 vars in 1400 bytes} [Tue Jan 25 02:22:42 2022] GET /identity/v3/role_assignments?user.id=6680b5cac28b4aa1b86cbea15dc3c7be&scope.project.id=23e2ef72742d4a2cb64f8a286c6d034d&role.id=33a8e87420ed423f9cb29e0084eab5d2 => generated 260 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 02:22:42.939774 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31056614-de1b-4859-816e-49c732a78db4 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:22:42.953240 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0588b196-18a5-402d-8b4b-37897eaadcb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:22:42.954161 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0588b196-18a5-402d-8b4b-37897eaadcb9 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:42.954455 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0588b196-18a5-402d-8b4b-37897eaadcb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:42.954740 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0588b196-18a5-402d-8b4b-37897eaadcb9 admin admin] PATH_INFO: `/v3/users/6680b5cac28b4aa1b86cbea15dc3c7be` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:42.960791 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0588b196-18a5-402d-8b4b-37897eaadcb9 admin admin] RBAC: Authorizing `identity:get_user(user_id=6680b5cac28b4aa1b86cbea15dc3c7be)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:22:42.963141 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0588b196-18a5-402d-8b4b-37897eaadcb9 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:22:42.965033 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 43/89] 10.222.0.117 () {56 vars in 1203 bytes} [Tue Jan 25 02:22:42 2022] GET /identity/v3/users/6680b5cac28b4aa1b86cbea15dc3c7be => generated 276 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 02:22:42.971514 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca5aa95-f04d-4156-a8d1-13fa9cf0b51f admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:22:42.989266 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca5aa95-f04d-4156-a8d1-13fa9cf0b51f admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:22:43.000245 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53b1256-ce76-41e0-8ac4-b8fa31fe4c72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:22:43.001282 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53b1256-ce76-41e0-8ac4-b8fa31fe4c72 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:43.001769 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53b1256-ce76-41e0-8ac4-b8fa31fe4c72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:43.002253 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53b1256-ce76-41e0-8ac4-b8fa31fe4c72 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:43.016730 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53b1256-ce76-41e0-8ac4-b8fa31fe4c72 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:22:43.018851 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53b1256-ce76-41e0-8ac4-b8fa31fe4c72 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:22:43.029811 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 47/90] 10.222.0.117 () {58 vars in 1329 bytes} [Tue Jan 25 02:22:42 2022] GET /identity/v3/auth/tokens => generated 915 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 25 02:22:43.035716 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0588b196-18a5-402d-8b4b-37897eaadcb9 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:22:43.048112 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0588b196-18a5-402d-8b4b-37897eaadcb9 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:22:43.053046 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebec93d-07ea-47f3-8c1b-76ae5edfd857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:22:43.054138 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebec93d-07ea-47f3-8c1b-76ae5edfd857 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:43.054615 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebec93d-07ea-47f3-8c1b-76ae5edfd857 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:43.055100 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebec93d-07ea-47f3-8c1b-76ae5edfd857 admin admin] PATH_INFO: `/v3/projects/26e358bfb5294c7f9855f86b5dbeedac` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:43.056534 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebec93d-07ea-47f3-8c1b-76ae5edfd857 admin admin] RBAC: Authorizing `identity:get_project(project_id=26e358bfb5294c7f9855f86b5dbeedac)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:22:43.058864 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebec93d-07ea-47f3-8c1b-76ae5edfd857 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:22:43.061537 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 44/91] 10.222.0.117 () {56 vars in 1212 bytes} [Tue Jan 25 02:22:43 2022] GET /identity/v3/projects/26e358bfb5294c7f9855f86b5dbeedac => generated 299 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:22:43.068792 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53b1256-ce76-41e0-8ac4-b8fa31fe4c72 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:22:43.080825 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53b1256-ce76-41e0-8ac4-b8fa31fe4c72 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:22:43.090966 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c3bc21-08b9-4dcd-bd61-bf81e083b64f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:22:43.092348 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c3bc21-08b9-4dcd-bd61-bf81e083b64f admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:43.092879 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c3bc21-08b9-4dcd-bd61-bf81e083b64f admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:43.093359 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c3bc21-08b9-4dcd-bd61-bf81e083b64f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:43.094457 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c3bc21-08b9-4dcd-bd61-bf81e083b64f admin admin] RBAC: Adding query filter params (role.id=259d005f63d5455d8728277d6385bfba, scope.project.id=26e358bfb5294c7f9855f86b5dbeedac, user.id=6680b5cac28b4aa1b86cbea15dc3c7be) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:22:43.094962 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c3bc21-08b9-4dcd-bd61-bf81e083b64f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:22:43.097321 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c3bc21-08b9-4dcd-bd61-bf81e083b64f admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:22:43.109181 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 48/92] 10.222.0.117 () {56 vars in 1400 bytes} [Tue Jan 25 02:22:43 2022] GET /identity/v3/role_assignments?user.id=6680b5cac28b4aa1b86cbea15dc3c7be&scope.project.id=26e358bfb5294c7f9855f86b5dbeedac&role.id=259d005f63d5455d8728277d6385bfba => generated 260 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:22:43.116859 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315d89bb-eef8-43f0-86e0-f8bfa25d7483 None None] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:43.117158 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315d89bb-eef8-43f0-86e0-f8bfa25d7483 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:43.117428 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315d89bb-eef8-43f0-86e0-f8bfa25d7483 None None] PATH_INFO: `/` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:43.119348 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 45/93] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:22:43 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:22:43.126025 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcc5260-fe9a-462c-b4e8-bc4509cfe48a None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:43.126326 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcc5260-fe9a-462c-b4e8-bc4509cfe48a None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:43.126589 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcc5260-fe9a-462c-b4e8-bc4509cfe48a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:43.154758 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-3fcc5260-fe9a-462c-b4e8-bc4509cfe48a None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:22:43.155871 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-3fcc5260-fe9a-462c-b4e8-bc4509cfe48a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:22:43.166930 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 49/94] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:22:43 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 25 02:22:43.216022 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315d89bb-eef8-43f0-86e0-f8bfa25d7483 None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:22:43.239134 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315d89bb-eef8-43f0-86e0-f8bfa25d7483 None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:22:43.245974 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad712b4-0b80-4401-ab21-7df85608bfda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:22:43.246937 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad712b4-0b80-4401-ab21-7df85608bfda admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:43.247434 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad712b4-0b80-4401-ab21-7df85608bfda admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:43.247838 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad712b4-0b80-4401-ab21-7df85608bfda admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:43.249111 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad712b4-0b80-4401-ab21-7df85608bfda admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:22:43.250867 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad712b4-0b80-4401-ab21-7df85608bfda admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:22:43.252917 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 46/95] 10.222.0.117 () {56 vars in 1134 bytes} [Tue Jan 25 02:22:43 2022] GET /identity/v3/domains/default => generated 200 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:22:43.258326 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcc5260-fe9a-462c-b4e8-bc4509cfe48a None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:22:43.268631 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcc5260-fe9a-462c-b4e8-bc4509cfe48a None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:22:43.273413 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75963a4-bb8b-4781-ad96-d153679f2bca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:22:43.274096 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75963a4-bb8b-4781-ad96-d153679f2bca admin admin] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:43.274378 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75963a4-bb8b-4781-ad96-d153679f2bca admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:43.274651 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75963a4-bb8b-4781-ad96-d153679f2bca admin admin] PATH_INFO: `/v3/users` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:43.275402 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75963a4-bb8b-4781-ad96-d153679f2bca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:22:43.277409 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75963a4-bb8b-4781-ad96-d153679f2bca admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:22:43.310743 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 50/96] 10.222.0.117 () {60 vars in 1158 bytes} [Tue Jan 25 02:22:43 2022] POST /identity/v3/users => generated 290 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 02:22:45.221943 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df14e1c8-c87c-46b0-9123-08ec3ba85a8a None None] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:45.222517 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df14e1c8-c87c-46b0-9123-08ec3ba85a8a None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:45.222517 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df14e1c8-c87c-46b0-9123-08ec3ba85a8a None None] PATH_INFO: `/` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:45.224696 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 47/97] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:22:45 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:22:45.240636 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6d41b7-7730-4d91-a412-a3ce13fbd684 None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:45.241165 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6d41b7-7730-4d91-a412-a3ce13fbd684 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:45.241165 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6d41b7-7730-4d91-a412-a3ce13fbd684 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:45.264432 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-5a6d41b7-7730-4d91-a412-a3ce13fbd684 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:22:45.265627 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-5a6d41b7-7730-4d91-a412-a3ce13fbd684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:22:45.277773 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 51/98] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:22:45 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 25 02:22:45.306164 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df14e1c8-c87c-46b0-9123-08ec3ba85a8a None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:22:45.319438 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df14e1c8-c87c-46b0-9123-08ec3ba85a8a None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:22:45.323746 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b9f4cc-7c01-428d-95e4-a1b130ea16f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:22:45.324560 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b9f4cc-7c01-428d-95e4-a1b130ea16f0 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:45.325504 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b9f4cc-7c01-428d-95e4-a1b130ea16f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:45.325955 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b9f4cc-7c01-428d-95e4-a1b130ea16f0 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:45.341789 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b9f4cc-7c01-428d-95e4-a1b130ea16f0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 25 02:22:45.348944 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: WARNING keystone.server.flask.application [None req-93b9f4cc-7c01-428d-95e4-a1b130ea16f0 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 25 02:22:45.350347 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 48/99] 10.222.0.117 () {56 vars in 1125 bytes} [Tue Jan 25 02:22:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:22:45.357263 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6d41b7-7730-4d91-a412-a3ce13fbd684 None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:22:45.366440 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6d41b7-7730-4d91-a412-a3ce13fbd684 None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:22:45.370935 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2c33fb-ab5c-47dc-beae-079d5c496919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:22:45.371631 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2c33fb-ab5c-47dc-beae-079d5c496919 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:45.372086 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2c33fb-ab5c-47dc-beae-079d5c496919 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:45.372576 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2c33fb-ab5c-47dc-beae-079d5c496919 admin admin] PATH_INFO: `/v3/roles` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:45.373394 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2c33fb-ab5c-47dc-beae-079d5c496919 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:22:45.373760 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2c33fb-ab5c-47dc-beae-079d5c496919 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:22:45.375385 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2c33fb-ab5c-47dc-beae-079d5c496919 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:22:45.387845 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 52/100] 10.222.0.117 () {56 vars in 1127 bytes} [Tue Jan 25 02:22:45 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:22:45.393573 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b9f4cc-7c01-428d-95e4-a1b130ea16f0 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:22:45.404617 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b9f4cc-7c01-428d-95e4-a1b130ea16f0 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:22:45.413842 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a45295d-bfaf-4bee-bdd1-dae38f48002c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:22:45.414065 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a45295d-bfaf-4bee-bdd1-dae38f48002c admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:45.414332 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a45295d-bfaf-4bee-bdd1-dae38f48002c admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:45.414531 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a45295d-bfaf-4bee-bdd1-dae38f48002c admin admin] PATH_INFO: `/v3/users/6680b5cac28b4aa1b86cbea15dc3c7be` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:45.415774 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a45295d-bfaf-4bee-bdd1-dae38f48002c admin admin] RBAC: Authorizing `identity:get_user(user_id=6680b5cac28b4aa1b86cbea15dc3c7be)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:22:45.417940 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a45295d-bfaf-4bee-bdd1-dae38f48002c admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:22:45.420604 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 49/101] 10.222.0.117 () {56 vars in 1203 bytes} [Tue Jan 25 02:22:45 2022] GET /identity/v3/users/6680b5cac28b4aa1b86cbea15dc3c7be => generated 276 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:22:45.426333 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2c33fb-ab5c-47dc-beae-079d5c496919 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:22:45.440779 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2c33fb-ab5c-47dc-beae-079d5c496919 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:22:45.445237 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d52529-4a98-49de-be0e-3ebddfdf6fc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:22:45.446089 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d52529-4a98-49de-be0e-3ebddfdf6fc6 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:45.446368 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d52529-4a98-49de-be0e-3ebddfdf6fc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:45.446641 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d52529-4a98-49de-be0e-3ebddfdf6fc6 admin admin] PATH_INFO: `/v3/projects/26e358bfb5294c7f9855f86b5dbeedac` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:45.447866 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d52529-4a98-49de-be0e-3ebddfdf6fc6 admin admin] RBAC: Authorizing `identity:get_project(project_id=26e358bfb5294c7f9855f86b5dbeedac)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:22:45.450043 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d52529-4a98-49de-be0e-3ebddfdf6fc6 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:22:45.452088 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 53/102] 10.222.0.117 () {56 vars in 1212 bytes} [Tue Jan 25 02:22:45 2022] GET /identity/v3/projects/26e358bfb5294c7f9855f86b5dbeedac => generated 299 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:22:45.457897 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a45295d-bfaf-4bee-bdd1-dae38f48002c admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:22:45.468128 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a45295d-bfaf-4bee-bdd1-dae38f48002c admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:22:45.477010 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b19ab9-ba93-43fd-91bf-a61be003bf5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:22:45.477848 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b19ab9-ba93-43fd-91bf-a61be003bf5c admin admin] REQUEST_METHOD: `PUT` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:45.478137 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b19ab9-ba93-43fd-91bf-a61be003bf5c admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:45.478419 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b19ab9-ba93-43fd-91bf-a61be003bf5c admin admin] PATH_INFO: `/v3/projects/26e358bfb5294c7f9855f86b5dbeedac/users/6680b5cac28b4aa1b86cbea15dc3c7be/roles/33a8e87420ed423f9cb29e0084eab5d2` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:45.481513 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b19ab9-ba93-43fd-91bf-a61be003bf5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=26e358bfb5294c7f9855f86b5dbeedac, user_id=6680b5cac28b4aa1b86cbea15dc3c7be, role_id=33a8e87420ed423f9cb29e0084eab5d2)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:22:45.482975 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: WARNING py.warnings [None req-73b19ab9-ba93-43fd-91bf-a61be003bf5c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 25 02:22:45.482975 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: warnings.warn(msg) Jan 25 02:22:45.482975 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: Jan 25 02:22:45.484946 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b19ab9-ba93-43fd-91bf-a61be003bf5c admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:22:45.504757 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 50/103] 10.222.0.117 () {58 vars in 1465 bytes} [Tue Jan 25 02:22:45 2022] PUT /identity/v3/projects/26e358bfb5294c7f9855f86b5dbeedac/users/6680b5cac28b4aa1b86cbea15dc3c7be/roles/33a8e87420ed423f9cb29e0084eab5d2 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 25 02:22:45.572199 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d9a6d5-f3c1-4712-b292-bcaaf982f08b None None] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:45.572508 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d9a6d5-f3c1-4712-b292-bcaaf982f08b None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:45.572754 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d9a6d5-f3c1-4712-b292-bcaaf982f08b None None] PATH_INFO: `/` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:45.575350 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 54/104] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:22:45 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:22:45.599325 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1074ec33-f7e8-43d3-b0fb-4ba8f29259ab None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:45.599933 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1074ec33-f7e8-43d3-b0fb-4ba8f29259ab None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:45.599933 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1074ec33-f7e8-43d3-b0fb-4ba8f29259ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:45.621336 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-1074ec33-f7e8-43d3-b0fb-4ba8f29259ab None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:22:45.623755 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-1074ec33-f7e8-43d3-b0fb-4ba8f29259ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:22:45.695867 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 51/105] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:22:45 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 25 02:22:45.732242 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d9a6d5-f3c1-4712-b292-bcaaf982f08b None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:22:45.751391 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d9a6d5-f3c1-4712-b292-bcaaf982f08b None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:22:45.755763 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f809886-aa6a-4858-b756-82fdae090ff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:22:45.756617 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f809886-aa6a-4858-b756-82fdae090ff1 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:45.756907 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f809886-aa6a-4858-b756-82fdae090ff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:45.757184 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f809886-aa6a-4858-b756-82fdae090ff1 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:45.774797 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f809886-aa6a-4858-b756-82fdae090ff1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 25 02:22:45.783051 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: WARNING keystone.server.flask.application [None req-8f809886-aa6a-4858-b756-82fdae090ff1 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 25 02:22:45.784519 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 55/106] 10.222.0.117 () {56 vars in 1122 bytes} [Tue Jan 25 02:22:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:22:45.790384 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1074ec33-f7e8-43d3-b0fb-4ba8f29259ab None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:22:45.800674 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1074ec33-f7e8-43d3-b0fb-4ba8f29259ab None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:22:45.805166 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e885c8a-4fb8-4bad-9b63-45d6f83287c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:22:45.805845 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e885c8a-4fb8-4bad-9b63-45d6f83287c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:45.806129 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e885c8a-4fb8-4bad-9b63-45d6f83287c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:45.806408 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e885c8a-4fb8-4bad-9b63-45d6f83287c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:45.807179 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e885c8a-4fb8-4bad-9b63-45d6f83287c2 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:22:45.807484 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e885c8a-4fb8-4bad-9b63-45d6f83287c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:22:45.809190 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e885c8a-4fb8-4bad-9b63-45d6f83287c2 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:22:45.822737 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 52/107] 10.222.0.117 () {56 vars in 1125 bytes} [Tue Jan 25 02:22:45 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:22:45.828625 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f809886-aa6a-4858-b756-82fdae090ff1 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:22:45.845901 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f809886-aa6a-4858-b756-82fdae090ff1 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:22:45.850371 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9681ff-8c6e-4467-85f9-117e2a845848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:22:45.851238 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9681ff-8c6e-4467-85f9-117e2a845848 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:45.851521 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9681ff-8c6e-4467-85f9-117e2a845848 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:45.851822 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9681ff-8c6e-4467-85f9-117e2a845848 admin admin] PATH_INFO: `/v3/users/3db97686d01f422cb62642c302e35e45` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:45.853076 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9681ff-8c6e-4467-85f9-117e2a845848 admin admin] RBAC: Authorizing `identity:get_user(user_id=3db97686d01f422cb62642c302e35e45)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:22:45.854916 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9681ff-8c6e-4467-85f9-117e2a845848 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:22:45.857655 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 56/108] 10.222.0.117 () {56 vars in 1203 bytes} [Tue Jan 25 02:22:45 2022] GET /identity/v3/users/3db97686d01f422cb62642c302e35e45 => generated 248 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:22:45.863357 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e885c8a-4fb8-4bad-9b63-45d6f83287c2 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:22:45.873640 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e885c8a-4fb8-4bad-9b63-45d6f83287c2 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:22:45.878126 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b24745-0b05-43a7-97ad-2b500ec66151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:22:45.880297 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462c0ca1-a0ad-42d4-8d78-c370bbdd3531 None None] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:45.880584 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462c0ca1-a0ad-42d4-8d78-c370bbdd3531 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:45.880866 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462c0ca1-a0ad-42d4-8d78-c370bbdd3531 None None] PATH_INFO: `/` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:45.882870 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 57/109] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:22:45 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jan 25 02:22:45.883371 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b24745-0b05-43a7-97ad-2b500ec66151 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:45.883661 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b24745-0b05-43a7-97ad-2b500ec66151 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:45.883973 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b24745-0b05-43a7-97ad-2b500ec66151 admin admin] PATH_INFO: `/v3/projects/26e358bfb5294c7f9855f86b5dbeedac` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:45.885359 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b24745-0b05-43a7-97ad-2b500ec66151 admin admin] RBAC: Authorizing `identity:get_project(project_id=26e358bfb5294c7f9855f86b5dbeedac)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:22:45.888771 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4f5318-01d8-42ad-b983-db80bbb9a3b1 None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:45.889061 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4f5318-01d8-42ad-b983-db80bbb9a3b1 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:45.889337 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4f5318-01d8-42ad-b983-db80bbb9a3b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:45.894800 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b24745-0b05-43a7-97ad-2b500ec66151 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:22:45.896999 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 53/110] 10.222.0.117 () {56 vars in 1212 bytes} [Tue Jan 25 02:22:45 2022] GET /identity/v3/projects/26e358bfb5294c7f9855f86b5dbeedac => generated 299 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:22:45.905890 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b24745-0b05-43a7-97ad-2b500ec66151 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:22:45.923280 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b24745-0b05-43a7-97ad-2b500ec66151 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:22:45.925952 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-ae4f5318-01d8-42ad-b983-db80bbb9a3b1 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:22:45.927138 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-ae4f5318-01d8-42ad-b983-db80bbb9a3b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:22:45.930665 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628734ec-b5af-4ff0-94c8-962ed0528e43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:22:45.931551 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628734ec-b5af-4ff0-94c8-962ed0528e43 admin admin] REQUEST_METHOD: `PUT` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:45.931860 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628734ec-b5af-4ff0-94c8-962ed0528e43 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:45.932136 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628734ec-b5af-4ff0-94c8-962ed0528e43 admin admin] PATH_INFO: `/v3/projects/26e358bfb5294c7f9855f86b5dbeedac/users/3db97686d01f422cb62642c302e35e45/roles/d8dbc6d83d9d41d28c3feb8b3485b291` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:45.937239 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628734ec-b5af-4ff0-94c8-962ed0528e43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26e358bfb5294c7f9855f86b5dbeedac, user_id=3db97686d01f422cb62642c302e35e45, role_id=d8dbc6d83d9d41d28c3feb8b3485b291)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:22:45.944471 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 58/111] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:22:45 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 25 02:22:45.944717 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628734ec-b5af-4ff0-94c8-962ed0528e43 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:22:45.967445 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 54/112] 10.222.0.117 () {58 vars in 1465 bytes} [Tue Jan 25 02:22:45 2022] PUT /identity/v3/projects/26e358bfb5294c7f9855f86b5dbeedac/users/3db97686d01f422cb62642c302e35e45/roles/d8dbc6d83d9d41d28c3feb8b3485b291 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 25 02:22:45.993357 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4f5318-01d8-42ad-b983-db80bbb9a3b1 None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:22:46.004865 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4f5318-01d8-42ad-b983-db80bbb9a3b1 None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:22:46.078006 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8b455b-427b-442d-a2dd-0fb5f0e9409a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:22:46.078826 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8b455b-427b-442d-a2dd-0fb5f0e9409a admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:46.079104 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8b455b-427b-442d-a2dd-0fb5f0e9409a admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:46.079374 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8b455b-427b-442d-a2dd-0fb5f0e9409a admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:46.096795 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8b455b-427b-442d-a2dd-0fb5f0e9409a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 25 02:22:46.103881 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: WARNING keystone.server.flask.application [None req-6e8b455b-427b-442d-a2dd-0fb5f0e9409a admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 25 02:22:46.105148 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 59/113] 10.222.0.117 () {56 vars in 1125 bytes} [Tue Jan 25 02:22:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 112 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:22:46.111654 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628734ec-b5af-4ff0-94c8-962ed0528e43 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:22:46.126029 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628734ec-b5af-4ff0-94c8-962ed0528e43 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:22:46.130581 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c967f593-7c4f-46ce-b6a6-c79d2aea2bee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:22:46.131259 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c967f593-7c4f-46ce-b6a6-c79d2aea2bee admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:46.131545 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c967f593-7c4f-46ce-b6a6-c79d2aea2bee admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:46.131852 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c967f593-7c4f-46ce-b6a6-c79d2aea2bee admin admin] PATH_INFO: `/v3/roles` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:46.132630 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c967f593-7c4f-46ce-b6a6-c79d2aea2bee admin admin] RBAC: Adding query filter params (name=member) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:22:46.132937 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c967f593-7c4f-46ce-b6a6-c79d2aea2bee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:22:46.134581 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c967f593-7c4f-46ce-b6a6-c79d2aea2bee admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:22:46.147885 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 55/114] 10.222.0.117 () {56 vars in 1127 bytes} [Tue Jan 25 02:22:46 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:22:46.154134 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8b455b-427b-442d-a2dd-0fb5f0e9409a admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:22:46.169553 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8b455b-427b-442d-a2dd-0fb5f0e9409a admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:22:46.174330 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0c9129-cabe-4c33-8549-1a14e41a0408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:22:46.175202 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0c9129-cabe-4c33-8549-1a14e41a0408 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:46.175483 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0c9129-cabe-4c33-8549-1a14e41a0408 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:46.175773 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0c9129-cabe-4c33-8549-1a14e41a0408 admin admin] PATH_INFO: `/v3/users/6680b5cac28b4aa1b86cbea15dc3c7be` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:46.177041 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0c9129-cabe-4c33-8549-1a14e41a0408 admin admin] RBAC: Authorizing `identity:get_user(user_id=6680b5cac28b4aa1b86cbea15dc3c7be)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:22:46.179206 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0c9129-cabe-4c33-8549-1a14e41a0408 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:22:46.181132 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 60/115] 10.222.0.117 () {56 vars in 1203 bytes} [Tue Jan 25 02:22:46 2022] GET /identity/v3/users/6680b5cac28b4aa1b86cbea15dc3c7be => generated 276 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:22:46.187414 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c967f593-7c4f-46ce-b6a6-c79d2aea2bee admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:22:46.201533 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c967f593-7c4f-46ce-b6a6-c79d2aea2bee admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:22:46.205963 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67265503-e56f-4db2-b6a2-54648b00b751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:22:46.206829 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67265503-e56f-4db2-b6a2-54648b00b751 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:46.207114 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67265503-e56f-4db2-b6a2-54648b00b751 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:46.207389 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67265503-e56f-4db2-b6a2-54648b00b751 admin admin] PATH_INFO: `/v3/projects/23e2ef72742d4a2cb64f8a286c6d034d` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:46.208614 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67265503-e56f-4db2-b6a2-54648b00b751 admin admin] RBAC: Authorizing `identity:get_project(project_id=23e2ef72742d4a2cb64f8a286c6d034d)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:22:46.210687 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67265503-e56f-4db2-b6a2-54648b00b751 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:22:46.212379 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 56/116] 10.222.0.117 () {56 vars in 1212 bytes} [Tue Jan 25 02:22:46 2022] GET /identity/v3/projects/23e2ef72742d4a2cb64f8a286c6d034d => generated 313 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:22:46.218620 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0c9129-cabe-4c33-8549-1a14e41a0408 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:22:46.229685 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0c9129-cabe-4c33-8549-1a14e41a0408 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:22:46.235105 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d95cb55-f667-4539-8c44-031ac0a2d8b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:22:46.236038 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d95cb55-f667-4539-8c44-031ac0a2d8b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:46.236320 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d95cb55-f667-4539-8c44-031ac0a2d8b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:46.236600 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d95cb55-f667-4539-8c44-031ac0a2d8b0 admin admin] PATH_INFO: `/v3/projects/23e2ef72742d4a2cb64f8a286c6d034d/users/6680b5cac28b4aa1b86cbea15dc3c7be/roles/33a8e87420ed423f9cb29e0084eab5d2` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:46.238703 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d95cb55-f667-4539-8c44-031ac0a2d8b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23e2ef72742d4a2cb64f8a286c6d034d, user_id=6680b5cac28b4aa1b86cbea15dc3c7be, role_id=33a8e87420ed423f9cb29e0084eab5d2)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:22:46.241529 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d95cb55-f667-4539-8c44-031ac0a2d8b0 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:22:46.263876 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 61/117] 10.222.0.117 () {58 vars in 1465 bytes} [Tue Jan 25 02:22:46 2022] PUT /identity/v3/projects/23e2ef72742d4a2cb64f8a286c6d034d/users/6680b5cac28b4aa1b86cbea15dc3c7be/roles/33a8e87420ed423f9cb29e0084eab5d2 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:22:46.549956 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ec8030-0943-48c3-8376-c17cf08d696c None None] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:46.550477 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ec8030-0943-48c3-8376-c17cf08d696c None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:46.550477 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ec8030-0943-48c3-8376-c17cf08d696c None None] PATH_INFO: `/` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:46.552269 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 57/118] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:22:46 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:22:46.558325 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d672d4-e85e-4945-85b7-eb5f70ff029c None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:46.558619 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d672d4-e85e-4945-85b7-eb5f70ff029c None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:46.558926 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d672d4-e85e-4945-85b7-eb5f70ff029c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:46.581071 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-66d672d4-e85e-4945-85b7-eb5f70ff029c None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:22:46.582291 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-66d672d4-e85e-4945-85b7-eb5f70ff029c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:22:46.664844 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 62/119] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:22:46 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 25 02:22:46.711762 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ec8030-0943-48c3-8376-c17cf08d696c None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:22:46.729624 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ec8030-0943-48c3-8376-c17cf08d696c None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:22:46.734574 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e449381-0bc2-48d7-a0b1-0eae7f8e101d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:22:46.735390 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e449381-0bc2-48d7-a0b1-0eae7f8e101d admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:46.735684 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e449381-0bc2-48d7-a0b1-0eae7f8e101d admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:46.735989 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e449381-0bc2-48d7-a0b1-0eae7f8e101d admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:46.756627 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e449381-0bc2-48d7-a0b1-0eae7f8e101d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 25 02:22:46.764077 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: WARNING keystone.server.flask.application [None req-7e449381-0bc2-48d7-a0b1-0eae7f8e101d admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jan 25 02:22:46.765319 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 58/120] 10.222.0.117 () {56 vars in 1140 bytes} [Tue Jan 25 02:22:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:22:46.772750 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d672d4-e85e-4945-85b7-eb5f70ff029c None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:22:46.782004 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d672d4-e85e-4945-85b7-eb5f70ff029c None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:22:46.791545 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0752fa4-b49b-481f-8d68-089f69161bbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:22:46.792272 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0752fa4-b49b-481f-8d68-089f69161bbd admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:46.792565 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0752fa4-b49b-481f-8d68-089f69161bbd admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:46.792849 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0752fa4-b49b-481f-8d68-089f69161bbd admin admin] PATH_INFO: `/v3/roles` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:46.794210 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0752fa4-b49b-481f-8d68-089f69161bbd admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:22:46.794522 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0752fa4-b49b-481f-8d68-089f69161bbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:22:46.796404 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0752fa4-b49b-481f-8d68-089f69161bbd admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:22:46.815687 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 63/121] 10.222.0.117 () {56 vars in 1137 bytes} [Tue Jan 25 02:22:46 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:22:46.821170 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e449381-0bc2-48d7-a0b1-0eae7f8e101d admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:22:46.836908 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e449381-0bc2-48d7-a0b1-0eae7f8e101d admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:22:46.841779 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e7e51f-a532-41c8-9c6e-a9367aaf91cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:22:46.842660 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e7e51f-a532-41c8-9c6e-a9367aaf91cb admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:46.842948 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e7e51f-a532-41c8-9c6e-a9367aaf91cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:46.843233 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e7e51f-a532-41c8-9c6e-a9367aaf91cb admin admin] PATH_INFO: `/v3/users/6680b5cac28b4aa1b86cbea15dc3c7be` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:46.844511 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e7e51f-a532-41c8-9c6e-a9367aaf91cb admin admin] RBAC: Authorizing `identity:get_user(user_id=6680b5cac28b4aa1b86cbea15dc3c7be)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:22:46.847009 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e7e51f-a532-41c8-9c6e-a9367aaf91cb admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:22:46.848696 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 59/122] 10.222.0.117 () {56 vars in 1203 bytes} [Tue Jan 25 02:22:46 2022] GET /identity/v3/users/6680b5cac28b4aa1b86cbea15dc3c7be => generated 276 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:22:46.854319 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0752fa4-b49b-481f-8d68-089f69161bbd admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:22:46.870449 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0752fa4-b49b-481f-8d68-089f69161bbd admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:22:46.875067 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfba5f4-e5f8-48a6-afbb-16c8188f67dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:22:46.876072 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfba5f4-e5f8-48a6-afbb-16c8188f67dc admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:46.876279 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfba5f4-e5f8-48a6-afbb-16c8188f67dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:46.878907 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfba5f4-e5f8-48a6-afbb-16c8188f67dc admin admin] PATH_INFO: `/v3/projects/26e358bfb5294c7f9855f86b5dbeedac` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:46.878907 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfba5f4-e5f8-48a6-afbb-16c8188f67dc admin admin] RBAC: Authorizing `identity:get_project(project_id=26e358bfb5294c7f9855f86b5dbeedac)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:22:46.880530 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfba5f4-e5f8-48a6-afbb-16c8188f67dc admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:22:46.882293 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 64/123] 10.222.0.117 () {56 vars in 1212 bytes} [Tue Jan 25 02:22:46 2022] GET /identity/v3/projects/26e358bfb5294c7f9855f86b5dbeedac => generated 299 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:22:46.889091 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e7e51f-a532-41c8-9c6e-a9367aaf91cb admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:22:46.901663 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e7e51f-a532-41c8-9c6e-a9367aaf91cb admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:22:46.910916 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f27f2e-efd8-4783-9329-c875066a57ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:22:46.912230 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f27f2e-efd8-4783-9329-c875066a57ac admin admin] REQUEST_METHOD: `PUT` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:46.916336 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f27f2e-efd8-4783-9329-c875066a57ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:46.916854 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f27f2e-efd8-4783-9329-c875066a57ac admin admin] PATH_INFO: `/v3/projects/26e358bfb5294c7f9855f86b5dbeedac/users/6680b5cac28b4aa1b86cbea15dc3c7be/roles/259d005f63d5455d8728277d6385bfba` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:46.921317 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f27f2e-efd8-4783-9329-c875066a57ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=26e358bfb5294c7f9855f86b5dbeedac, user_id=6680b5cac28b4aa1b86cbea15dc3c7be, role_id=259d005f63d5455d8728277d6385bfba)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:22:46.924351 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f27f2e-efd8-4783-9329-c875066a57ac admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:22:46.951382 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 60/124] 10.222.0.117 () {58 vars in 1465 bytes} [Tue Jan 25 02:22:46 2022] PUT /identity/v3/projects/26e358bfb5294c7f9855f86b5dbeedac/users/6680b5cac28b4aa1b86cbea15dc3c7be/roles/259d005f63d5455d8728277d6385bfba => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:22:47.514282 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17869d09-2899-4c41-a055-b3d13b5eb75f None None] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:47.514783 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17869d09-2899-4c41-a055-b3d13b5eb75f None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:47.514853 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17869d09-2899-4c41-a055-b3d13b5eb75f None None] PATH_INFO: `/` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:47.516811 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 65/125] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:22:47 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:22:47.522028 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fc29b5-ee53-485b-9599-562cdbf907c0 None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:47.522544 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fc29b5-ee53-485b-9599-562cdbf907c0 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:47.523012 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fc29b5-ee53-485b-9599-562cdbf907c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:47.545484 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-c1fc29b5-ee53-485b-9599-562cdbf907c0 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:22:47.547007 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-c1fc29b5-ee53-485b-9599-562cdbf907c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:22:47.629227 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 61/126] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:22:47 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 25 02:22:47.678063 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17869d09-2899-4c41-a055-b3d13b5eb75f None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:22:47.701669 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17869d09-2899-4c41-a055-b3d13b5eb75f None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:22:47.709166 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52949534-728b-45ca-9b2f-f3c75ee3902c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:22:47.709975 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52949534-728b-45ca-9b2f-f3c75ee3902c admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:47.710265 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52949534-728b-45ca-9b2f-f3c75ee3902c admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:47.710546 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52949534-728b-45ca-9b2f-f3c75ee3902c admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:47.722316 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52949534-728b-45ca-9b2f-f3c75ee3902c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 25 02:22:47.733548 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: WARNING keystone.server.flask.application [None req-52949534-728b-45ca-9b2f-f3c75ee3902c admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jan 25 02:22:47.735119 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 66/127] 10.222.0.117 () {56 vars in 1125 bytes} [Tue Jan 25 02:22:47 2022] GET /identity/v3/roles/reader => generated 84 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:22:47.740786 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fc29b5-ee53-485b-9599-562cdbf907c0 None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:22:47.754981 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fc29b5-ee53-485b-9599-562cdbf907c0 None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:22:47.765675 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bff5ef-974f-4892-b4b4-118bf03df843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:22:47.766694 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bff5ef-974f-4892-b4b4-118bf03df843 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:47.767171 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bff5ef-974f-4892-b4b4-118bf03df843 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:47.767634 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bff5ef-974f-4892-b4b4-118bf03df843 admin admin] PATH_INFO: `/v3/roles` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:47.768629 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bff5ef-974f-4892-b4b4-118bf03df843 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:22:47.769125 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bff5ef-974f-4892-b4b4-118bf03df843 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:22:47.770963 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bff5ef-974f-4892-b4b4-118bf03df843 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:22:47.785142 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 62/128] 10.222.0.117 () {56 vars in 1127 bytes} [Tue Jan 25 02:22:47 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:22:47.790592 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52949534-728b-45ca-9b2f-f3c75ee3902c admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:22:47.806090 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52949534-728b-45ca-9b2f-f3c75ee3902c admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:22:47.817229 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76999118-edd9-4625-8baa-90a7323da1b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:22:47.818111 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76999118-edd9-4625-8baa-90a7323da1b3 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:47.818396 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76999118-edd9-4625-8baa-90a7323da1b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:47.818682 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76999118-edd9-4625-8baa-90a7323da1b3 admin admin] PATH_INFO: `/v3/users/f64c5292e3bc416fbd8d88c0986c5688` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:47.838428 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76999118-edd9-4625-8baa-90a7323da1b3 admin admin] RBAC: Authorizing `identity:get_user(user_id=f64c5292e3bc416fbd8d88c0986c5688)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:22:47.841399 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76999118-edd9-4625-8baa-90a7323da1b3 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:22:47.843133 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 67/129] 10.222.0.117 () {56 vars in 1203 bytes} [Tue Jan 25 02:22:47 2022] GET /identity/v3/users/f64c5292e3bc416fbd8d88c0986c5688 => generated 290 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:22:47.848997 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bff5ef-974f-4892-b4b4-118bf03df843 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:22:47.865799 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bff5ef-974f-4892-b4b4-118bf03df843 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:22:47.872625 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721de14b-d82e-4935-bf90-bbeeee2957c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:22:47.873390 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721de14b-d82e-4935-bf90-bbeeee2957c1 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:47.873684 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721de14b-d82e-4935-bf90-bbeeee2957c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:47.873957 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721de14b-d82e-4935-bf90-bbeeee2957c1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:47.886121 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721de14b-d82e-4935-bf90-bbeeee2957c1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:22:47.889322 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721de14b-d82e-4935-bf90-bbeeee2957c1 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:22:47.906213 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 63/130] 10.222.0.117 () {58 vars in 1329 bytes} [Tue Jan 25 02:22:47 2022] GET /identity/v3/auth/tokens => generated 915 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 25 02:22:47.907494 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76999118-edd9-4625-8baa-90a7323da1b3 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:22:47.914508 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96439725-d29e-4688-a369-5100b576a93b None None] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:47.914799 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96439725-d29e-4688-a369-5100b576a93b None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:47.915079 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96439725-d29e-4688-a369-5100b576a93b None None] PATH_INFO: `/` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:47.916881 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 64/131] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:22:47 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:22:47.922643 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76999118-edd9-4625-8baa-90a7323da1b3 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:22:47.924800 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6026d4-e480-453e-8014-96951b8d35bd None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:47.925234 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6026d4-e480-453e-8014-96951b8d35bd None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:47.926009 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6026d4-e480-453e-8014-96951b8d35bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:47.927958 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaee2611-ddc4-46fc-8a6d-10f473cfc7ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:22:47.929024 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaee2611-ddc4-46fc-8a6d-10f473cfc7ce admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:47.929416 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaee2611-ddc4-46fc-8a6d-10f473cfc7ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:47.935715 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaee2611-ddc4-46fc-8a6d-10f473cfc7ce admin admin] PATH_INFO: `/v3/projects/26e358bfb5294c7f9855f86b5dbeedac` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:47.935715 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaee2611-ddc4-46fc-8a6d-10f473cfc7ce admin admin] RBAC: Authorizing `identity:get_project(project_id=26e358bfb5294c7f9855f86b5dbeedac)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:22:47.935715 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaee2611-ddc4-46fc-8a6d-10f473cfc7ce admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:22:47.935715 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 68/132] 10.222.0.117 () {56 vars in 1212 bytes} [Tue Jan 25 02:22:47 2022] GET /identity/v3/projects/26e358bfb5294c7f9855f86b5dbeedac => generated 299 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 02:22:47.941208 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaee2611-ddc4-46fc-8a6d-10f473cfc7ce admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:22:47.955755 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaee2611-ddc4-46fc-8a6d-10f473cfc7ce admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:22:47.964590 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94e3f1c-0020-42ec-9332-25a29dda25b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:22:47.965816 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94e3f1c-0020-42ec-9332-25a29dda25b4 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:47.966112 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94e3f1c-0020-42ec-9332-25a29dda25b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:47.966391 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94e3f1c-0020-42ec-9332-25a29dda25b4 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:47.967472 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94e3f1c-0020-42ec-9332-25a29dda25b4 admin admin] RBAC: Adding query filter params (role.id=3f17a45b07a243abb2d3005961a5d648, scope.project.id=26e358bfb5294c7f9855f86b5dbeedac, user.id=f64c5292e3bc416fbd8d88c0986c5688) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:22:47.967812 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94e3f1c-0020-42ec-9332-25a29dda25b4 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:22:47.969692 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94e3f1c-0020-42ec-9332-25a29dda25b4 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:22:47.972943 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-ae6026d4-e480-453e-8014-96951b8d35bd None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:22:47.974178 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-ae6026d4-e480-453e-8014-96951b8d35bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:22:47.986976 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 65/133] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:22:47 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 25 02:22:47.987207 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 69/134] 10.222.0.117 () {56 vars in 1400 bytes} [Tue Jan 25 02:22:47 2022] GET /identity/v3/role_assignments?user.id=f64c5292e3bc416fbd8d88c0986c5688&scope.project.id=26e358bfb5294c7f9855f86b5dbeedac&role.id=3f17a45b07a243abb2d3005961a5d648 => generated 260 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:22:48.026663 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6026d4-e480-453e-8014-96951b8d35bd None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:22:48.036460 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6026d4-e480-453e-8014-96951b8d35bd None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:22:48.041098 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8387887b-eabf-4cd8-ac35-79a09c2ea747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:22:48.041919 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8387887b-eabf-4cd8-ac35-79a09c2ea747 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:48.042208 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8387887b-eabf-4cd8-ac35-79a09c2ea747 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:48.042491 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8387887b-eabf-4cd8-ac35-79a09c2ea747 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:48.044364 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8387887b-eabf-4cd8-ac35-79a09c2ea747 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:22:48.046108 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8387887b-eabf-4cd8-ac35-79a09c2ea747 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:22:48.047780 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 66/135] 10.222.0.117 () {56 vars in 1134 bytes} [Tue Jan 25 02:22:48 2022] GET /identity/v3/domains/default => generated 200 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:22:48.053728 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94e3f1c-0020-42ec-9332-25a29dda25b4 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:22:48.064111 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94e3f1c-0020-42ec-9332-25a29dda25b4 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:22:48.068782 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc8deb9-ffd9-492b-80a0-6feab5155e17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:22:48.069597 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc8deb9-ffd9-492b-80a0-6feab5155e17 admin admin] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:48.070033 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc8deb9-ffd9-492b-80a0-6feab5155e17 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:48.070451 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc8deb9-ffd9-492b-80a0-6feab5155e17 admin admin] PATH_INFO: `/v3/projects` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:48.071355 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc8deb9-ffd9-492b-80a0-6feab5155e17 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:22:48.077747 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc8deb9-ffd9-492b-80a0-6feab5155e17 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:22:48.115810 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 70/136] 10.222.0.117 () {60 vars in 1167 bytes} [Tue Jan 25 02:22:48 2022] POST /identity/v3/projects => generated 303 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 02:22:48.972604 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec6d360-8c72-4ca2-81f4-b2c336652a1a None None] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:48.973101 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec6d360-8c72-4ca2-81f4-b2c336652a1a None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:48.973271 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec6d360-8c72-4ca2-81f4-b2c336652a1a None None] PATH_INFO: `/` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:48.975057 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 67/137] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:22:48 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:22:48.992415 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287ae1bf-66f3-449e-a6d3-478769a42f30 None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:48.992900 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287ae1bf-66f3-449e-a6d3-478769a42f30 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:48.992970 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287ae1bf-66f3-449e-a6d3-478769a42f30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:49.018303 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-287ae1bf-66f3-449e-a6d3-478769a42f30 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:22:49.019524 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-287ae1bf-66f3-449e-a6d3-478769a42f30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:22:49.091526 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 71/138] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:22:48 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 25 02:22:49.134959 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec6d360-8c72-4ca2-81f4-b2c336652a1a None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:22:49.159007 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec6d360-8c72-4ca2-81f4-b2c336652a1a None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:22:49.165370 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514a7073-68d7-4a78-884f-ef812384a55b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:22:49.166196 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514a7073-68d7-4a78-884f-ef812384a55b admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:49.166489 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514a7073-68d7-4a78-884f-ef812384a55b admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:49.166774 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514a7073-68d7-4a78-884f-ef812384a55b admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:49.183517 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514a7073-68d7-4a78-884f-ef812384a55b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 25 02:22:49.196715 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: WARNING keystone.server.flask.application [None req-514a7073-68d7-4a78-884f-ef812384a55b admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 25 02:22:49.198212 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 68/139] 10.222.0.117 () {56 vars in 1125 bytes} [Tue Jan 25 02:22:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:22:49.206124 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287ae1bf-66f3-449e-a6d3-478769a42f30 None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:22:49.224687 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287ae1bf-66f3-449e-a6d3-478769a42f30 None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:22:49.231660 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195b6172-f7ef-4b6e-adff-b425a567683f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:22:49.236784 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195b6172-f7ef-4b6e-adff-b425a567683f admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:49.237219 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195b6172-f7ef-4b6e-adff-b425a567683f admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:49.237640 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195b6172-f7ef-4b6e-adff-b425a567683f admin admin] PATH_INFO: `/v3/roles` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:49.238846 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195b6172-f7ef-4b6e-adff-b425a567683f admin admin] RBAC: Adding query filter params (name=member) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:22:49.239321 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195b6172-f7ef-4b6e-adff-b425a567683f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:22:49.242002 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195b6172-f7ef-4b6e-adff-b425a567683f admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:22:49.261365 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 72/140] 10.222.0.117 () {56 vars in 1127 bytes} [Tue Jan 25 02:22:49 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:22:49.268375 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514a7073-68d7-4a78-884f-ef812384a55b admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:22:49.279270 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514a7073-68d7-4a78-884f-ef812384a55b admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:22:49.287989 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23786164-2c7d-4f80-b1a9-a4b356f7ae5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:22:49.288889 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23786164-2c7d-4f80-b1a9-a4b356f7ae5c admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:49.289179 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23786164-2c7d-4f80-b1a9-a4b356f7ae5c admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:49.289463 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23786164-2c7d-4f80-b1a9-a4b356f7ae5c admin admin] PATH_INFO: `/v3/users/6680b5cac28b4aa1b86cbea15dc3c7be` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:49.290752 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23786164-2c7d-4f80-b1a9-a4b356f7ae5c admin admin] RBAC: Authorizing `identity:get_user(user_id=6680b5cac28b4aa1b86cbea15dc3c7be)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:22:49.293019 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23786164-2c7d-4f80-b1a9-a4b356f7ae5c admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:22:49.295025 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 69/141] 10.222.0.117 () {56 vars in 1203 bytes} [Tue Jan 25 02:22:49 2022] GET /identity/v3/users/6680b5cac28b4aa1b86cbea15dc3c7be => generated 276 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:22:49.300581 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195b6172-f7ef-4b6e-adff-b425a567683f admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:22:49.311007 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195b6172-f7ef-4b6e-adff-b425a567683f admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:22:49.315561 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fa876d-9cf5-4fd8-86d8-fcf40a4684f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:22:49.316266 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fa876d-9cf5-4fd8-86d8-fcf40a4684f8 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:49.316604 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fa876d-9cf5-4fd8-86d8-fcf40a4684f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:49.316830 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fa876d-9cf5-4fd8-86d8-fcf40a4684f8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:49.326405 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fa876d-9cf5-4fd8-86d8-fcf40a4684f8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:22:49.328251 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fa876d-9cf5-4fd8-86d8-fcf40a4684f8 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:22:49.337912 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 73/142] 10.222.0.117 () {58 vars in 1329 bytes} [Tue Jan 25 02:22:49 2022] GET /identity/v3/auth/tokens => generated 915 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 25 02:22:49.344436 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23786164-2c7d-4f80-b1a9-a4b356f7ae5c admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:22:49.355146 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23786164-2c7d-4f80-b1a9-a4b356f7ae5c admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:22:49.363822 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc79d3b4-4e42-4224-9518-bff23d211f8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:22:49.364686 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc79d3b4-4e42-4224-9518-bff23d211f8d admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:49.364973 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc79d3b4-4e42-4224-9518-bff23d211f8d admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:49.365249 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc79d3b4-4e42-4224-9518-bff23d211f8d admin admin] PATH_INFO: `/v3/projects/26e358bfb5294c7f9855f86b5dbeedac` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:49.366464 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc79d3b4-4e42-4224-9518-bff23d211f8d admin admin] RBAC: Authorizing `identity:get_project(project_id=26e358bfb5294c7f9855f86b5dbeedac)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:22:49.368602 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc79d3b4-4e42-4224-9518-bff23d211f8d admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:22:49.370447 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 70/143] 10.222.0.117 () {56 vars in 1212 bytes} [Tue Jan 25 02:22:49 2022] GET /identity/v3/projects/26e358bfb5294c7f9855f86b5dbeedac => generated 299 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:22:49.376066 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fa876d-9cf5-4fd8-86d8-fcf40a4684f8 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:22:49.387444 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fa876d-9cf5-4fd8-86d8-fcf40a4684f8 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:22:49.394268 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8003443-ddf9-4925-9efc-429912073d25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:22:49.394971 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8003443-ddf9-4925-9efc-429912073d25 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:49.395257 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8003443-ddf9-4925-9efc-429912073d25 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:49.395535 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8003443-ddf9-4925-9efc-429912073d25 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:49.396458 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8003443-ddf9-4925-9efc-429912073d25 admin admin] RBAC: Adding query filter params (role.id=33a8e87420ed423f9cb29e0084eab5d2, scope.project.id=26e358bfb5294c7f9855f86b5dbeedac, user.id=6680b5cac28b4aa1b86cbea15dc3c7be) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:22:49.396812 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8003443-ddf9-4925-9efc-429912073d25 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:22:49.398728 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8003443-ddf9-4925-9efc-429912073d25 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:22:49.409908 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 74/144] 10.222.0.117 () {56 vars in 1400 bytes} [Tue Jan 25 02:22:49 2022] GET /identity/v3/role_assignments?user.id=6680b5cac28b4aa1b86cbea15dc3c7be&scope.project.id=26e358bfb5294c7f9855f86b5dbeedac&role.id=33a8e87420ed423f9cb29e0084eab5d2 => generated 610 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:22:49.586711 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedbed30-83d5-44af-86bb-915b0948e7dc None None] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:49.587054 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedbed30-83d5-44af-86bb-915b0948e7dc None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:49.587217 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedbed30-83d5-44af-86bb-915b0948e7dc None None] PATH_INFO: `/` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:49.590300 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 71/145] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:22:49 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:22:49.598955 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b246b4ae-496f-4e07-a7d3-023bdf7082a4 None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:49.599245 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b246b4ae-496f-4e07-a7d3-023bdf7082a4 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:49.599512 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b246b4ae-496f-4e07-a7d3-023bdf7082a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:49.623748 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-b246b4ae-496f-4e07-a7d3-023bdf7082a4 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:22:49.624990 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-b246b4ae-496f-4e07-a7d3-023bdf7082a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:22:49.633525 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 75/146] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:22:49 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 25 02:22:49.689246 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedbed30-83d5-44af-86bb-915b0948e7dc None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:22:49.705260 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedbed30-83d5-44af-86bb-915b0948e7dc None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:22:49.710793 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cb07c0-e348-4010-b3b4-3ab3597b9487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:22:49.711729 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cb07c0-e348-4010-b3b4-3ab3597b9487 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:49.711994 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cb07c0-e348-4010-b3b4-3ab3597b9487 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:49.712269 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cb07c0-e348-4010-b3b4-3ab3597b9487 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:49.728409 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cb07c0-e348-4010-b3b4-3ab3597b9487 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 25 02:22:49.736327 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: WARNING keystone.server.flask.application [None req-50cb07c0-e348-4010-b3b4-3ab3597b9487 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 25 02:22:49.737898 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 72/147] 10.222.0.117 () {56 vars in 1125 bytes} [Tue Jan 25 02:22:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:22:49.743961 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b246b4ae-496f-4e07-a7d3-023bdf7082a4 None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:22:49.755661 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b246b4ae-496f-4e07-a7d3-023bdf7082a4 None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:22:49.761318 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03d325c-4295-41fd-82d2-753f51fb1746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:22:49.763047 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03d325c-4295-41fd-82d2-753f51fb1746 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:49.763336 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03d325c-4295-41fd-82d2-753f51fb1746 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:49.763610 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03d325c-4295-41fd-82d2-753f51fb1746 admin admin] PATH_INFO: `/v3/roles` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:49.764475 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03d325c-4295-41fd-82d2-753f51fb1746 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:22:49.764782 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03d325c-4295-41fd-82d2-753f51fb1746 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:22:49.766455 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03d325c-4295-41fd-82d2-753f51fb1746 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:22:49.780887 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 76/148] 10.222.0.117 () {56 vars in 1127 bytes} [Tue Jan 25 02:22:49 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:22:49.786614 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cb07c0-e348-4010-b3b4-3ab3597b9487 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:22:49.798027 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cb07c0-e348-4010-b3b4-3ab3597b9487 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:22:49.804099 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6033a096-fa6c-46b8-a8b0-e85d195366ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:22:49.805024 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6033a096-fa6c-46b8-a8b0-e85d195366ea admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:49.805307 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6033a096-fa6c-46b8-a8b0-e85d195366ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:49.805581 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6033a096-fa6c-46b8-a8b0-e85d195366ea admin admin] PATH_INFO: `/v3/users/6680b5cac28b4aa1b86cbea15dc3c7be` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:49.806945 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6033a096-fa6c-46b8-a8b0-e85d195366ea admin admin] RBAC: Authorizing `identity:get_user(user_id=6680b5cac28b4aa1b86cbea15dc3c7be)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:22:49.809266 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6033a096-fa6c-46b8-a8b0-e85d195366ea admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:22:49.811331 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 73/149] 10.222.0.117 () {56 vars in 1203 bytes} [Tue Jan 25 02:22:49 2022] GET /identity/v3/users/6680b5cac28b4aa1b86cbea15dc3c7be => generated 276 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:22:49.817260 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03d325c-4295-41fd-82d2-753f51fb1746 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:22:49.828352 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03d325c-4295-41fd-82d2-753f51fb1746 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:22:49.833344 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e145d82c-387f-4dfe-a2de-63aab5e267a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:22:49.834103 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e145d82c-387f-4dfe-a2de-63aab5e267a7 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:49.834388 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e145d82c-387f-4dfe-a2de-63aab5e267a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:49.834664 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e145d82c-387f-4dfe-a2de-63aab5e267a7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:49.848290 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e145d82c-387f-4dfe-a2de-63aab5e267a7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:22:49.850036 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e145d82c-387f-4dfe-a2de-63aab5e267a7 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:22:49.862436 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 77/150] 10.222.0.117 () {58 vars in 1329 bytes} [Tue Jan 25 02:22:49 2022] GET /identity/v3/auth/tokens => generated 915 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 25 02:22:49.868446 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6033a096-fa6c-46b8-a8b0-e85d195366ea admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:22:49.880368 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6033a096-fa6c-46b8-a8b0-e85d195366ea admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:22:49.888980 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46595535-1deb-4a1e-aa3e-6f7bb40398c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:22:49.889991 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46595535-1deb-4a1e-aa3e-6f7bb40398c6 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:49.890291 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46595535-1deb-4a1e-aa3e-6f7bb40398c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:49.890627 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46595535-1deb-4a1e-aa3e-6f7bb40398c6 admin admin] PATH_INFO: `/v3/projects/23e2ef72742d4a2cb64f8a286c6d034d` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:49.891907 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46595535-1deb-4a1e-aa3e-6f7bb40398c6 admin admin] RBAC: Authorizing `identity:get_project(project_id=23e2ef72742d4a2cb64f8a286c6d034d)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:22:49.894412 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46595535-1deb-4a1e-aa3e-6f7bb40398c6 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:22:49.896324 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 74/151] 10.222.0.117 () {56 vars in 1212 bytes} [Tue Jan 25 02:22:49 2022] GET /identity/v3/projects/23e2ef72742d4a2cb64f8a286c6d034d => generated 313 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:22:49.902296 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e145d82c-387f-4dfe-a2de-63aab5e267a7 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:22:49.916904 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e145d82c-387f-4dfe-a2de-63aab5e267a7 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:22:49.922381 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba67b1b-76d8-48cd-aa9f-8997dc8bbb6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:22:49.923082 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba67b1b-76d8-48cd-aa9f-8997dc8bbb6e admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:49.923456 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba67b1b-76d8-48cd-aa9f-8997dc8bbb6e admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:49.923707 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba67b1b-76d8-48cd-aa9f-8997dc8bbb6e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:49.924567 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba67b1b-76d8-48cd-aa9f-8997dc8bbb6e admin admin] RBAC: Adding query filter params (role.id=33a8e87420ed423f9cb29e0084eab5d2, scope.project.id=23e2ef72742d4a2cb64f8a286c6d034d, user.id=6680b5cac28b4aa1b86cbea15dc3c7be) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:22:49.925046 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba67b1b-76d8-48cd-aa9f-8997dc8bbb6e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:22:49.926999 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba67b1b-76d8-48cd-aa9f-8997dc8bbb6e admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:22:49.935522 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 78/152] 10.222.0.117 () {56 vars in 1400 bytes} [Tue Jan 25 02:22:49 2022] GET /identity/v3/role_assignments?user.id=6680b5cac28b4aa1b86cbea15dc3c7be&scope.project.id=23e2ef72742d4a2cb64f8a286c6d034d&role.id=33a8e87420ed423f9cb29e0084eab5d2 => generated 610 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:22:50.104802 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21230393-0464-4554-9c91-50f162b61c98 None None] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:50.105450 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21230393-0464-4554-9c91-50f162b61c98 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:50.105450 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21230393-0464-4554-9c91-50f162b61c98 None None] PATH_INFO: `/` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:50.107893 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 75/153] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:22:50 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:22:50.113758 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3300da77-7df4-4e3b-8248-60ef483be488 None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:50.114356 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3300da77-7df4-4e3b-8248-60ef483be488 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:50.114356 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3300da77-7df4-4e3b-8248-60ef483be488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:50.131255 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69d22a7-5140-4c63-9c4d-725ae4a258e4 None None] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:50.131550 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69d22a7-5140-4c63-9c4d-725ae4a258e4 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:50.131840 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69d22a7-5140-4c63-9c4d-725ae4a258e4 None None] PATH_INFO: `/` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:50.133791 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 76/154] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:22:50 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jan 25 02:22:50.141018 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b93249f-87a8-4735-aaa1-85d5ec9ccc1d None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:50.141301 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b93249f-87a8-4735-aaa1-85d5ec9ccc1d None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:50.141590 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b93249f-87a8-4735-aaa1-85d5ec9ccc1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:50.145151 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-3300da77-7df4-4e3b-8248-60ef483be488 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:22:50.146381 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-3300da77-7df4-4e3b-8248-60ef483be488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:22:50.155773 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 79/155] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:22:50 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 25 02:22:50.180782 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3300da77-7df4-4e3b-8248-60ef483be488 None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:22:50.184790 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-3b93249f-87a8-4735-aaa1-85d5ec9ccc1d None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:22:50.186180 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-3b93249f-87a8-4735-aaa1-85d5ec9ccc1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:22:50.191063 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3300da77-7df4-4e3b-8248-60ef483be488 None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:22:50.198642 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6e90b7-9490-4e68-9ec4-fa9a13591918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:22:50.200617 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6e90b7-9490-4e68-9ec4-fa9a13591918 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:50.200790 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 77/156] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:22:50 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 25 02:22:50.200936 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6e90b7-9490-4e68-9ec4-fa9a13591918 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:50.200936 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6e90b7-9490-4e68-9ec4-fa9a13591918 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:50.211759 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6e90b7-9490-4e68-9ec4-fa9a13591918 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 25 02:22:50.219812 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: WARNING keystone.server.flask.application [None req-ee6e90b7-9490-4e68-9ec4-fa9a13591918 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jan 25 02:22:50.221277 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 80/157] 10.222.0.117 () {56 vars in 1140 bytes} [Tue Jan 25 02:22:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 25 02:22:50.228021 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b93249f-87a8-4735-aaa1-85d5ec9ccc1d None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:22:50.230733 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6e90b7-9490-4e68-9ec4-fa9a13591918 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:22:50.241571 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b93249f-87a8-4735-aaa1-85d5ec9ccc1d None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:22:50.247748 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6e90b7-9490-4e68-9ec4-fa9a13591918 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:22:50.251047 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6dd35e-9391-42b7-8e1c-57cd3ad868bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:22:50.251852 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6dd35e-9391-42b7-8e1c-57cd3ad868bf admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:50.252244 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6dd35e-9391-42b7-8e1c-57cd3ad868bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:50.252986 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0514b58d-7833-43a9-bc87-e1856d3eec2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:22:50.253366 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6dd35e-9391-42b7-8e1c-57cd3ad868bf admin admin] PATH_INFO: `/v3/roles` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:50.254092 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0514b58d-7833-43a9-bc87-e1856d3eec2d admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:50.254367 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6dd35e-9391-42b7-8e1c-57cd3ad868bf admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:22:50.254763 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0514b58d-7833-43a9-bc87-e1856d3eec2d admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:50.254873 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6dd35e-9391-42b7-8e1c-57cd3ad868bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:22:50.255271 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0514b58d-7833-43a9-bc87-e1856d3eec2d admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:50.256687 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6dd35e-9391-42b7-8e1c-57cd3ad868bf admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:22:50.269423 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 78/158] 10.222.0.117 () {56 vars in 1137 bytes} [Tue Jan 25 02:22:50 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:22:50.270077 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0514b58d-7833-43a9-bc87-e1856d3eec2d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 25 02:22:50.274861 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6dd35e-9391-42b7-8e1c-57cd3ad868bf admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:22:50.278746 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: WARNING keystone.server.flask.application [None req-0514b58d-7833-43a9-bc87-e1856d3eec2d admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 25 02:22:50.280276 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 81/159] 10.222.0.117 () {56 vars in 1122 bytes} [Tue Jan 25 02:22:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 25 02:22:50.286312 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0514b58d-7833-43a9-bc87-e1856d3eec2d admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:22:50.289604 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6dd35e-9391-42b7-8e1c-57cd3ad868bf admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:22:50.295944 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfb78ab-e637-48e9-b5d8-6718c1206a84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:22:50.296982 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfb78ab-e637-48e9-b5d8-6718c1206a84 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:50.297390 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfb78ab-e637-48e9-b5d8-6718c1206a84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:50.297745 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfb78ab-e637-48e9-b5d8-6718c1206a84 admin admin] PATH_INFO: `/v3/users/6680b5cac28b4aa1b86cbea15dc3c7be` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:50.299227 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfb78ab-e637-48e9-b5d8-6718c1206a84 admin admin] RBAC: Authorizing `identity:get_user(user_id=6680b5cac28b4aa1b86cbea15dc3c7be)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:22:50.300355 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0514b58d-7833-43a9-bc87-e1856d3eec2d admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:22:50.301724 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfb78ab-e637-48e9-b5d8-6718c1206a84 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:22:50.303765 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 79/160] 10.222.0.117 () {56 vars in 1203 bytes} [Tue Jan 25 02:22:50 2022] GET /identity/v3/users/6680b5cac28b4aa1b86cbea15dc3c7be => generated 276 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:22:50.305637 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460ca12c-d199-489a-af21-ac9a125bd0c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:22:50.306476 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460ca12c-d199-489a-af21-ac9a125bd0c4 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:50.306898 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460ca12c-d199-489a-af21-ac9a125bd0c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:50.307314 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460ca12c-d199-489a-af21-ac9a125bd0c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:50.308257 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460ca12c-d199-489a-af21-ac9a125bd0c4 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:22:50.309474 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460ca12c-d199-489a-af21-ac9a125bd0c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:22:50.310669 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfb78ab-e637-48e9-b5d8-6718c1206a84 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:22:50.311673 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460ca12c-d199-489a-af21-ac9a125bd0c4 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:22:50.320767 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 82/161] 10.222.0.117 () {56 vars in 1125 bytes} [Tue Jan 25 02:22:50 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 02:22:50.323739 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfb78ab-e637-48e9-b5d8-6718c1206a84 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:22:50.327553 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460ca12c-d199-489a-af21-ac9a125bd0c4 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:22:50.329301 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e61f44-c105-4091-8b57-431c978e78ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:22:50.330199 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e61f44-c105-4091-8b57-431c978e78ed admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:50.330724 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e61f44-c105-4091-8b57-431c978e78ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:50.331213 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e61f44-c105-4091-8b57-431c978e78ed admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:50.337672 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460ca12c-d199-489a-af21-ac9a125bd0c4 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:22:50.341342 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e61f44-c105-4091-8b57-431c978e78ed admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:22:50.342840 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca1b0f5-dad2-4ab8-9e62-c40707a41ef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:22:50.343723 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca1b0f5-dad2-4ab8-9e62-c40707a41ef3 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:50.344012 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca1b0f5-dad2-4ab8-9e62-c40707a41ef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:50.344292 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca1b0f5-dad2-4ab8-9e62-c40707a41ef3 admin admin] PATH_INFO: `/v3/users/3db97686d01f422cb62642c302e35e45` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:50.344598 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e61f44-c105-4091-8b57-431c978e78ed admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:22:50.345513 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca1b0f5-dad2-4ab8-9e62-c40707a41ef3 admin admin] RBAC: Authorizing `identity:get_user(user_id=3db97686d01f422cb62642c302e35e45)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:22:50.347596 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca1b0f5-dad2-4ab8-9e62-c40707a41ef3 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:22:50.349246 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 83/162] 10.222.0.117 () {56 vars in 1203 bytes} [Tue Jan 25 02:22:50 2022] GET /identity/v3/users/3db97686d01f422cb62642c302e35e45 => generated 248 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 02:22:50.354491 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca1b0f5-dad2-4ab8-9e62-c40707a41ef3 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:22:50.357252 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 80/163] 10.222.0.117 () {58 vars in 1329 bytes} [Tue Jan 25 02:22:50 2022] GET /identity/v3/auth/tokens => generated 915 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jan 25 02:22:50.362795 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e61f44-c105-4091-8b57-431c978e78ed admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:22:50.365397 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca1b0f5-dad2-4ab8-9e62-c40707a41ef3 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:22:50.369862 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952ea50e-32ae-4c91-bfff-575a5ec06b1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:22:50.370499 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952ea50e-32ae-4c91-bfff-575a5ec06b1c admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:50.370781 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952ea50e-32ae-4c91-bfff-575a5ec06b1c admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:50.371058 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952ea50e-32ae-4c91-bfff-575a5ec06b1c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:50.374728 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e61f44-c105-4091-8b57-431c978e78ed admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:22:50.379843 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca317217-978e-4bf1-bdf1-4d2bf179eab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:22:50.380711 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952ea50e-32ae-4c91-bfff-575a5ec06b1c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:22:50.381229 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca317217-978e-4bf1-bdf1-4d2bf179eab5 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:50.381708 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca317217-978e-4bf1-bdf1-4d2bf179eab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:50.382252 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca317217-978e-4bf1-bdf1-4d2bf179eab5 admin admin] PATH_INFO: `/v3/projects/26e358bfb5294c7f9855f86b5dbeedac` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:50.382513 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952ea50e-32ae-4c91-bfff-575a5ec06b1c admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:22:50.388580 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca317217-978e-4bf1-bdf1-4d2bf179eab5 admin admin] RBAC: Authorizing `identity:get_project(project_id=26e358bfb5294c7f9855f86b5dbeedac)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:22:50.390845 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca317217-978e-4bf1-bdf1-4d2bf179eab5 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:22:50.392835 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 81/164] 10.222.0.117 () {56 vars in 1212 bytes} [Tue Jan 25 02:22:50 2022] GET /identity/v3/projects/26e358bfb5294c7f9855f86b5dbeedac => generated 299 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 02:22:50.398667 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca317217-978e-4bf1-bdf1-4d2bf179eab5 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:22:50.398779 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 84/165] 10.222.0.117 () {58 vars in 1329 bytes} [Tue Jan 25 02:22:50 2022] GET /identity/v3/auth/tokens => generated 915 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 25 02:22:50.399676 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952ea50e-32ae-4c91-bfff-575a5ec06b1c admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:22:50.409122 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952ea50e-32ae-4c91-bfff-575a5ec06b1c admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:22:50.409573 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca317217-978e-4bf1-bdf1-4d2bf179eab5 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:22:50.414161 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe777db-a698-42f0-8c6c-354b02f94506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:22:50.414482 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38402c87-f48c-415d-8092-ffd2ecc02814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:22:50.415316 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe777db-a698-42f0-8c6c-354b02f94506 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:50.415419 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38402c87-f48c-415d-8092-ffd2ecc02814 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:50.415659 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38402c87-f48c-415d-8092-ffd2ecc02814 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:50.415990 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38402c87-f48c-415d-8092-ffd2ecc02814 admin admin] PATH_INFO: `/v3/projects/26e358bfb5294c7f9855f86b5dbeedac` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:50.416339 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe777db-a698-42f0-8c6c-354b02f94506 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:50.416818 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe777db-a698-42f0-8c6c-354b02f94506 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:50.417286 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38402c87-f48c-415d-8092-ffd2ecc02814 admin admin] RBAC: Authorizing `identity:get_project(project_id=26e358bfb5294c7f9855f86b5dbeedac)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:22:50.418083 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe777db-a698-42f0-8c6c-354b02f94506 admin admin] RBAC: Adding query filter params (role.id=259d005f63d5455d8728277d6385bfba, scope.project.id=26e358bfb5294c7f9855f86b5dbeedac, user.id=6680b5cac28b4aa1b86cbea15dc3c7be) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:22:50.419026 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe777db-a698-42f0-8c6c-354b02f94506 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:22:50.419787 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38402c87-f48c-415d-8092-ffd2ecc02814 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:22:50.421417 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe777db-a698-42f0-8c6c-354b02f94506 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:22:50.421519 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 85/166] 10.222.0.117 () {56 vars in 1212 bytes} [Tue Jan 25 02:22:50 2022] GET /identity/v3/projects/26e358bfb5294c7f9855f86b5dbeedac => generated 299 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:22:50.427240 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38402c87-f48c-415d-8092-ffd2ecc02814 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:22:50.430355 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 82/167] 10.222.0.117 () {56 vars in 1400 bytes} [Tue Jan 25 02:22:50 2022] GET /identity/v3/role_assignments?user.id=6680b5cac28b4aa1b86cbea15dc3c7be&scope.project.id=26e358bfb5294c7f9855f86b5dbeedac&role.id=259d005f63d5455d8728277d6385bfba => generated 610 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:22:50.438039 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38402c87-f48c-415d-8092-ffd2ecc02814 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:22:50.442996 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e885e422-5edc-4a08-b9bb-4eea7d26e03f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:22:50.443740 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e885e422-5edc-4a08-b9bb-4eea7d26e03f admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:50.444078 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e885e422-5edc-4a08-b9bb-4eea7d26e03f admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:50.444361 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e885e422-5edc-4a08-b9bb-4eea7d26e03f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:50.445282 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e885e422-5edc-4a08-b9bb-4eea7d26e03f admin admin] RBAC: Adding query filter params (role.id=d8dbc6d83d9d41d28c3feb8b3485b291, scope.project.id=26e358bfb5294c7f9855f86b5dbeedac, user.id=3db97686d01f422cb62642c302e35e45) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:22:50.445595 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e885e422-5edc-4a08-b9bb-4eea7d26e03f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:22:50.447719 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e885e422-5edc-4a08-b9bb-4eea7d26e03f admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:22:50.455812 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 86/168] 10.222.0.117 () {56 vars in 1400 bytes} [Tue Jan 25 02:22:50 2022] GET /identity/v3/role_assignments?user.id=3db97686d01f422cb62642c302e35e45&scope.project.id=26e358bfb5294c7f9855f86b5dbeedac&role.id=d8dbc6d83d9d41d28c3feb8b3485b291 => generated 610 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 02:22:51.326161 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bbfb6c-3134-4bb9-b813-245dda9a158f None None] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:51.326710 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bbfb6c-3134-4bb9-b813-245dda9a158f None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:51.326710 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bbfb6c-3134-4bb9-b813-245dda9a158f None None] PATH_INFO: `/` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:51.328599 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 83/169] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:22:51 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:22:51.333876 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4498dff4-632b-41a0-8787-ce3b137e4c43 None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:51.334272 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4498dff4-632b-41a0-8787-ce3b137e4c43 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:51.334444 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4498dff4-632b-41a0-8787-ce3b137e4c43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:51.352927 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-4498dff4-632b-41a0-8787-ce3b137e4c43 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:22:51.354107 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-4498dff4-632b-41a0-8787-ce3b137e4c43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:22:51.362300 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 87/170] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:22:51 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 25 02:22:51.386401 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bbfb6c-3134-4bb9-b813-245dda9a158f None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:22:51.398983 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bbfb6c-3134-4bb9-b813-245dda9a158f None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:22:51.403815 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92cb558-ccc1-4985-9acb-380e4370146b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:22:51.404591 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92cb558-ccc1-4985-9acb-380e4370146b admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:51.404874 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92cb558-ccc1-4985-9acb-380e4370146b admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:51.405144 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92cb558-ccc1-4985-9acb-380e4370146b admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:51.406305 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92cb558-ccc1-4985-9acb-380e4370146b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:22:51.408073 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92cb558-ccc1-4985-9acb-380e4370146b admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:22:51.409787 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 84/171] 10.222.0.117 () {56 vars in 1134 bytes} [Tue Jan 25 02:22:51 2022] GET /identity/v3/domains/default => generated 200 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:22:51.414872 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4498dff4-632b-41a0-8787-ce3b137e4c43 None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:22:51.424380 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4498dff4-632b-41a0-8787-ce3b137e4c43 None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:22:51.428666 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cb56ca-962f-4e8c-a39f-12552fa21c16 None None] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:51.428795 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e121b080-c9bc-4a97-995c-7a036fbebbe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:22:51.428957 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cb56ca-962f-4e8c-a39f-12552fa21c16 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:51.429236 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cb56ca-962f-4e8c-a39f-12552fa21c16 None None] PATH_INFO: `/` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:51.429372 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e121b080-c9bc-4a97-995c-7a036fbebbe1 admin admin] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:51.429655 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e121b080-c9bc-4a97-995c-7a036fbebbe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:51.429932 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e121b080-c9bc-4a97-995c-7a036fbebbe1 admin admin] PATH_INFO: `/v3/users` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:51.430670 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e121b080-c9bc-4a97-995c-7a036fbebbe1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:22:51.430967 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 85/172] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:22:51 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jan 25 02:22:51.432716 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e121b080-c9bc-4a97-995c-7a036fbebbe1 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:22:51.436599 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185e68ca-8bc9-44cc-99d8-fa477a751f22 None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:51.436886 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185e68ca-8bc9-44cc-99d8-fa477a751f22 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:51.437164 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185e68ca-8bc9-44cc-99d8-fa477a751f22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:51.452471 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 88/173] 10.222.0.117 () {60 vars in 1158 bytes} [Tue Jan 25 02:22:51 2022] POST /identity/v3/users => generated 284 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 02:22:51.455163 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-185e68ca-8bc9-44cc-99d8-fa477a751f22 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:22:51.456401 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-185e68ca-8bc9-44cc-99d8-fa477a751f22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:22:51.464036 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 86/174] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:22:51 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 25 02:22:51.488686 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e121b080-c9bc-4a97-995c-7a036fbebbe1 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:22:51.499644 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e121b080-c9bc-4a97-995c-7a036fbebbe1 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:22:51.504172 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b1f2b2-ac4c-41eb-a912-4f506e8f0732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:22:51.504996 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b1f2b2-ac4c-41eb-a912-4f506e8f0732 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:51.505295 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b1f2b2-ac4c-41eb-a912-4f506e8f0732 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:51.505549 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b1f2b2-ac4c-41eb-a912-4f506e8f0732 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:51.518294 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b1f2b2-ac4c-41eb-a912-4f506e8f0732 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 25 02:22:51.525451 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: WARNING keystone.server.flask.application [None req-63b1f2b2-ac4c-41eb-a912-4f506e8f0732 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jan 25 02:22:51.526716 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 89/175] 10.222.0.117 () {56 vars in 1125 bytes} [Tue Jan 25 02:22:51 2022] GET /identity/v3/roles/reader => generated 84 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:22:51.533817 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185e68ca-8bc9-44cc-99d8-fa477a751f22 None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:22:51.543768 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185e68ca-8bc9-44cc-99d8-fa477a751f22 None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:22:51.548190 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be750e3-b1bc-4edb-a4c2-c70dc2801082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:22:51.548869 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be750e3-b1bc-4edb-a4c2-c70dc2801082 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:51.549150 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be750e3-b1bc-4edb-a4c2-c70dc2801082 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:51.549422 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be750e3-b1bc-4edb-a4c2-c70dc2801082 admin admin] PATH_INFO: `/v3/roles` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:51.550203 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be750e3-b1bc-4edb-a4c2-c70dc2801082 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:22:51.550505 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be750e3-b1bc-4edb-a4c2-c70dc2801082 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:22:51.552162 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be750e3-b1bc-4edb-a4c2-c70dc2801082 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:22:51.563061 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 87/176] 10.222.0.117 () {56 vars in 1127 bytes} [Tue Jan 25 02:22:51 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:22:51.567927 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b1f2b2-ac4c-41eb-a912-4f506e8f0732 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:22:51.579459 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b1f2b2-ac4c-41eb-a912-4f506e8f0732 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:22:51.583663 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e65c006-206a-445d-a5b9-84887ef2b2a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:22:51.584552 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e65c006-206a-445d-a5b9-84887ef2b2a3 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:51.584831 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e65c006-206a-445d-a5b9-84887ef2b2a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:51.585104 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e65c006-206a-445d-a5b9-84887ef2b2a3 admin admin] PATH_INFO: `/v3/users/f64c5292e3bc416fbd8d88c0986c5688` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:51.586342 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e65c006-206a-445d-a5b9-84887ef2b2a3 admin admin] RBAC: Authorizing `identity:get_user(user_id=f64c5292e3bc416fbd8d88c0986c5688)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:22:51.588558 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e65c006-206a-445d-a5b9-84887ef2b2a3 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:22:51.591027 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 90/177] 10.222.0.117 () {56 vars in 1203 bytes} [Tue Jan 25 02:22:51 2022] GET /identity/v3/users/f64c5292e3bc416fbd8d88c0986c5688 => generated 290 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:22:51.597290 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be750e3-b1bc-4edb-a4c2-c70dc2801082 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:22:51.607342 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be750e3-b1bc-4edb-a4c2-c70dc2801082 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:22:51.611749 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a96487-f864-4251-8c78-d87013ccf109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:22:51.612862 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a96487-f864-4251-8c78-d87013ccf109 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:51.612987 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a96487-f864-4251-8c78-d87013ccf109 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:51.613156 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a96487-f864-4251-8c78-d87013ccf109 admin admin] PATH_INFO: `/v3/projects/26e358bfb5294c7f9855f86b5dbeedac` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:51.614366 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a96487-f864-4251-8c78-d87013ccf109 admin admin] RBAC: Authorizing `identity:get_project(project_id=26e358bfb5294c7f9855f86b5dbeedac)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:22:51.616473 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a96487-f864-4251-8c78-d87013ccf109 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:22:51.618140 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 88/178] 10.222.0.117 () {56 vars in 1212 bytes} [Tue Jan 25 02:22:51 2022] GET /identity/v3/projects/26e358bfb5294c7f9855f86b5dbeedac => generated 299 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:22:51.623960 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e65c006-206a-445d-a5b9-84887ef2b2a3 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:22:51.633601 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e65c006-206a-445d-a5b9-84887ef2b2a3 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:22:51.639023 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cd18e4-a7ce-4045-8978-4325435e9ffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:22:51.639924 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cd18e4-a7ce-4045-8978-4325435e9ffc admin admin] REQUEST_METHOD: `PUT` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:51.640205 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cd18e4-a7ce-4045-8978-4325435e9ffc admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:51.640481 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cd18e4-a7ce-4045-8978-4325435e9ffc admin admin] PATH_INFO: `/v3/projects/26e358bfb5294c7f9855f86b5dbeedac/users/f64c5292e3bc416fbd8d88c0986c5688/roles/3f17a45b07a243abb2d3005961a5d648` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:51.642432 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cd18e4-a7ce-4045-8978-4325435e9ffc admin admin] RBAC: Authorizing `identity:create_grant(project_id=26e358bfb5294c7f9855f86b5dbeedac, user_id=f64c5292e3bc416fbd8d88c0986c5688, role_id=3f17a45b07a243abb2d3005961a5d648)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:22:51.645151 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cd18e4-a7ce-4045-8978-4325435e9ffc admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:22:51.658521 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 91/179] 10.222.0.117 () {58 vars in 1465 bytes} [Tue Jan 25 02:22:51 2022] PUT /identity/v3/projects/26e358bfb5294c7f9855f86b5dbeedac/users/f64c5292e3bc416fbd8d88c0986c5688/roles/3f17a45b07a243abb2d3005961a5d648 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:22:53.817961 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bcaf84-faff-471c-ae77-d0328172057c None None] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:53.818484 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bcaf84-faff-471c-ae77-d0328172057c None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:53.818559 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bcaf84-faff-471c-ae77-d0328172057c None None] PATH_INFO: `/` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:53.820326 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 89/180] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:22:53 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:22:53.826279 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8e0055-21f0-4226-8f0b-b5e77276323d None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:53.826690 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8e0055-21f0-4226-8f0b-b5e77276323d None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:53.826853 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8e0055-21f0-4226-8f0b-b5e77276323d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:53.845968 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-2f8e0055-21f0-4226-8f0b-b5e77276323d None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:22:53.847169 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-2f8e0055-21f0-4226-8f0b-b5e77276323d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:22:53.907027 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 92/181] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:22:53 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 25 02:22:53.921254 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3f664d-056f-4f49-a0ab-800e986f1def None None] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:53.921544 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3f664d-056f-4f49-a0ab-800e986f1def None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:53.921826 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3f664d-056f-4f49-a0ab-800e986f1def None None] PATH_INFO: `/` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:53.923583 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 90/182] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:22:53 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:22:53.929137 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a267161-2c2d-4256-9e8d-cc22c4a3317b None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:53.929365 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a267161-2c2d-4256-9e8d-cc22c4a3317b None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:53.929642 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a267161-2c2d-4256-9e8d-cc22c4a3317b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:53.931516 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3f664d-056f-4f49-a0ab-800e986f1def None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:22:53.947391 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3f664d-056f-4f49-a0ab-800e986f1def None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:22:53.949106 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-0a267161-2c2d-4256-9e8d-cc22c4a3317b None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:22:53.950696 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-0a267161-2c2d-4256-9e8d-cc22c4a3317b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:22:53.952156 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177f290b-cd8c-4c3d-b12e-d645b7e995bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:22:53.953104 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177f290b-cd8c-4c3d-b12e-d645b7e995bb admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:53.953526 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177f290b-cd8c-4c3d-b12e-d645b7e995bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:53.953959 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177f290b-cd8c-4c3d-b12e-d645b7e995bb admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:53.958435 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 93/183] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:22:53 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 25 02:22:53.965775 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177f290b-cd8c-4c3d-b12e-d645b7e995bb admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 25 02:22:53.973175 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: WARNING keystone.server.flask.application [None req-177f290b-cd8c-4c3d-b12e-d645b7e995bb admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 25 02:22:53.974524 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 91/184] 10.222.0.117 () {56 vars in 1122 bytes} [Tue Jan 25 02:22:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 25 02:22:53.982244 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a267161-2c2d-4256-9e8d-cc22c4a3317b None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:22:53.991646 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177f290b-cd8c-4c3d-b12e-d645b7e995bb admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:22:53.993849 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a267161-2c2d-4256-9e8d-cc22c4a3317b None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:22:53.998976 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f62f3f-9af3-42bf-955a-d71ea09e6693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:22:53.999850 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f62f3f-9af3-42bf-955a-d71ea09e6693 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:54.000298 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f62f3f-9af3-42bf-955a-d71ea09e6693 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:54.000710 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f62f3f-9af3-42bf-955a-d71ea09e6693 admin admin] PATH_INFO: `/v3/roles` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:54.001620 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f62f3f-9af3-42bf-955a-d71ea09e6693 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:22:54.002067 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f62f3f-9af3-42bf-955a-d71ea09e6693 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:22:54.004737 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f62f3f-9af3-42bf-955a-d71ea09e6693 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:22:54.007237 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177f290b-cd8c-4c3d-b12e-d645b7e995bb admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:22:54.014676 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1307fd7-7829-4de5-afc4-ad1d0784aa9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:22:54.015481 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1307fd7-7829-4de5-afc4-ad1d0784aa9b admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:54.015783 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1307fd7-7829-4de5-afc4-ad1d0784aa9b admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:54.016060 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1307fd7-7829-4de5-afc4-ad1d0784aa9b admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:54.024336 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 94/185] 10.222.0.117 () {56 vars in 1125 bytes} [Tue Jan 25 02:22:53 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:22:54.025435 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab66816-bdb5-4bdd-9a59-5aab0afc50bc None None] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:54.025723 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab66816-bdb5-4bdd-9a59-5aab0afc50bc None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:54.026041 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab66816-bdb5-4bdd-9a59-5aab0afc50bc None None] PATH_INFO: `/` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:54.032252 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 95/186] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:22:54 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:22:54.032252 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab66816-bdb5-4bdd-9a59-5aab0afc50bc None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:22:54.035090 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1307fd7-7829-4de5-afc4-ad1d0784aa9b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 25 02:22:54.041773 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab66816-bdb5-4bdd-9a59-5aab0afc50bc None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:22:54.042053 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: WARNING keystone.server.flask.application [None req-d1307fd7-7829-4de5-afc4-ad1d0784aa9b admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jan 25 02:22:54.043979 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 92/187] 10.222.0.117 () {56 vars in 1125 bytes} [Tue Jan 25 02:22:53 2022] GET /identity/v3/roles/reader => generated 84 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:22:54.045351 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9eb8ba-a7ea-47d2-b110-2088b841ccf3 None None] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:54.045850 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9eb8ba-a7ea-47d2-b110-2088b841ccf3 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:54.046344 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9eb8ba-a7ea-47d2-b110-2088b841ccf3 None None] PATH_INFO: `/` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:54.048834 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9932da81-eb20-43bf-90be-2e27e3ceb984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:22:54.049623 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 93/188] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:22:54 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:22:54.049997 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9932da81-eb20-43bf-90be-2e27e3ceb984 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:54.050282 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9932da81-eb20-43bf-90be-2e27e3ceb984 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:54.050560 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9932da81-eb20-43bf-90be-2e27e3ceb984 admin admin] PATH_INFO: `/v3/users/389d3645cc1e4f20af168caff539224e` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:54.051774 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3ca0f0-5e81-4430-a0c7-01aea18a1d79 None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:54.052265 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3ca0f0-5e81-4430-a0c7-01aea18a1d79 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:54.052775 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3ca0f0-5e81-4430-a0c7-01aea18a1d79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:54.073037 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9932da81-eb20-43bf-90be-2e27e3ceb984 admin admin] RBAC: Authorizing `identity:get_user(user_id=389d3645cc1e4f20af168caff539224e)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:22:54.076079 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9932da81-eb20-43bf-90be-2e27e3ceb984 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:22:54.077849 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 96/189] 10.222.0.117 () {56 vars in 1203 bytes} [Tue Jan 25 02:22:54 2022] GET /identity/v3/users/389d3645cc1e4f20af168caff539224e => generated 284 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:22:54.078616 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9932da81-eb20-43bf-90be-2e27e3ceb984 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:22:54.084562 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-7f3ca0f0-5e81-4430-a0c7-01aea18a1d79 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:22:54.085757 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-7f3ca0f0-5e81-4430-a0c7-01aea18a1d79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:22:54.088485 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9932da81-eb20-43bf-90be-2e27e3ceb984 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:22:54.093834 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f09d804-d79a-4fbc-bfa3-ccfab5c374c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:22:54.098844 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 94/190] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:22:54 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 25 02:22:54.098988 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f09d804-d79a-4fbc-bfa3-ccfab5c374c0 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:54.098988 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f09d804-d79a-4fbc-bfa3-ccfab5c374c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:54.098988 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f09d804-d79a-4fbc-bfa3-ccfab5c374c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:54.098988 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f09d804-d79a-4fbc-bfa3-ccfab5c374c0 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:22:54.098988 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f09d804-d79a-4fbc-bfa3-ccfab5c374c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:22:54.099267 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6001cfb-6583-4681-90f1-e087faf87699 None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:54.099267 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6001cfb-6583-4681-90f1-e087faf87699 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:54.099267 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6001cfb-6583-4681-90f1-e087faf87699 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:54.099430 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f09d804-d79a-4fbc-bfa3-ccfab5c374c0 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:22:54.115047 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 97/191] 10.222.0.117 () {56 vars in 1127 bytes} [Tue Jan 25 02:22:54 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:22:54.116640 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f09d804-d79a-4fbc-bfa3-ccfab5c374c0 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:22:54.122282 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-b6001cfb-6583-4681-90f1-e087faf87699 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:22:54.123464 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-b6001cfb-6583-4681-90f1-e087faf87699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:22:54.126657 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f09d804-d79a-4fbc-bfa3-ccfab5c374c0 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:22:54.130819 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 95/192] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:22:54 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 25 02:22:54.131608 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6001cfb-6583-4681-90f1-e087faf87699 None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:22:54.131772 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32302d0f-1aea-494e-a8d0-4638faf17a14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:22:54.132361 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32302d0f-1aea-494e-a8d0-4638faf17a14 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:54.132651 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32302d0f-1aea-494e-a8d0-4638faf17a14 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:54.133021 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32302d0f-1aea-494e-a8d0-4638faf17a14 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:54.141022 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32302d0f-1aea-494e-a8d0-4638faf17a14 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:22:54.141150 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6001cfb-6583-4681-90f1-e087faf87699 None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:22:54.142804 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32302d0f-1aea-494e-a8d0-4638faf17a14 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:22:54.145348 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb8a470-522b-4f6f-980f-b0fb64432158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:22:54.146127 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb8a470-522b-4f6f-980f-b0fb64432158 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:54.146405 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb8a470-522b-4f6f-980f-b0fb64432158 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:54.146677 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb8a470-522b-4f6f-980f-b0fb64432158 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:54.151628 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 98/193] 10.222.0.117 () {58 vars in 1329 bytes} [Tue Jan 25 02:22:54 2022] GET /identity/v3/auth/tokens => generated 915 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 25 02:22:54.156820 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32302d0f-1aea-494e-a8d0-4638faf17a14 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:22:54.161892 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb8a470-522b-4f6f-980f-b0fb64432158 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 25 02:22:54.162577 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32302d0f-1aea-494e-a8d0-4638faf17a14 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:22:54.166837 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7738ea5d-27bf-4e88-b7e2-6a1d4d951e75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:22:54.167672 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7738ea5d-27bf-4e88-b7e2-6a1d4d951e75 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:54.167996 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7738ea5d-27bf-4e88-b7e2-6a1d4d951e75 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:54.168912 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7738ea5d-27bf-4e88-b7e2-6a1d4d951e75 admin admin] PATH_INFO: `/v3/users/f64c5292e3bc416fbd8d88c0986c5688` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:54.170046 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7738ea5d-27bf-4e88-b7e2-6a1d4d951e75 admin admin] RBAC: Authorizing `identity:get_user(user_id=f64c5292e3bc416fbd8d88c0986c5688)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:22:54.170201 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: WARNING keystone.server.flask.application [None req-7eb8a470-522b-4f6f-980f-b0fb64432158 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jan 25 02:22:54.171392 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 96/194] 10.222.0.117 () {56 vars in 1140 bytes} [Tue Jan 25 02:22:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:22:54.171392 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb8a470-522b-4f6f-980f-b0fb64432158 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:22:54.172637 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7738ea5d-27bf-4e88-b7e2-6a1d4d951e75 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:22:54.173955 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 99/195] 10.222.0.117 () {56 vars in 1203 bytes} [Tue Jan 25 02:22:54 2022] GET /identity/v3/users/f64c5292e3bc416fbd8d88c0986c5688 => generated 290 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:22:54.175819 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7738ea5d-27bf-4e88-b7e2-6a1d4d951e75 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:22:54.185495 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7738ea5d-27bf-4e88-b7e2-6a1d4d951e75 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:22:54.185714 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb8a470-522b-4f6f-980f-b0fb64432158 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:22:54.189759 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2fc104-19de-421b-ad2d-18d08e46d427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:22:54.189974 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a864bb5-391d-44cb-850e-5d3d51bb96d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:22:54.190560 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2fc104-19de-421b-ad2d-18d08e46d427 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:54.190704 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a864bb5-391d-44cb-850e-5d3d51bb96d7 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:54.190845 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2fc104-19de-421b-ad2d-18d08e46d427 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:54.190984 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a864bb5-391d-44cb-850e-5d3d51bb96d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:54.191123 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2fc104-19de-421b-ad2d-18d08e46d427 admin admin] PATH_INFO: `/v3/projects/711fe35d158f4285974b4184777b46ac` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:54.191255 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a864bb5-391d-44cb-850e-5d3d51bb96d7 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:54.192318 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2fc104-19de-421b-ad2d-18d08e46d427 admin admin] RBAC: Authorizing `identity:get_project(project_id=711fe35d158f4285974b4184777b46ac)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:22:54.192414 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a864bb5-391d-44cb-850e-5d3d51bb96d7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:22:54.194064 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a864bb5-391d-44cb-850e-5d3d51bb96d7 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:22:54.194344 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2fc104-19de-421b-ad2d-18d08e46d427 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:22:54.195591 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 97/196] 10.222.0.117 () {56 vars in 1134 bytes} [Tue Jan 25 02:22:54 2022] GET /identity/v3/domains/default => generated 200 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:22:54.200831 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 100/197] 10.222.0.117 () {56 vars in 1212 bytes} [Tue Jan 25 02:22:54 2022] GET /identity/v3/projects/711fe35d158f4285974b4184777b46ac => generated 303 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:22:54.200955 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a864bb5-391d-44cb-850e-5d3d51bb96d7 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:22:54.201040 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2fc104-19de-421b-ad2d-18d08e46d427 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:22:54.206364 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2fc104-19de-421b-ad2d-18d08e46d427 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:22:54.210250 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a864bb5-391d-44cb-850e-5d3d51bb96d7 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:22:54.210617 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c860355-4129-4401-a635-02af738d175b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:22:54.211221 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c860355-4129-4401-a635-02af738d175b admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:54.211504 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c860355-4129-4401-a635-02af738d175b admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:54.211817 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c860355-4129-4401-a635-02af738d175b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:54.214550 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f455ee-6c39-4d15-a5a3-25a6baacb8f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:22:54.215830 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f455ee-6c39-4d15-a5a3-25a6baacb8f5 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:54.216297 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f455ee-6c39-4d15-a5a3-25a6baacb8f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:54.216297 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f455ee-6c39-4d15-a5a3-25a6baacb8f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:54.216995 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f455ee-6c39-4d15-a5a3-25a6baacb8f5 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:22:54.217295 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f455ee-6c39-4d15-a5a3-25a6baacb8f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:22:54.218958 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f455ee-6c39-4d15-a5a3-25a6baacb8f5 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:22:54.220235 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c860355-4129-4401-a635-02af738d175b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:22:54.222210 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c860355-4129-4401-a635-02af738d175b admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:22:54.227081 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 98/198] 10.222.0.117 () {56 vars in 1137 bytes} [Tue Jan 25 02:22:54 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:22:54.227857 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f455ee-6c39-4d15-a5a3-25a6baacb8f5 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:22:54.234876 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 101/199] 10.222.0.117 () {58 vars in 1329 bytes} [Tue Jan 25 02:22:54 2022] GET /identity/v3/auth/tokens => generated 915 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 25 02:22:54.236667 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c860355-4129-4401-a635-02af738d175b admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:22:54.237578 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f455ee-6c39-4d15-a5a3-25a6baacb8f5 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:22:54.242123 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022261c9-cafe-4003-ba20-d6b71b745195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:22:54.242752 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022261c9-cafe-4003-ba20-d6b71b745195 admin admin] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:54.243034 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022261c9-cafe-4003-ba20-d6b71b745195 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:54.243307 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022261c9-cafe-4003-ba20-d6b71b745195 admin admin] PATH_INFO: `/v3/users` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:54.244048 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022261c9-cafe-4003-ba20-d6b71b745195 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:22:54.245072 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: WARNING py.warnings [None req-022261c9-cafe-4003-ba20-d6b71b745195 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 25 02:22:54.245072 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: warnings.warn(msg) Jan 25 02:22:54.245072 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: Jan 25 02:22:54.245647 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c860355-4129-4401-a635-02af738d175b admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:22:54.246760 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022261c9-cafe-4003-ba20-d6b71b745195 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:22:54.250822 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc1ff6a-4fad-451d-b51f-7fc5ff0716ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:22:54.251434 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc1ff6a-4fad-451d-b51f-7fc5ff0716ba admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:54.251736 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc1ff6a-4fad-451d-b51f-7fc5ff0716ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:54.252016 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc1ff6a-4fad-451d-b51f-7fc5ff0716ba admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:54.252857 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc1ff6a-4fad-451d-b51f-7fc5ff0716ba admin admin] RBAC: Adding query filter params (role.id=d8dbc6d83d9d41d28c3feb8b3485b291, scope.project.id=711fe35d158f4285974b4184777b46ac, user.id=389d3645cc1e4f20af168caff539224e) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:22:54.253167 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc1ff6a-4fad-451d-b51f-7fc5ff0716ba admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:22:54.254989 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc1ff6a-4fad-451d-b51f-7fc5ff0716ba admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:22:54.260864 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 102/200] 10.222.0.117 () {56 vars in 1400 bytes} [Tue Jan 25 02:22:54 2022] GET /identity/v3/role_assignments?user.id=389d3645cc1e4f20af168caff539224e&scope.project.id=711fe35d158f4285974b4184777b46ac&role.id=d8dbc6d83d9d41d28c3feb8b3485b291 => generated 260 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:22:54.261718 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc1ff6a-4fad-451d-b51f-7fc5ff0716ba admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:22:54.273688 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc1ff6a-4fad-451d-b51f-7fc5ff0716ba admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:22:54.273932 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 99/201] 10.222.0.117 () {60 vars in 1158 bytes} [Tue Jan 25 02:22:54 2022] POST /identity/v3/users => generated 298 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 02:22:54.279955 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f7d607-a596-445f-933c-525455430267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:22:54.280876 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022261c9-cafe-4003-ba20-d6b71b745195 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:22:54.281590 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f7d607-a596-445f-933c-525455430267 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:54.282111 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f7d607-a596-445f-933c-525455430267 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:54.282598 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f7d607-a596-445f-933c-525455430267 admin admin] PATH_INFO: `/v3/users/389d3645cc1e4f20af168caff539224e` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:54.284297 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f7d607-a596-445f-933c-525455430267 admin admin] RBAC: Authorizing `identity:get_user(user_id=389d3645cc1e4f20af168caff539224e)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:22:54.287214 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f7d607-a596-445f-933c-525455430267 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:22:54.290578 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 103/202] 10.222.0.117 () {56 vars in 1203 bytes} [Tue Jan 25 02:22:54 2022] GET /identity/v3/users/389d3645cc1e4f20af168caff539224e => generated 284 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:22:54.292663 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022261c9-cafe-4003-ba20-d6b71b745195 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:22:54.297269 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f7d607-a596-445f-933c-525455430267 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:22:54.299422 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653139eb-8b27-4b37-9cd5-265e647dd188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:22:54.300392 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653139eb-8b27-4b37-9cd5-265e647dd188 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:54.300672 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653139eb-8b27-4b37-9cd5-265e647dd188 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:54.300998 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653139eb-8b27-4b37-9cd5-265e647dd188 admin admin] PATH_INFO: `/v3/projects/26e358bfb5294c7f9855f86b5dbeedac` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:54.302453 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653139eb-8b27-4b37-9cd5-265e647dd188 admin admin] RBAC: Authorizing `identity:get_project(project_id=26e358bfb5294c7f9855f86b5dbeedac)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:22:54.304765 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653139eb-8b27-4b37-9cd5-265e647dd188 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:22:54.307644 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 100/203] 10.222.0.117 () {56 vars in 1212 bytes} [Tue Jan 25 02:22:54 2022] GET /identity/v3/projects/26e358bfb5294c7f9855f86b5dbeedac => generated 299 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:22:54.315435 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f7d607-a596-445f-933c-525455430267 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:22:54.317194 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653139eb-8b27-4b37-9cd5-265e647dd188 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:22:54.320780 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d25bb70-289e-40df-b3b1-4a9027e5a589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:22:54.321521 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d25bb70-289e-40df-b3b1-4a9027e5a589 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:54.321851 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d25bb70-289e-40df-b3b1-4a9027e5a589 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:54.322128 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d25bb70-289e-40df-b3b1-4a9027e5a589 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:54.332917 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653139eb-8b27-4b37-9cd5-265e647dd188 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:22:54.333125 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d25bb70-289e-40df-b3b1-4a9027e5a589 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:22:54.334977 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d25bb70-289e-40df-b3b1-4a9027e5a589 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:22:54.338914 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280f0423-a7aa-42e7-b08d-8e7d6611bcc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:22:54.340028 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280f0423-a7aa-42e7-b08d-8e7d6611bcc8 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:54.341198 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280f0423-a7aa-42e7-b08d-8e7d6611bcc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:54.341802 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280f0423-a7aa-42e7-b08d-8e7d6611bcc8 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:54.343117 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280f0423-a7aa-42e7-b08d-8e7d6611bcc8 admin admin] RBAC: Adding query filter params (role.id=3f17a45b07a243abb2d3005961a5d648, scope.project.id=26e358bfb5294c7f9855f86b5dbeedac, user.id=f64c5292e3bc416fbd8d88c0986c5688) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:22:54.343711 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280f0423-a7aa-42e7-b08d-8e7d6611bcc8 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:22:54.346204 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280f0423-a7aa-42e7-b08d-8e7d6611bcc8 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:22:54.348233 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 104/204] 10.222.0.117 () {58 vars in 1329 bytes} [Tue Jan 25 02:22:54 2022] GET /identity/v3/auth/tokens => generated 915 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 25 02:22:54.355025 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 101/205] 10.222.0.117 () {56 vars in 1400 bytes} [Tue Jan 25 02:22:54 2022] GET /identity/v3/role_assignments?user.id=f64c5292e3bc416fbd8d88c0986c5688&scope.project.id=26e358bfb5294c7f9855f86b5dbeedac&role.id=3f17a45b07a243abb2d3005961a5d648 => generated 610 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 02:22:54.359749 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d25bb70-289e-40df-b3b1-4a9027e5a589 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:22:54.369737 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d25bb70-289e-40df-b3b1-4a9027e5a589 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:22:54.375258 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aae66f6-e869-4ca7-97bd-3abcc3cd6e07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:22:54.376481 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aae66f6-e869-4ca7-97bd-3abcc3cd6e07 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:54.376879 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aae66f6-e869-4ca7-97bd-3abcc3cd6e07 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:54.377285 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aae66f6-e869-4ca7-97bd-3abcc3cd6e07 admin admin] PATH_INFO: `/v3/projects/711fe35d158f4285974b4184777b46ac` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:54.379105 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aae66f6-e869-4ca7-97bd-3abcc3cd6e07 admin admin] RBAC: Authorizing `identity:get_project(project_id=711fe35d158f4285974b4184777b46ac)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:22:54.381435 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aae66f6-e869-4ca7-97bd-3abcc3cd6e07 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:22:54.383887 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 105/206] 10.222.0.117 () {56 vars in 1212 bytes} [Tue Jan 25 02:22:54 2022] GET /identity/v3/projects/711fe35d158f4285974b4184777b46ac => generated 303 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:22:54.391050 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280f0423-a7aa-42e7-b08d-8e7d6611bcc8 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:22:54.401921 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280f0423-a7aa-42e7-b08d-8e7d6611bcc8 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:22:54.408480 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5711f8-a763-44c4-875c-93b70b340084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:22:54.409207 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5711f8-a763-44c4-875c-93b70b340084 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:54.409493 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5711f8-a763-44c4-875c-93b70b340084 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:54.409766 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5711f8-a763-44c4-875c-93b70b340084 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:54.410700 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5711f8-a763-44c4-875c-93b70b340084 admin admin] RBAC: Adding query filter params (role.id=259d005f63d5455d8728277d6385bfba, scope.project.id=711fe35d158f4285974b4184777b46ac, user.id=389d3645cc1e4f20af168caff539224e) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:22:54.411016 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5711f8-a763-44c4-875c-93b70b340084 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:22:54.413172 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5711f8-a763-44c4-875c-93b70b340084 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:22:54.420797 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 102/207] 10.222.0.117 () {56 vars in 1400 bytes} [Tue Jan 25 02:22:54 2022] GET /identity/v3/role_assignments?user.id=389d3645cc1e4f20af168caff539224e&scope.project.id=711fe35d158f4285974b4184777b46ac&role.id=259d005f63d5455d8728277d6385bfba => generated 260 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:22:56.619926 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c3d585-4652-4b88-8ec1-d97ee7b6d02d None None] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:56.620465 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c3d585-4652-4b88-8ec1-d97ee7b6d02d None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:56.620465 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c3d585-4652-4b88-8ec1-d97ee7b6d02d None None] PATH_INFO: `/` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:56.623589 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 106/208] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:22:56 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:22:56.629316 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b7c58e-b581-42b8-99da-ef219b3e0534 None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:56.629760 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b7c58e-b581-42b8-99da-ef219b3e0534 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:56.629964 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b7c58e-b581-42b8-99da-ef219b3e0534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:56.648004 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-13b7c58e-b581-42b8-99da-ef219b3e0534 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:22:56.649203 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-13b7c58e-b581-42b8-99da-ef219b3e0534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:22:56.656906 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 103/209] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:22:56 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 25 02:22:56.680443 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c3d585-4652-4b88-8ec1-d97ee7b6d02d None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:22:56.693412 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c3d585-4652-4b88-8ec1-d97ee7b6d02d None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:22:56.697955 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9530565-37ee-4fed-9e03-e064164691d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:22:56.698748 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9530565-37ee-4fed-9e03-e064164691d3 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:56.699030 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9530565-37ee-4fed-9e03-e064164691d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:56.699381 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9530565-37ee-4fed-9e03-e064164691d3 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:56.711093 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9530565-37ee-4fed-9e03-e064164691d3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 25 02:22:56.718404 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: WARNING keystone.server.flask.application [None req-d9530565-37ee-4fed-9e03-e064164691d3 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 25 02:22:56.719621 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 107/210] 10.222.0.117 () {56 vars in 1122 bytes} [Tue Jan 25 02:22:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:22:56.725653 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b7c58e-b581-42b8-99da-ef219b3e0534 None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:22:56.735787 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b7c58e-b581-42b8-99da-ef219b3e0534 None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:22:56.740770 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43530bfc-5049-49b8-8e32-a8ead500fcfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:22:56.741437 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43530bfc-5049-49b8-8e32-a8ead500fcfe admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:56.741720 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43530bfc-5049-49b8-8e32-a8ead500fcfe admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:56.741998 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43530bfc-5049-49b8-8e32-a8ead500fcfe admin admin] PATH_INFO: `/v3/roles` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:56.742778 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43530bfc-5049-49b8-8e32-a8ead500fcfe admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:22:56.743086 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43530bfc-5049-49b8-8e32-a8ead500fcfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:22:56.744743 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43530bfc-5049-49b8-8e32-a8ead500fcfe admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:22:56.754111 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 104/211] 10.222.0.117 () {56 vars in 1125 bytes} [Tue Jan 25 02:22:56 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:22:56.759546 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9530565-37ee-4fed-9e03-e064164691d3 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:22:56.762962 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0079d2-1fee-4122-9ae3-3e9b67490e06 None None] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:56.763258 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0079d2-1fee-4122-9ae3-3e9b67490e06 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:56.763515 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0079d2-1fee-4122-9ae3-3e9b67490e06 None None] PATH_INFO: `/` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:56.765516 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 105/212] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:22:56 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:22:56.770428 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9530565-37ee-4fed-9e03-e064164691d3 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:22:56.771476 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7a9a32-4ed4-4d0e-a715-2ff26ba0a774 None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:56.771787 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7a9a32-4ed4-4d0e-a715-2ff26ba0a774 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:56.772067 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7a9a32-4ed4-4d0e-a715-2ff26ba0a774 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:56.775152 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce726078-ea7a-4249-9aeb-8ebe4fbccbb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:22:56.776144 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce726078-ea7a-4249-9aeb-8ebe4fbccbb4 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:56.776872 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce726078-ea7a-4249-9aeb-8ebe4fbccbb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:56.777221 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce726078-ea7a-4249-9aeb-8ebe4fbccbb4 admin admin] PATH_INFO: `/v3/users/389d3645cc1e4f20af168caff539224e` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:56.779096 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce726078-ea7a-4249-9aeb-8ebe4fbccbb4 admin admin] RBAC: Authorizing `identity:get_user(user_id=389d3645cc1e4f20af168caff539224e)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:22:56.781339 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce726078-ea7a-4249-9aeb-8ebe4fbccbb4 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:22:56.783103 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 108/213] 10.222.0.117 () {56 vars in 1203 bytes} [Tue Jan 25 02:22:56 2022] GET /identity/v3/users/389d3645cc1e4f20af168caff539224e => generated 284 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:22:56.784212 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b76e903-955a-4239-890a-5cde3caaaade None None] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:56.784575 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b76e903-955a-4239-890a-5cde3caaaade None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:56.784855 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b76e903-955a-4239-890a-5cde3caaaade None None] PATH_INFO: `/` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:56.786616 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 109/214] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:22:56 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:22:56.790712 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b76e903-955a-4239-890a-5cde3caaaade None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:22:56.790925 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-5b7a9a32-4ed4-4d0e-a715-2ff26ba0a774 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:22:56.792150 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-5b7a9a32-4ed4-4d0e-a715-2ff26ba0a774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:22:56.801590 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 106/215] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:22:56 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 25 02:22:56.802915 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b76e903-955a-4239-890a-5cde3caaaade None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:22:56.803606 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7985e375-df45-4030-adfa-039490fc2d4f None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:56.804290 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7985e375-df45-4030-adfa-039490fc2d4f None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:56.804879 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7985e375-df45-4030-adfa-039490fc2d4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:56.807309 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f57f905-2c98-4f5e-a1c2-f63b108a267a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:22:56.808277 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f57f905-2c98-4f5e-a1c2-f63b108a267a admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:56.808567 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f57f905-2c98-4f5e-a1c2-f63b108a267a admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:56.808900 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f57f905-2c98-4f5e-a1c2-f63b108a267a admin admin] PATH_INFO: `/v3/projects/711fe35d158f4285974b4184777b46ac` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:56.810293 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f57f905-2c98-4f5e-a1c2-f63b108a267a admin admin] RBAC: Authorizing `identity:get_project(project_id=711fe35d158f4285974b4184777b46ac)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:22:56.812377 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f57f905-2c98-4f5e-a1c2-f63b108a267a admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:22:56.815411 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 110/216] 10.222.0.117 () {56 vars in 1212 bytes} [Tue Jan 25 02:22:56 2022] GET /identity/v3/projects/711fe35d158f4285974b4184777b46ac => generated 303 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:22:56.820816 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f57f905-2c98-4f5e-a1c2-f63b108a267a admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:22:56.827015 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-7985e375-df45-4030-adfa-039490fc2d4f None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:22:56.828275 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-7985e375-df45-4030-adfa-039490fc2d4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:22:56.831584 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f57f905-2c98-4f5e-a1c2-f63b108a267a admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:22:56.835907 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914eb0a0-9999-430b-a141-b0f474163ca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:22:56.836334 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 107/217] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:22:56 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 25 02:22:56.836781 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914eb0a0-9999-430b-a141-b0f474163ca1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:56.837061 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914eb0a0-9999-430b-a141-b0f474163ca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:56.837392 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914eb0a0-9999-430b-a141-b0f474163ca1 admin admin] PATH_INFO: `/v3/projects/711fe35d158f4285974b4184777b46ac/users/389d3645cc1e4f20af168caff539224e/roles/d8dbc6d83d9d41d28c3feb8b3485b291` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:56.839336 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914eb0a0-9999-430b-a141-b0f474163ca1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=711fe35d158f4285974b4184777b46ac, user_id=389d3645cc1e4f20af168caff539224e, role_id=d8dbc6d83d9d41d28c3feb8b3485b291)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:22:56.842551 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914eb0a0-9999-430b-a141-b0f474163ca1 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:22:56.843566 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7985e375-df45-4030-adfa-039490fc2d4f None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:22:56.854849 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7985e375-df45-4030-adfa-039490fc2d4f None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:22:56.858465 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 111/218] 10.222.0.117 () {58 vars in 1465 bytes} [Tue Jan 25 02:22:56 2022] PUT /identity/v3/projects/711fe35d158f4285974b4184777b46ac/users/389d3645cc1e4f20af168caff539224e/roles/d8dbc6d83d9d41d28c3feb8b3485b291 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:22:56.863981 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914eb0a0-9999-430b-a141-b0f474163ca1 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:22:56.931838 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914eb0a0-9999-430b-a141-b0f474163ca1 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:22:56.935537 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ca8953-5bd1-4c7d-af9a-84a5a447e072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:22:56.936381 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ca8953-5bd1-4c7d-af9a-84a5a447e072 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:56.936665 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ca8953-5bd1-4c7d-af9a-84a5a447e072 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:56.936929 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f008202b-2ab7-4c25-9ea5-3c34312b9a6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:22:56.937038 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ca8953-5bd1-4c7d-af9a-84a5a447e072 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:56.937743 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f008202b-2ab7-4c25-9ea5-3c34312b9a6a admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:56.938022 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f008202b-2ab7-4c25-9ea5-3c34312b9a6a admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:56.938293 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f008202b-2ab7-4c25-9ea5-3c34312b9a6a admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:56.948770 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ca8953-5bd1-4c7d-af9a-84a5a447e072 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 25 02:22:56.950276 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f008202b-2ab7-4c25-9ea5-3c34312b9a6a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 25 02:22:56.956808 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: WARNING keystone.server.flask.application [None req-14ca8953-5bd1-4c7d-af9a-84a5a447e072 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 25 02:22:56.958290 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: WARNING keystone.server.flask.application [None req-f008202b-2ab7-4c25-9ea5-3c34312b9a6a admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jan 25 02:22:56.958402 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 108/219] 10.222.0.117 () {56 vars in 1125 bytes} [Tue Jan 25 02:22:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 121 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:22:56.959731 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 112/220] 10.222.0.117 () {56 vars in 1140 bytes} [Tue Jan 25 02:22:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 98 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:22:56.963917 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f008202b-2ab7-4c25-9ea5-3c34312b9a6a admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:22:56.966176 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8bb67f-6612-4375-8d6d-1c55420e6c44 None None] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:56.966469 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8bb67f-6612-4375-8d6d-1c55420e6c44 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:56.966746 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8bb67f-6612-4375-8d6d-1c55420e6c44 None None] PATH_INFO: `/` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:56.973151 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 109/221] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:22:56 2022] GET /identity => generated 271 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:22:56.973151 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8bb67f-6612-4375-8d6d-1c55420e6c44 None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:22:56.975199 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f008202b-2ab7-4c25-9ea5-3c34312b9a6a admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:22:56.979647 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75f702c-5eaa-4ae0-a6fa-a53ad136f32c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:22:56.980465 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75f702c-5eaa-4ae0-a6fa-a53ad136f32c admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:56.981295 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75f702c-5eaa-4ae0-a6fa-a53ad136f32c admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:56.981685 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75f702c-5eaa-4ae0-a6fa-a53ad136f32c admin admin] PATH_INFO: `/v3/roles` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:56.982476 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75f702c-5eaa-4ae0-a6fa-a53ad136f32c admin admin] RBAC: Adding query filter params (name=member) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:22:56.982788 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75f702c-5eaa-4ae0-a6fa-a53ad136f32c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:22:56.984046 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8bb67f-6612-4375-8d6d-1c55420e6c44 None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:22:56.984464 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75f702c-5eaa-4ae0-a6fa-a53ad136f32c admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:22:56.988830 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00407a8-e2c5-41c1-841f-745b5639c26e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:22:56.989507 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00407a8-e2c5-41c1-841f-745b5639c26e admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:56.989792 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00407a8-e2c5-41c1-841f-745b5639c26e admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:56.990066 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00407a8-e2c5-41c1-841f-745b5639c26e admin admin] PATH_INFO: `/v3/roles` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:56.990861 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00407a8-e2c5-41c1-841f-745b5639c26e admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:22:56.991170 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00407a8-e2c5-41c1-841f-745b5639c26e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:22:56.992892 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00407a8-e2c5-41c1-841f-745b5639c26e admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:22:56.994528 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 113/222] 10.222.0.117 () {56 vars in 1127 bytes} [Tue Jan 25 02:22:56 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 02:22:57.000629 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1101d35a-dcc6-4d37-9a0a-831f74cb79a4 None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:57.000629 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1101d35a-dcc6-4d37-9a0a-831f74cb79a4 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:57.000629 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1101d35a-dcc6-4d37-9a0a-831f74cb79a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:57.008739 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 110/223] 10.222.0.117 () {56 vars in 1137 bytes} [Tue Jan 25 02:22:56 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:22:57.009449 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00407a8-e2c5-41c1-841f-745b5639c26e admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:22:57.020277 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00407a8-e2c5-41c1-841f-745b5639c26e admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:22:57.023055 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-1101d35a-dcc6-4d37-9a0a-831f74cb79a4 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:22:57.024300 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-1101d35a-dcc6-4d37-9a0a-831f74cb79a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:22:57.024698 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095294bf-61d2-48bc-86ab-c02bd2d9b708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:22:57.025569 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095294bf-61d2-48bc-86ab-c02bd2d9b708 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:57.025851 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095294bf-61d2-48bc-86ab-c02bd2d9b708 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:57.026128 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095294bf-61d2-48bc-86ab-c02bd2d9b708 admin admin] PATH_INFO: `/v3/users/f2385373f2ed470596d9876b614f4df6` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:57.033467 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 114/224] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:22:56 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 25 02:22:57.034115 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1101d35a-dcc6-4d37-9a0a-831f74cb79a4 None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:22:57.043803 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1101d35a-dcc6-4d37-9a0a-831f74cb79a4 None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:22:57.048569 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095294bf-61d2-48bc-86ab-c02bd2d9b708 admin admin] RBAC: Authorizing `identity:get_user(user_id=f2385373f2ed470596d9876b614f4df6)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:22:57.049215 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a845dc-d4a6-4bdb-814a-ccfcfbad3653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:22:57.050658 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a845dc-d4a6-4bdb-814a-ccfcfbad3653 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:57.051134 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a845dc-d4a6-4bdb-814a-ccfcfbad3653 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:57.051597 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a845dc-d4a6-4bdb-814a-ccfcfbad3653 admin admin] PATH_INFO: `/v3/users/389d3645cc1e4f20af168caff539224e` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:57.052174 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095294bf-61d2-48bc-86ab-c02bd2d9b708 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:22:57.053075 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a845dc-d4a6-4bdb-814a-ccfcfbad3653 admin admin] RBAC: Authorizing `identity:get_user(user_id=389d3645cc1e4f20af168caff539224e)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:22:57.054555 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 111/225] 10.222.0.117 () {56 vars in 1203 bytes} [Tue Jan 25 02:22:57 2022] GET /identity/v3/users/f2385373f2ed470596d9876b614f4df6 => generated 298 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:22:57.057953 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a845dc-d4a6-4bdb-814a-ccfcfbad3653 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:22:57.058310 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 115/226] 10.222.0.117 () {56 vars in 1203 bytes} [Tue Jan 25 02:22:57 2022] GET /identity/v3/users/389d3645cc1e4f20af168caff539224e => generated 284 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:22:57.064798 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095294bf-61d2-48bc-86ab-c02bd2d9b708 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:22:57.065515 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a845dc-d4a6-4bdb-814a-ccfcfbad3653 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:22:57.076178 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095294bf-61d2-48bc-86ab-c02bd2d9b708 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:22:57.076342 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a845dc-d4a6-4bdb-814a-ccfcfbad3653 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:22:57.080466 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776291f9-61c1-4734-a8e3-b4c2177fac40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:22:57.080656 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091473ed-e8e8-4d77-9dbc-b56fbf603070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:22:57.081262 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776291f9-61c1-4734-a8e3-b4c2177fac40 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:57.081452 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091473ed-e8e8-4d77-9dbc-b56fbf603070 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:57.081542 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776291f9-61c1-4734-a8e3-b4c2177fac40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:57.081723 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091473ed-e8e8-4d77-9dbc-b56fbf603070 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:57.081813 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776291f9-61c1-4734-a8e3-b4c2177fac40 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:57.081995 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091473ed-e8e8-4d77-9dbc-b56fbf603070 admin admin] PATH_INFO: `/v3/projects/711fe35d158f4285974b4184777b46ac` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:57.082968 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776291f9-61c1-4734-a8e3-b4c2177fac40 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:22:57.083174 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091473ed-e8e8-4d77-9dbc-b56fbf603070 admin admin] RBAC: Authorizing `identity:get_project(project_id=711fe35d158f4285974b4184777b46ac)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:22:57.084701 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776291f9-61c1-4734-a8e3-b4c2177fac40 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:22:57.085246 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091473ed-e8e8-4d77-9dbc-b56fbf603070 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:22:57.086538 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 112/227] 10.222.0.117 () {56 vars in 1134 bytes} [Tue Jan 25 02:22:57 2022] GET /identity/v3/domains/default => generated 200 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:22:57.087020 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 116/228] 10.222.0.117 () {56 vars in 1212 bytes} [Tue Jan 25 02:22:57 2022] GET /identity/v3/projects/711fe35d158f4285974b4184777b46ac => generated 303 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 02:22:57.087114 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776291f9-61c1-4734-a8e3-b4c2177fac40 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:22:57.093960 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091473ed-e8e8-4d77-9dbc-b56fbf603070 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:22:57.106415 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091473ed-e8e8-4d77-9dbc-b56fbf603070 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:22:57.106684 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776291f9-61c1-4734-a8e3-b4c2177fac40 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:22:57.111041 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b0854b-7a56-4de5-81f4-45481162b99b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:22:57.111185 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee2faf3-de22-4293-92f6-3578d395485b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:22:57.111803 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee2faf3-de22-4293-92f6-3578d395485b admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:57.111967 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b0854b-7a56-4de5-81f4-45481162b99b admin admin] REQUEST_METHOD: `PUT` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:57.112116 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee2faf3-de22-4293-92f6-3578d395485b admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:57.112365 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee2faf3-de22-4293-92f6-3578d395485b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:57.112472 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b0854b-7a56-4de5-81f4-45481162b99b admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:57.112650 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b0854b-7a56-4de5-81f4-45481162b99b admin admin] PATH_INFO: `/v3/projects/711fe35d158f4285974b4184777b46ac/users/389d3645cc1e4f20af168caff539224e/roles/259d005f63d5455d8728277d6385bfba` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:57.114793 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b0854b-7a56-4de5-81f4-45481162b99b admin admin] RBAC: Authorizing `identity:create_grant(project_id=711fe35d158f4285974b4184777b46ac, user_id=389d3645cc1e4f20af168caff539224e, role_id=259d005f63d5455d8728277d6385bfba)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:22:57.117460 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b0854b-7a56-4de5-81f4-45481162b99b admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:22:57.120549 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee2faf3-de22-4293-92f6-3578d395485b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:22:57.123210 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee2faf3-de22-4293-92f6-3578d395485b admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:22:57.139845 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 117/229] 10.222.0.117 () {58 vars in 1465 bytes} [Tue Jan 25 02:22:57 2022] PUT /identity/v3/projects/711fe35d158f4285974b4184777b46ac/users/389d3645cc1e4f20af168caff539224e/roles/259d005f63d5455d8728277d6385bfba => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 25 02:22:57.139845 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b0854b-7a56-4de5-81f4-45481162b99b admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:22:57.140089 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 113/230] 10.222.0.117 () {58 vars in 1329 bytes} [Tue Jan 25 02:22:57 2022] GET /identity/v3/auth/tokens => generated 915 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 25 02:22:57.140089 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee2faf3-de22-4293-92f6-3578d395485b admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:22:57.148272 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee2faf3-de22-4293-92f6-3578d395485b admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:22:57.214636 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee123dec-7a18-4c53-96c1-042d466b5f23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:22:57.216122 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee123dec-7a18-4c53-96c1-042d466b5f23 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:57.216631 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee123dec-7a18-4c53-96c1-042d466b5f23 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:57.216911 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee123dec-7a18-4c53-96c1-042d466b5f23 admin admin] PATH_INFO: `/v3/projects/711fe35d158f4285974b4184777b46ac` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:57.218180 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee123dec-7a18-4c53-96c1-042d466b5f23 admin admin] RBAC: Authorizing `identity:get_project(project_id=711fe35d158f4285974b4184777b46ac)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:22:57.219595 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b0854b-7a56-4de5-81f4-45481162b99b admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:22:57.220844 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee123dec-7a18-4c53-96c1-042d466b5f23 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:22:57.222671 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 114/231] 10.222.0.117 () {56 vars in 1212 bytes} [Tue Jan 25 02:22:57 2022] GET /identity/v3/projects/711fe35d158f4285974b4184777b46ac => generated 303 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 02:22:57.228664 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee123dec-7a18-4c53-96c1-042d466b5f23 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:22:57.230094 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785d483d-2ee3-42ff-b055-3cb07bc28e08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:22:57.231430 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785d483d-2ee3-42ff-b055-3cb07bc28e08 admin admin] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:57.231813 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785d483d-2ee3-42ff-b055-3cb07bc28e08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:57.232248 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785d483d-2ee3-42ff-b055-3cb07bc28e08 admin admin] PATH_INFO: `/v3/users` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:57.233056 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785d483d-2ee3-42ff-b055-3cb07bc28e08 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:22:57.235091 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785d483d-2ee3-42ff-b055-3cb07bc28e08 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:22:57.240194 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee123dec-7a18-4c53-96c1-042d466b5f23 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:22:57.245595 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d80f4c0-c1a0-4b91-a917-6936d4f6402c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:22:57.247648 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d80f4c0-c1a0-4b91-a917-6936d4f6402c admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:57.248038 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d80f4c0-c1a0-4b91-a917-6936d4f6402c admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:57.248392 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d80f4c0-c1a0-4b91-a917-6936d4f6402c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:57.249519 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d80f4c0-c1a0-4b91-a917-6936d4f6402c admin admin] RBAC: Adding query filter params (role.id=33a8e87420ed423f9cb29e0084eab5d2, scope.project.id=711fe35d158f4285974b4184777b46ac, user.id=f2385373f2ed470596d9876b614f4df6) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:22:57.250078 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d80f4c0-c1a0-4b91-a917-6936d4f6402c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:22:57.252177 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d80f4c0-c1a0-4b91-a917-6936d4f6402c admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:22:57.259030 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 115/232] 10.222.0.117 () {56 vars in 1400 bytes} [Tue Jan 25 02:22:57 2022] GET /identity/v3/role_assignments?user.id=f2385373f2ed470596d9876b614f4df6&scope.project.id=711fe35d158f4285974b4184777b46ac&role.id=33a8e87420ed423f9cb29e0084eab5d2 => generated 260 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 02:22:57.265707 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 118/233] 10.222.0.117 () {60 vars in 1158 bytes} [Tue Jan 25 02:22:57 2022] POST /identity/v3/users => generated 298 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 02:22:59.641762 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f25b5c-a80a-42ca-9749-f6ee2661e9f1 None None] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:59.642299 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f25b5c-a80a-42ca-9749-f6ee2661e9f1 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:59.642299 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f25b5c-a80a-42ca-9749-f6ee2661e9f1 None None] PATH_INFO: `/` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:59.644246 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 116/234] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:22:59 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:22:59.661736 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fc003a-c678-4879-b45d-a2198fe1b21d None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:59.662224 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fc003a-c678-4879-b45d-a2198fe1b21d None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:59.662322 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fc003a-c678-4879-b45d-a2198fe1b21d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:59.684301 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-c7fc003a-c678-4879-b45d-a2198fe1b21d None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:22:59.685853 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-c7fc003a-c678-4879-b45d-a2198fe1b21d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:22:59.693687 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 119/235] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:22:59 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 25 02:22:59.737935 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f25b5c-a80a-42ca-9749-f6ee2661e9f1 None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:22:59.757305 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f25b5c-a80a-42ca-9749-f6ee2661e9f1 None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:22:59.761814 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c53e736-514f-4f17-9c61-b9e34a2634ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:22:59.762786 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c53e736-514f-4f17-9c61-b9e34a2634ca admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:59.763070 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c53e736-514f-4f17-9c61-b9e34a2634ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:59.763338 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c53e736-514f-4f17-9c61-b9e34a2634ca admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:59.778829 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c53e736-514f-4f17-9c61-b9e34a2634ca admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 25 02:22:59.786213 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: WARNING keystone.server.flask.application [None req-8c53e736-514f-4f17-9c61-b9e34a2634ca admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jan 25 02:22:59.787407 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 117/236] 10.222.0.117 () {56 vars in 1140 bytes} [Tue Jan 25 02:22:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:22:59.793863 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fc003a-c678-4879-b45d-a2198fe1b21d None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:22:59.802752 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fc003a-c678-4879-b45d-a2198fe1b21d None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:22:59.807170 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c498d1-a240-430a-bf60-74399c6aeabd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:22:59.807864 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c498d1-a240-430a-bf60-74399c6aeabd admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:59.808144 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c498d1-a240-430a-bf60-74399c6aeabd admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:59.808418 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c498d1-a240-430a-bf60-74399c6aeabd admin admin] PATH_INFO: `/v3/roles` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:59.809800 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c498d1-a240-430a-bf60-74399c6aeabd admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:22:59.810106 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c498d1-a240-430a-bf60-74399c6aeabd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:22:59.811711 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c498d1-a240-430a-bf60-74399c6aeabd admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:22:59.820627 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 120/237] 10.222.0.117 () {56 vars in 1137 bytes} [Tue Jan 25 02:22:59 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:22:59.826947 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c53e736-514f-4f17-9c61-b9e34a2634ca admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:22:59.836697 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c53e736-514f-4f17-9c61-b9e34a2634ca admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:22:59.841816 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e06ebf-f809-415b-ad5e-faaa94242390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:22:59.842668 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e06ebf-f809-415b-ad5e-faaa94242390 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:59.842946 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e06ebf-f809-415b-ad5e-faaa94242390 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:59.843207 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e06ebf-f809-415b-ad5e-faaa94242390 admin admin] PATH_INFO: `/v3/users/389d3645cc1e4f20af168caff539224e` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:59.844425 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e06ebf-f809-415b-ad5e-faaa94242390 admin admin] RBAC: Authorizing `identity:get_user(user_id=389d3645cc1e4f20af168caff539224e)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:22:59.846823 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e06ebf-f809-415b-ad5e-faaa94242390 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:22:59.852728 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 118/238] 10.222.0.117 () {56 vars in 1203 bytes} [Tue Jan 25 02:22:59 2022] GET /identity/v3/users/389d3645cc1e4f20af168caff539224e => generated 284 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 02:22:59.854049 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c498d1-a240-430a-bf60-74399c6aeabd admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:22:59.863858 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c498d1-a240-430a-bf60-74399c6aeabd admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:22:59.868202 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630a7e2a-502c-4810-bf3e-9b7d1751733a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:22:59.868835 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630a7e2a-502c-4810-bf3e-9b7d1751733a admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:59.869111 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630a7e2a-502c-4810-bf3e-9b7d1751733a admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:59.869384 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630a7e2a-502c-4810-bf3e-9b7d1751733a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:59.881856 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630a7e2a-502c-4810-bf3e-9b7d1751733a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:22:59.883610 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630a7e2a-502c-4810-bf3e-9b7d1751733a admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:22:59.898083 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 121/239] 10.222.0.117 () {58 vars in 1329 bytes} [Tue Jan 25 02:22:59 2022] GET /identity/v3/auth/tokens => generated 915 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 25 02:22:59.905629 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7ba27e-92cf-4abd-91a2-2a7bfb443afb None None] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:59.905967 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7ba27e-92cf-4abd-91a2-2a7bfb443afb None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:59.906243 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7ba27e-92cf-4abd-91a2-2a7bfb443afb None None] PATH_INFO: `/` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:59.908165 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 119/240] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:22:59 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jan 25 02:22:59.909168 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630a7e2a-502c-4810-bf3e-9b7d1751733a admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:22:59.913358 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af1913d-b4fe-4537-9034-716c84bd4b0a None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:59.913692 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af1913d-b4fe-4537-9034-716c84bd4b0a None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:59.913970 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af1913d-b4fe-4537-9034-716c84bd4b0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:59.938488 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630a7e2a-502c-4810-bf3e-9b7d1751733a admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:22:59.940493 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-2af1913d-b4fe-4537-9034-716c84bd4b0a None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:22:59.941817 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-2af1913d-b4fe-4537-9034-716c84bd4b0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:22:59.946877 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811d9b17-9d1a-469a-bcb0-a015c81dc273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:22:59.947799 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811d9b17-9d1a-469a-bcb0-a015c81dc273 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:59.948081 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811d9b17-9d1a-469a-bcb0-a015c81dc273 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:59.948350 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811d9b17-9d1a-469a-bcb0-a015c81dc273 admin admin] PATH_INFO: `/v3/projects/711fe35d158f4285974b4184777b46ac` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:59.951267 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811d9b17-9d1a-469a-bcb0-a015c81dc273 admin admin] RBAC: Authorizing `identity:get_project(project_id=711fe35d158f4285974b4184777b46ac)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:22:59.953482 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811d9b17-9d1a-469a-bcb0-a015c81dc273 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:22:59.957012 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 122/241] 10.222.0.117 () {56 vars in 1212 bytes} [Tue Jan 25 02:22:59 2022] GET /identity/v3/projects/711fe35d158f4285974b4184777b46ac => generated 303 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:22:59.962031 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811d9b17-9d1a-469a-bcb0-a015c81dc273 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:22:59.963758 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 120/242] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:22:59 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 25 02:22:59.975253 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb6dee5-4cf5-4b29-9326-f313ada768c2 None None] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:59.975539 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb6dee5-4cf5-4b29-9326-f313ada768c2 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:59.975842 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb6dee5-4cf5-4b29-9326-f313ada768c2 None None] PATH_INFO: `/` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:59.976943 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811d9b17-9d1a-469a-bcb0-a015c81dc273 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:22:59.979745 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 121/243] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:22:59 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jan 25 02:22:59.983083 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f253f823-2afb-466a-b932-6caba999264f None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:59.983558 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f253f823-2afb-466a-b932-6caba999264f None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:59.984065 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f253f823-2afb-466a-b932-6caba999264f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:59.989288 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bc965d-7c97-41c0-bbbf-064d9a29394d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:22:59.989961 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bc965d-7c97-41c0-bbbf-064d9a29394d admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:22:59.990248 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bc965d-7c97-41c0-bbbf-064d9a29394d admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:22:59.990527 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bc965d-7c97-41c0-bbbf-064d9a29394d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:22:59.991396 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bc965d-7c97-41c0-bbbf-064d9a29394d admin admin] RBAC: Adding query filter params (role.id=259d005f63d5455d8728277d6385bfba, scope.project.id=711fe35d158f4285974b4184777b46ac, user.id=389d3645cc1e4f20af168caff539224e) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:22:59.991729 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bc965d-7c97-41c0-bbbf-064d9a29394d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:22:59.993835 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bc965d-7c97-41c0-bbbf-064d9a29394d admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:00.005006 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-f253f823-2afb-466a-b932-6caba999264f None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:23:00.006459 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-f253f823-2afb-466a-b932-6caba999264f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:23:00.009367 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 123/244] 10.222.0.117 () {56 vars in 1400 bytes} [Tue Jan 25 02:22:59 2022] GET /identity/v3/role_assignments?user.id=389d3645cc1e4f20af168caff539224e&scope.project.id=711fe35d158f4285974b4184777b46ac&role.id=259d005f63d5455d8728277d6385bfba => generated 610 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 02:23:00.016016 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 122/245] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:22:59 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 25 02:23:00.016751 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bc965d-7c97-41c0-bbbf-064d9a29394d admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:00.033491 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bc965d-7c97-41c0-bbbf-064d9a29394d admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:00.048587 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a1f383-600b-4fce-89fc-08c22e3fd2f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:00.049421 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a1f383-600b-4fce-89fc-08c22e3fd2f0 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:00.049714 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a1f383-600b-4fce-89fc-08c22e3fd2f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:00.049991 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a1f383-600b-4fce-89fc-08c22e3fd2f0 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:00.068699 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a1f383-600b-4fce-89fc-08c22e3fd2f0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 25 02:23:00.069355 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f253f823-2afb-466a-b932-6caba999264f None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:00.076690 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: WARNING keystone.server.flask.application [None req-c7a1f383-600b-4fce-89fc-08c22e3fd2f0 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 25 02:23:00.078913 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 124/246] 10.222.0.117 () {56 vars in 1122 bytes} [Tue Jan 25 02:23:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:23:00.085505 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f253f823-2afb-466a-b932-6caba999264f None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:00.085690 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a1f383-600b-4fce-89fc-08c22e3fd2f0 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:00.096379 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04411ecd-7171-46c2-9967-34aea17aee7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:00.097535 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04411ecd-7171-46c2-9967-34aea17aee7a admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:00.097967 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04411ecd-7171-46c2-9967-34aea17aee7a admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:00.098416 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04411ecd-7171-46c2-9967-34aea17aee7a admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:00.107599 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a1f383-600b-4fce-89fc-08c22e3fd2f0 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:00.115682 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00545541-0fbd-4b9f-bb14-d2049580b0ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:00.116688 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00545541-0fbd-4b9f-bb14-d2049580b0ee admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:00.117235 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00545541-0fbd-4b9f-bb14-d2049580b0ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:00.119647 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00545541-0fbd-4b9f-bb14-d2049580b0ee admin admin] PATH_INFO: `/v3/roles` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:00.120722 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00545541-0fbd-4b9f-bb14-d2049580b0ee admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:00.122296 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00545541-0fbd-4b9f-bb14-d2049580b0ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:00.124241 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00545541-0fbd-4b9f-bb14-d2049580b0ee admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:00.125347 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04411ecd-7171-46c2-9967-34aea17aee7a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 25 02:23:00.135212 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: WARNING keystone.server.flask.application [None req-04411ecd-7171-46c2-9967-34aea17aee7a admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 25 02:23:00.142424 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 123/247] 10.222.0.117 () {56 vars in 1125 bytes} [Tue Jan 25 02:23:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 25 02:23:00.148927 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 125/248] 10.222.0.117 () {56 vars in 1125 bytes} [Tue Jan 25 02:23:00 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 02:23:00.155634 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04411ecd-7171-46c2-9967-34aea17aee7a admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:00.156282 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00545541-0fbd-4b9f-bb14-d2049580b0ee admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:00.166060 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04411ecd-7171-46c2-9967-34aea17aee7a admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:00.172075 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00545541-0fbd-4b9f-bb14-d2049580b0ee admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:00.173878 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d796c1f2-16cd-43cf-a166-0b1d3f8b8a73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:00.174821 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d796c1f2-16cd-43cf-a166-0b1d3f8b8a73 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:00.175159 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d796c1f2-16cd-43cf-a166-0b1d3f8b8a73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:00.175522 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d796c1f2-16cd-43cf-a166-0b1d3f8b8a73 admin admin] PATH_INFO: `/v3/users/389d3645cc1e4f20af168caff539224e` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:00.177549 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d796c1f2-16cd-43cf-a166-0b1d3f8b8a73 admin admin] RBAC: Authorizing `identity:get_user(user_id=389d3645cc1e4f20af168caff539224e)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:00.180156 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d796c1f2-16cd-43cf-a166-0b1d3f8b8a73 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:00.184476 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 124/249] 10.222.0.117 () {56 vars in 1203 bytes} [Tue Jan 25 02:23:00 2022] GET /identity/v3/users/389d3645cc1e4f20af168caff539224e => generated 284 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:00.185993 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef4d83c-66ee-4baa-a5fd-ed9e2cc06f35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:00.186767 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef4d83c-66ee-4baa-a5fd-ed9e2cc06f35 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:00.187083 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef4d83c-66ee-4baa-a5fd-ed9e2cc06f35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:00.187420 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef4d83c-66ee-4baa-a5fd-ed9e2cc06f35 admin admin] PATH_INFO: `/v3/roles` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:00.188318 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef4d83c-66ee-4baa-a5fd-ed9e2cc06f35 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:00.188689 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef4d83c-66ee-4baa-a5fd-ed9e2cc06f35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:00.191846 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef4d83c-66ee-4baa-a5fd-ed9e2cc06f35 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:00.192958 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d796c1f2-16cd-43cf-a166-0b1d3f8b8a73 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:00.201993 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 126/250] 10.222.0.117 () {56 vars in 1127 bytes} [Tue Jan 25 02:23:00 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 02:23:00.206413 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d796c1f2-16cd-43cf-a166-0b1d3f8b8a73 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:00.208388 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef4d83c-66ee-4baa-a5fd-ed9e2cc06f35 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:00.210974 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bdd424-b495-49de-a270-c2a580b10987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:00.211605 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bdd424-b495-49de-a270-c2a580b10987 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:00.211913 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bdd424-b495-49de-a270-c2a580b10987 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:00.212185 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bdd424-b495-49de-a270-c2a580b10987 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:00.220322 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef4d83c-66ee-4baa-a5fd-ed9e2cc06f35 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:00.221603 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bdd424-b495-49de-a270-c2a580b10987 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:00.223451 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bdd424-b495-49de-a270-c2a580b10987 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:00.226094 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07cd373-efdf-4fe5-a778-3516570b3356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:00.227243 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07cd373-efdf-4fe5-a778-3516570b3356 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:00.227794 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07cd373-efdf-4fe5-a778-3516570b3356 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:00.228303 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07cd373-efdf-4fe5-a778-3516570b3356 admin admin] PATH_INFO: `/v3/users/f2385373f2ed470596d9876b614f4df6` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:00.229881 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07cd373-efdf-4fe5-a778-3516570b3356 admin admin] RBAC: Authorizing `identity:get_user(user_id=f2385373f2ed470596d9876b614f4df6)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:00.232738 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07cd373-efdf-4fe5-a778-3516570b3356 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:00.234466 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 125/251] 10.222.0.117 () {58 vars in 1329 bytes} [Tue Jan 25 02:23:00 2022] GET /identity/v3/auth/tokens => generated 915 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 25 02:23:00.235146 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 127/252] 10.222.0.117 () {56 vars in 1203 bytes} [Tue Jan 25 02:23:00 2022] GET /identity/v3/users/f2385373f2ed470596d9876b614f4df6 => generated 298 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:00.238849 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b384f53b-85d8-4829-be91-662dd6dd6b47 None None] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:00.239204 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b384f53b-85d8-4829-be91-662dd6dd6b47 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:00.240103 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b384f53b-85d8-4829-be91-662dd6dd6b47 None None] PATH_INFO: `/` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:00.241349 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cbfbb3-3a13-486d-9e7a-4fa435ed7696 None None] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:00.241640 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cbfbb3-3a13-486d-9e7a-4fa435ed7696 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:00.241922 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cbfbb3-3a13-486d-9e7a-4fa435ed7696 None None] PATH_INFO: `/` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:00.242120 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 126/253] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:23:00 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:23:00.242807 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b384f53b-85d8-4829-be91-662dd6dd6b47 None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:00.243643 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 128/254] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:23:00 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:23:00.244374 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cbfbb3-3a13-486d-9e7a-4fa435ed7696 None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:00.257814 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cbfbb3-3a13-486d-9e7a-4fa435ed7696 None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:00.260762 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b384f53b-85d8-4829-be91-662dd6dd6b47 None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:00.263468 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808be349-88c5-4a94-9e7c-5c829cf7e10c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:00.264353 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808be349-88c5-4a94-9e7c-5c829cf7e10c admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:00.264722 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808be349-88c5-4a94-9e7c-5c829cf7e10c admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:00.265137 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808be349-88c5-4a94-9e7c-5c829cf7e10c admin admin] PATH_INFO: `/v3/projects/711fe35d158f4285974b4184777b46ac` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:00.266359 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecc67a6-a564-4558-a20a-9dcdaa566fc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:00.266890 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808be349-88c5-4a94-9e7c-5c829cf7e10c admin admin] RBAC: Authorizing `identity:get_project(project_id=711fe35d158f4285974b4184777b46ac)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:00.267200 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecc67a6-a564-4558-a20a-9dcdaa566fc7 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:00.267477 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecc67a6-a564-4558-a20a-9dcdaa566fc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:00.267781 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecc67a6-a564-4558-a20a-9dcdaa566fc7 admin admin] PATH_INFO: `/v3/projects/711fe35d158f4285974b4184777b46ac` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:00.269144 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecc67a6-a564-4558-a20a-9dcdaa566fc7 admin admin] RBAC: Authorizing `identity:get_project(project_id=711fe35d158f4285974b4184777b46ac)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:00.270350 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808be349-88c5-4a94-9e7c-5c829cf7e10c admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:00.271500 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecc67a6-a564-4558-a20a-9dcdaa566fc7 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:00.272638 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 129/255] 10.222.0.117 () {56 vars in 1212 bytes} [Tue Jan 25 02:23:00 2022] GET /identity/v3/projects/711fe35d158f4285974b4184777b46ac => generated 303 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:00.273847 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbb7b92-6291-4a81-b091-0f4128f84ec7 None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:00.274139 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbb7b92-6291-4a81-b091-0f4128f84ec7 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:00.274421 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbb7b92-6291-4a81-b091-0f4128f84ec7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:00.274717 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 127/256] 10.222.0.117 () {56 vars in 1212 bytes} [Tue Jan 25 02:23:00 2022] GET /identity/v3/projects/711fe35d158f4285974b4184777b46ac => generated 303 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:00.277049 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec90ad8-8317-49bd-8c43-2c8f3228fe2a None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:00.278113 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec90ad8-8317-49bd-8c43-2c8f3228fe2a None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:00.278582 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec90ad8-8317-49bd-8c43-2c8f3228fe2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:00.299418 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-abbb7b92-6291-4a81-b091-0f4128f84ec7 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:23:00.299901 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-5ec90ad8-8317-49bd-8c43-2c8f3228fe2a None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:23:00.300646 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-abbb7b92-6291-4a81-b091-0f4128f84ec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:23:00.301338 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-5ec90ad8-8317-49bd-8c43-2c8f3228fe2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:23:00.309660 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 130/257] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:23:00 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 25 02:23:00.310761 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbb7b92-6291-4a81-b091-0f4128f84ec7 None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:00.313211 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 128/258] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:23:00 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 25 02:23:00.314094 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec90ad8-8317-49bd-8c43-2c8f3228fe2a None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:00.324093 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec90ad8-8317-49bd-8c43-2c8f3228fe2a None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:00.330423 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cce03f4-8462-46b4-b055-33e8416d0093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:00.331151 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbb7b92-6291-4a81-b091-0f4128f84ec7 None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:00.331955 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cce03f4-8462-46b4-b055-33e8416d0093 admin admin] REQUEST_METHOD: `PUT` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:00.332417 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cce03f4-8462-46b4-b055-33e8416d0093 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:00.333078 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cce03f4-8462-46b4-b055-33e8416d0093 admin admin] PATH_INFO: `/v3/projects/711fe35d158f4285974b4184777b46ac/users/f2385373f2ed470596d9876b614f4df6/roles/33a8e87420ed423f9cb29e0084eab5d2` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:00.335750 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cce03f4-8462-46b4-b055-33e8416d0093 admin admin] RBAC: Authorizing `identity:create_grant(project_id=711fe35d158f4285974b4184777b46ac, user_id=f2385373f2ed470596d9876b614f4df6, role_id=33a8e87420ed423f9cb29e0084eab5d2)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:00.336136 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28f2216-adcd-4302-bb28-1b4a3d6c5ae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:00.336782 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28f2216-adcd-4302-bb28-1b4a3d6c5ae0 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:00.337064 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28f2216-adcd-4302-bb28-1b4a3d6c5ae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:00.337376 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28f2216-adcd-4302-bb28-1b4a3d6c5ae0 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:00.338193 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28f2216-adcd-4302-bb28-1b4a3d6c5ae0 admin admin] RBAC: Adding query filter params (role.id=d8dbc6d83d9d41d28c3feb8b3485b291, scope.project.id=711fe35d158f4285974b4184777b46ac, user.id=389d3645cc1e4f20af168caff539224e) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:00.338470 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cce03f4-8462-46b4-b055-33e8416d0093 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:00.338561 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28f2216-adcd-4302-bb28-1b4a3d6c5ae0 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:00.340995 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28f2216-adcd-4302-bb28-1b4a3d6c5ae0 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:00.348411 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 131/259] 10.222.0.117 () {56 vars in 1400 bytes} [Tue Jan 25 02:23:00 2022] GET /identity/v3/role_assignments?user.id=389d3645cc1e4f20af168caff539224e&scope.project.id=711fe35d158f4285974b4184777b46ac&role.id=d8dbc6d83d9d41d28c3feb8b3485b291 => generated 610 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:00.349170 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28f2216-adcd-4302-bb28-1b4a3d6c5ae0 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:00.354121 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 129/260] 10.222.0.117 () {58 vars in 1465 bytes} [Tue Jan 25 02:23:00 2022] PUT /identity/v3/projects/711fe35d158f4285974b4184777b46ac/users/f2385373f2ed470596d9876b614f4df6/roles/33a8e87420ed423f9cb29e0084eab5d2 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:23:00.355036 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cce03f4-8462-46b4-b055-33e8416d0093 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:00.361770 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28f2216-adcd-4302-bb28-1b4a3d6c5ae0 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:00.441786 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c392323d-6098-4b85-80c8-6a7212c5c6cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:00.443218 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c392323d-6098-4b85-80c8-6a7212c5c6cd admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:00.443670 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c392323d-6098-4b85-80c8-6a7212c5c6cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:00.444216 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c392323d-6098-4b85-80c8-6a7212c5c6cd admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:00.445282 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cce03f4-8462-46b4-b055-33e8416d0093 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:00.451442 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baee929c-a5e5-4882-ae79-dceb3eee6326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:00.452828 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baee929c-a5e5-4882-ae79-dceb3eee6326 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:00.453226 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baee929c-a5e5-4882-ae79-dceb3eee6326 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:00.453634 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baee929c-a5e5-4882-ae79-dceb3eee6326 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:00.456030 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baee929c-a5e5-4882-ae79-dceb3eee6326 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:00.458634 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baee929c-a5e5-4882-ae79-dceb3eee6326 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:00.459048 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c392323d-6098-4b85-80c8-6a7212c5c6cd admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 25 02:23:00.460940 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 130/261] 10.222.0.117 () {56 vars in 1134 bytes} [Tue Jan 25 02:23:00 2022] GET /identity/v3/domains/default => generated 200 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:00.466745 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baee929c-a5e5-4882-ae79-dceb3eee6326 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:00.467387 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: WARNING keystone.server.flask.application [None req-c392323d-6098-4b85-80c8-6a7212c5c6cd admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jan 25 02:23:00.469026 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 132/262] 10.222.0.117 () {56 vars in 1125 bytes} [Tue Jan 25 02:23:00 2022] GET /identity/v3/roles/reader => generated 84 bytes in 120 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:23:00.476055 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c392323d-6098-4b85-80c8-6a7212c5c6cd admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:00.480021 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baee929c-a5e5-4882-ae79-dceb3eee6326 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:00.487152 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5b1b6d-032a-4bac-9d6f-93921fb8493c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:00.488241 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5b1b6d-032a-4bac-9d6f-93921fb8493c admin admin] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:00.488631 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5b1b6d-032a-4bac-9d6f-93921fb8493c admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:00.488997 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c392323d-6098-4b85-80c8-6a7212c5c6cd admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:00.489112 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5b1b6d-032a-4bac-9d6f-93921fb8493c admin admin] PATH_INFO: `/v3/users` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:00.490065 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5b1b6d-032a-4bac-9d6f-93921fb8493c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:00.492699 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5b1b6d-032a-4bac-9d6f-93921fb8493c admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:00.494598 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11ec96b-af3c-4e84-bcc6-87bf72a9692f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:00.495556 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11ec96b-af3c-4e84-bcc6-87bf72a9692f admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:00.496022 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11ec96b-af3c-4e84-bcc6-87bf72a9692f admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:00.497033 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11ec96b-af3c-4e84-bcc6-87bf72a9692f admin admin] PATH_INFO: `/v3/roles` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:00.497984 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11ec96b-af3c-4e84-bcc6-87bf72a9692f admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:00.498476 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11ec96b-af3c-4e84-bcc6-87bf72a9692f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:00.500391 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11ec96b-af3c-4e84-bcc6-87bf72a9692f admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:00.514304 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 133/263] 10.222.0.117 () {56 vars in 1127 bytes} [Tue Jan 25 02:23:00 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:00.520383 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11ec96b-af3c-4e84-bcc6-87bf72a9692f admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:00.522282 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 131/264] 10.222.0.117 () {60 vars in 1158 bytes} [Tue Jan 25 02:23:00 2022] POST /identity/v3/users => generated 294 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 25 02:23:00.534392 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11ec96b-af3c-4e84-bcc6-87bf72a9692f admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:00.539940 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0157e539-946c-4cff-a295-fd00f97ba3de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:00.541192 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0157e539-946c-4cff-a295-fd00f97ba3de admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:00.541701 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0157e539-946c-4cff-a295-fd00f97ba3de admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:00.542130 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0157e539-946c-4cff-a295-fd00f97ba3de admin admin] PATH_INFO: `/v3/users/072b06358eaf4b878fc378c53be1be81` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:00.559916 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0157e539-946c-4cff-a295-fd00f97ba3de admin admin] RBAC: Authorizing `identity:get_user(user_id=072b06358eaf4b878fc378c53be1be81)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:00.562417 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0157e539-946c-4cff-a295-fd00f97ba3de admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:00.564681 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 134/265] 10.222.0.117 () {56 vars in 1203 bytes} [Tue Jan 25 02:23:00 2022] GET /identity/v3/users/072b06358eaf4b878fc378c53be1be81 => generated 298 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:00.570276 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5b1b6d-032a-4bac-9d6f-93921fb8493c admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:00.581554 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5b1b6d-032a-4bac-9d6f-93921fb8493c admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:00.591176 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88628ba8-1604-49e9-b2ca-7e99fda994f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:00.591930 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88628ba8-1604-49e9-b2ca-7e99fda994f0 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:00.592260 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88628ba8-1604-49e9-b2ca-7e99fda994f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:00.592554 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88628ba8-1604-49e9-b2ca-7e99fda994f0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:00.608878 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88628ba8-1604-49e9-b2ca-7e99fda994f0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:00.610752 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88628ba8-1604-49e9-b2ca-7e99fda994f0 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:00.622368 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 132/266] 10.222.0.117 () {58 vars in 1329 bytes} [Tue Jan 25 02:23:00 2022] GET /identity/v3/auth/tokens => generated 915 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 25 02:23:00.628002 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0157e539-946c-4cff-a295-fd00f97ba3de admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:00.643344 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0157e539-946c-4cff-a295-fd00f97ba3de admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:00.648369 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1624a6-91ec-42af-8ad2-aa06868acd09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:00.649815 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1624a6-91ec-42af-8ad2-aa06868acd09 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:00.650101 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1624a6-91ec-42af-8ad2-aa06868acd09 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:00.650376 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1624a6-91ec-42af-8ad2-aa06868acd09 admin admin] PATH_INFO: `/v3/projects/711fe35d158f4285974b4184777b46ac` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:00.651739 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1624a6-91ec-42af-8ad2-aa06868acd09 admin admin] RBAC: Authorizing `identity:get_project(project_id=711fe35d158f4285974b4184777b46ac)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:00.655514 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1624a6-91ec-42af-8ad2-aa06868acd09 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:00.657871 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 135/267] 10.222.0.117 () {56 vars in 1212 bytes} [Tue Jan 25 02:23:00 2022] GET /identity/v3/projects/711fe35d158f4285974b4184777b46ac => generated 303 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:00.665756 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88628ba8-1604-49e9-b2ca-7e99fda994f0 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:00.678439 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88628ba8-1604-49e9-b2ca-7e99fda994f0 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:00.685465 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a35961-eda6-47c8-8b9d-b9b5a0bdd180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:00.686142 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a35961-eda6-47c8-8b9d-b9b5a0bdd180 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:00.686426 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a35961-eda6-47c8-8b9d-b9b5a0bdd180 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:00.686697 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a35961-eda6-47c8-8b9d-b9b5a0bdd180 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:00.687583 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a35961-eda6-47c8-8b9d-b9b5a0bdd180 admin admin] RBAC: Adding query filter params (role.id=3f17a45b07a243abb2d3005961a5d648, scope.project.id=711fe35d158f4285974b4184777b46ac, user.id=072b06358eaf4b878fc378c53be1be81) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:00.687922 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a35961-eda6-47c8-8b9d-b9b5a0bdd180 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:00.689834 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a35961-eda6-47c8-8b9d-b9b5a0bdd180 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:00.696157 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 133/268] 10.222.0.117 () {56 vars in 1400 bytes} [Tue Jan 25 02:23:00 2022] GET /identity/v3/role_assignments?user.id=072b06358eaf4b878fc378c53be1be81&scope.project.id=711fe35d158f4285974b4184777b46ac&role.id=3f17a45b07a243abb2d3005961a5d648 => generated 260 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:02.673564 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3114361-75cf-4748-b28a-663aeb96b2ff None None] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:02.674088 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3114361-75cf-4748-b28a-663aeb96b2ff None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:02.674088 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3114361-75cf-4748-b28a-663aeb96b2ff None None] PATH_INFO: `/` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:02.676268 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 136/269] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:23:02 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:23:02.683196 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a261ea52-25f1-4d17-af21-a0696effa63e None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:02.684362 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a261ea52-25f1-4d17-af21-a0696effa63e None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:02.684362 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a261ea52-25f1-4d17-af21-a0696effa63e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:02.704948 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-a261ea52-25f1-4d17-af21-a0696effa63e None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:23:02.706232 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-a261ea52-25f1-4d17-af21-a0696effa63e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:23:02.714821 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 134/270] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:23:02 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 25 02:23:02.740496 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3114361-75cf-4748-b28a-663aeb96b2ff None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:02.753935 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3114361-75cf-4748-b28a-663aeb96b2ff None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:02.758494 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd48419e-fb70-4515-92c6-1b9419ecba81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:02.759523 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd48419e-fb70-4515-92c6-1b9419ecba81 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:02.760065 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd48419e-fb70-4515-92c6-1b9419ecba81 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:02.760534 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd48419e-fb70-4515-92c6-1b9419ecba81 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:02.777210 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd48419e-fb70-4515-92c6-1b9419ecba81 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 25 02:23:02.785197 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: WARNING keystone.server.flask.application [None req-bd48419e-fb70-4515-92c6-1b9419ecba81 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 25 02:23:02.791289 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 137/271] 10.222.0.117 () {56 vars in 1125 bytes} [Tue Jan 25 02:23:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:23:02.793427 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a261ea52-25f1-4d17-af21-a0696effa63e None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:02.803018 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a261ea52-25f1-4d17-af21-a0696effa63e None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:02.807535 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ecfcb4-a591-4769-a9f1-165234705a86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:02.808285 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ecfcb4-a591-4769-a9f1-165234705a86 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:02.809119 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ecfcb4-a591-4769-a9f1-165234705a86 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:02.809415 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ecfcb4-a591-4769-a9f1-165234705a86 admin admin] PATH_INFO: `/v3/roles` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:02.810191 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ecfcb4-a591-4769-a9f1-165234705a86 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:02.810495 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ecfcb4-a591-4769-a9f1-165234705a86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:02.812137 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ecfcb4-a591-4769-a9f1-165234705a86 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:02.821226 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 135/272] 10.222.0.117 () {56 vars in 1127 bytes} [Tue Jan 25 02:23:02 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:02.827237 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd48419e-fb70-4515-92c6-1b9419ecba81 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:02.837012 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd48419e-fb70-4515-92c6-1b9419ecba81 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:02.842155 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9521a932-257e-4f14-8a57-f7dc7f9fcb1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:02.843026 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9521a932-257e-4f14-8a57-f7dc7f9fcb1f admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:02.843311 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9521a932-257e-4f14-8a57-f7dc7f9fcb1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:02.843586 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9521a932-257e-4f14-8a57-f7dc7f9fcb1f admin admin] PATH_INFO: `/v3/users/f2385373f2ed470596d9876b614f4df6` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:02.844849 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9521a932-257e-4f14-8a57-f7dc7f9fcb1f admin admin] RBAC: Authorizing `identity:get_user(user_id=f2385373f2ed470596d9876b614f4df6)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:02.847250 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9521a932-257e-4f14-8a57-f7dc7f9fcb1f admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:02.848949 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 138/273] 10.222.0.117 () {56 vars in 1203 bytes} [Tue Jan 25 02:23:02 2022] GET /identity/v3/users/f2385373f2ed470596d9876b614f4df6 => generated 298 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:02.854354 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ecfcb4-a591-4769-a9f1-165234705a86 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:02.864601 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ecfcb4-a591-4769-a9f1-165234705a86 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:02.869171 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792ea9c7-f4d0-4354-bb33-4a32a6ee3cf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:02.869823 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792ea9c7-f4d0-4354-bb33-4a32a6ee3cf8 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:02.870111 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792ea9c7-f4d0-4354-bb33-4a32a6ee3cf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:02.870391 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792ea9c7-f4d0-4354-bb33-4a32a6ee3cf8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:02.879253 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792ea9c7-f4d0-4354-bb33-4a32a6ee3cf8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:02.881057 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792ea9c7-f4d0-4354-bb33-4a32a6ee3cf8 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:02.892863 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 136/274] 10.222.0.117 () {58 vars in 1329 bytes} [Tue Jan 25 02:23:02 2022] GET /identity/v3/auth/tokens => generated 915 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 25 02:23:02.899033 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9521a932-257e-4f14-8a57-f7dc7f9fcb1f admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:02.912002 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9521a932-257e-4f14-8a57-f7dc7f9fcb1f admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:02.916479 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c502f9f8-0aba-4da4-82eb-30ed1e721a4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:02.917338 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c502f9f8-0aba-4da4-82eb-30ed1e721a4a admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:02.917626 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c502f9f8-0aba-4da4-82eb-30ed1e721a4a admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:02.917994 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c502f9f8-0aba-4da4-82eb-30ed1e721a4a admin admin] PATH_INFO: `/v3/projects/711fe35d158f4285974b4184777b46ac` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:02.919320 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c502f9f8-0aba-4da4-82eb-30ed1e721a4a admin admin] RBAC: Authorizing `identity:get_project(project_id=711fe35d158f4285974b4184777b46ac)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:02.921414 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c502f9f8-0aba-4da4-82eb-30ed1e721a4a admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:02.923389 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 139/275] 10.222.0.117 () {56 vars in 1212 bytes} [Tue Jan 25 02:23:02 2022] GET /identity/v3/projects/711fe35d158f4285974b4184777b46ac => generated 303 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:02.929358 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c502f9f8-0aba-4da4-82eb-30ed1e721a4a admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:02.929557 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f4e16a-804f-4416-b2a7-dc23ec2c9fae None None] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:02.929746 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f4e16a-804f-4416-b2a7-dc23ec2c9fae None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:02.930032 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f4e16a-804f-4416-b2a7-dc23ec2c9fae None None] PATH_INFO: `/` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:02.932089 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 137/276] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:23:02 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:23:02.937193 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f121fe-4309-4871-818c-e20a59e63810 None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:02.937658 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f121fe-4309-4871-818c-e20a59e63810 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:02.938079 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f121fe-4309-4871-818c-e20a59e63810 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:02.939578 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c502f9f8-0aba-4da4-82eb-30ed1e721a4a admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:02.944025 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e15aa5c-df9e-4f81-9788-2b2da7cb844d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:02.944664 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e15aa5c-df9e-4f81-9788-2b2da7cb844d admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:02.944946 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e15aa5c-df9e-4f81-9788-2b2da7cb844d admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:02.945222 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e15aa5c-df9e-4f81-9788-2b2da7cb844d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:02.946078 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e15aa5c-df9e-4f81-9788-2b2da7cb844d admin admin] RBAC: Adding query filter params (role.id=33a8e87420ed423f9cb29e0084eab5d2, scope.project.id=711fe35d158f4285974b4184777b46ac, user.id=f2385373f2ed470596d9876b614f4df6) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:02.946374 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e15aa5c-df9e-4f81-9788-2b2da7cb844d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:02.948237 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e15aa5c-df9e-4f81-9788-2b2da7cb844d admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:02.955075 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 140/277] 10.222.0.117 () {56 vars in 1400 bytes} [Tue Jan 25 02:23:02 2022] GET /identity/v3/role_assignments?user.id=f2385373f2ed470596d9876b614f4df6&scope.project.id=711fe35d158f4285974b4184777b46ac&role.id=33a8e87420ed423f9cb29e0084eab5d2 => generated 610 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 02:23:02.959532 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-b6f121fe-4309-4871-818c-e20a59e63810 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:23:02.961048 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-b6f121fe-4309-4871-818c-e20a59e63810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:23:02.963935 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5be8632-74ca-44cb-962b-718974a7bc5f None None] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:02.964226 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5be8632-74ca-44cb-962b-718974a7bc5f None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:02.964505 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5be8632-74ca-44cb-962b-718974a7bc5f None None] PATH_INFO: `/` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:02.968755 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 141/278] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:23:02 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:23:02.972476 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 138/279] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:23:02 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 25 02:23:02.977335 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada1b471-bb6b-4c23-906e-e9971a307482 None None] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:02.979340 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada1b471-bb6b-4c23-906e-e9971a307482 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:02.979340 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada1b471-bb6b-4c23-906e-e9971a307482 None None] PATH_INFO: `/` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:02.979519 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0e3d42-fb3a-46f5-be6b-f51ed0186a11 None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:02.979519 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0e3d42-fb3a-46f5-be6b-f51ed0186a11 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:02.979519 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0e3d42-fb3a-46f5-be6b-f51ed0186a11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:02.980603 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 139/280] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:23:02 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:23:02.986230 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d3c160-cb27-4aea-bce4-2b4464f7359c None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:02.986597 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d3c160-cb27-4aea-bce4-2b4464f7359c None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:02.986758 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d3c160-cb27-4aea-bce4-2b4464f7359c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:03.008283 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-be0e3d42-fb3a-46f5-be6b-f51ed0186a11 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:23:03.009526 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-be0e3d42-fb3a-46f5-be6b-f51ed0186a11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:23:03.010206 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-c1d3c160-cb27-4aea-bce4-2b4464f7359c None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:23:03.011373 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-c1d3c160-cb27-4aea-bce4-2b4464f7359c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:23:03.018026 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 142/281] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:23:02 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 25 02:23:03.018699 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0e3d42-fb3a-46f5-be6b-f51ed0186a11 None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:03.028269 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 140/282] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:23:02 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 25 02:23:03.028617 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0e3d42-fb3a-46f5-be6b-f51ed0186a11 None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:03.033223 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796f3dab-fe6c-41b7-b18d-3b4c57a0bfa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:03.034089 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796f3dab-fe6c-41b7-b18d-3b4c57a0bfa8 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:03.034423 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796f3dab-fe6c-41b7-b18d-3b4c57a0bfa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:03.034704 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796f3dab-fe6c-41b7-b18d-3b4c57a0bfa8 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:03.043188 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d3c160-cb27-4aea-bce4-2b4464f7359c None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:03.047193 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796f3dab-fe6c-41b7-b18d-3b4c57a0bfa8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 25 02:23:03.053434 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d3c160-cb27-4aea-bce4-2b4464f7359c None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:03.054331 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: WARNING keystone.server.flask.application [None req-796f3dab-fe6c-41b7-b18d-3b4c57a0bfa8 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jan 25 02:23:03.055909 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 143/283] 10.222.0.117 () {56 vars in 1125 bytes} [Tue Jan 25 02:23:03 2022] GET /identity/v3/roles/reader => generated 84 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:23:03.056713 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796f3dab-fe6c-41b7-b18d-3b4c57a0bfa8 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:03.058021 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3b70f0-bf3e-49dd-b1f0-4d17a94c0a81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:03.059429 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3b70f0-bf3e-49dd-b1f0-4d17a94c0a81 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:03.060584 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3b70f0-bf3e-49dd-b1f0-4d17a94c0a81 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:03.060584 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3b70f0-bf3e-49dd-b1f0-4d17a94c0a81 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:03.062570 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3b70f0-bf3e-49dd-b1f0-4d17a94c0a81 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:03.063295 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3b70f0-bf3e-49dd-b1f0-4d17a94c0a81 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:03.065145 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 141/284] 10.222.0.117 () {56 vars in 1134 bytes} [Tue Jan 25 02:23:03 2022] GET /identity/v3/domains/default => generated 200 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 02:23:03.066584 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3b70f0-bf3e-49dd-b1f0-4d17a94c0a81 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:03.068033 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796f3dab-fe6c-41b7-b18d-3b4c57a0bfa8 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:03.072776 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9971749e-fb13-4862-add6-5adbf83c819d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:03.073574 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9971749e-fb13-4862-add6-5adbf83c819d admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:03.073857 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9971749e-fb13-4862-add6-5adbf83c819d admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:03.074134 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9971749e-fb13-4862-add6-5adbf83c819d admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:03.078644 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3b70f0-bf3e-49dd-b1f0-4d17a94c0a81 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:03.084227 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6473e855-bc75-4bef-ba46-8911a549279b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:03.085139 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6473e855-bc75-4bef-ba46-8911a549279b admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:03.085564 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6473e855-bc75-4bef-ba46-8911a549279b admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:03.086249 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6473e855-bc75-4bef-ba46-8911a549279b admin admin] PATH_INFO: `/v3/roles` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:03.086598 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9971749e-fb13-4862-add6-5adbf83c819d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 25 02:23:03.087316 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6473e855-bc75-4bef-ba46-8911a549279b admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:03.087794 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6473e855-bc75-4bef-ba46-8911a549279b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:03.089585 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6473e855-bc75-4bef-ba46-8911a549279b admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:03.094665 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: WARNING keystone.server.flask.application [None req-9971749e-fb13-4862-add6-5adbf83c819d admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 25 02:23:03.096382 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 144/285] 10.222.0.117 () {56 vars in 1125 bytes} [Tue Jan 25 02:23:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:23:03.096972 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9971749e-fb13-4862-add6-5adbf83c819d admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:03.106606 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 142/286] 10.222.0.117 () {56 vars in 1127 bytes} [Tue Jan 25 02:23:03 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:03.111495 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9971749e-fb13-4862-add6-5adbf83c819d admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:03.111583 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6473e855-bc75-4bef-ba46-8911a549279b admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:03.115902 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0a2c6f-6d30-4b70-9e93-0ff4ad03ba12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:03.116582 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0a2c6f-6d30-4b70-9e93-0ff4ad03ba12 admin admin] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:03.116868 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0a2c6f-6d30-4b70-9e93-0ff4ad03ba12 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:03.117145 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0a2c6f-6d30-4b70-9e93-0ff4ad03ba12 admin admin] PATH_INFO: `/v3/users` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:03.117885 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0a2c6f-6d30-4b70-9e93-0ff4ad03ba12 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:03.118515 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6473e855-bc75-4bef-ba46-8911a549279b admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:03.119874 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0a2c6f-6d30-4b70-9e93-0ff4ad03ba12 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:03.123631 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612ce5f9-acc8-47aa-99a7-975af2480d30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:03.124407 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612ce5f9-acc8-47aa-99a7-975af2480d30 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:03.124694 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612ce5f9-acc8-47aa-99a7-975af2480d30 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:03.124971 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612ce5f9-acc8-47aa-99a7-975af2480d30 admin admin] PATH_INFO: `/v3/roles` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:03.125753 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612ce5f9-acc8-47aa-99a7-975af2480d30 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:03.126063 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612ce5f9-acc8-47aa-99a7-975af2480d30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:03.127738 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612ce5f9-acc8-47aa-99a7-975af2480d30 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:03.137944 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 143/287] 10.222.0.117 () {56 vars in 1127 bytes} [Tue Jan 25 02:23:03 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:03.138627 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612ce5f9-acc8-47aa-99a7-975af2480d30 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:03.147456 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 145/288] 10.222.0.117 () {60 vars in 1158 bytes} [Tue Jan 25 02:23:03 2022] POST /identity/v3/users => generated 294 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 02:23:03.148035 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0a2c6f-6d30-4b70-9e93-0ff4ad03ba12 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:03.148384 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612ce5f9-acc8-47aa-99a7-975af2480d30 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:03.153771 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbec2235-2c56-4117-aded-79e161891ad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:03.155013 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbec2235-2c56-4117-aded-79e161891ad4 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:03.155288 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbec2235-2c56-4117-aded-79e161891ad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:03.156829 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbec2235-2c56-4117-aded-79e161891ad4 admin admin] PATH_INFO: `/v3/users/072b06358eaf4b878fc378c53be1be81` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:03.160140 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbec2235-2c56-4117-aded-79e161891ad4 admin admin] RBAC: Authorizing `identity:get_user(user_id=072b06358eaf4b878fc378c53be1be81)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:03.161974 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0a2c6f-6d30-4b70-9e93-0ff4ad03ba12 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:03.163457 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbec2235-2c56-4117-aded-79e161891ad4 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:03.165261 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 144/289] 10.222.0.117 () {56 vars in 1203 bytes} [Tue Jan 25 02:23:03 2022] GET /identity/v3/users/072b06358eaf4b878fc378c53be1be81 => generated 298 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:03.167388 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1797d0d-6a96-4e02-bcd9-3584ac62733f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:03.169198 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1797d0d-6a96-4e02-bcd9-3584ac62733f admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:03.169788 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1797d0d-6a96-4e02-bcd9-3584ac62733f admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:03.170243 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1797d0d-6a96-4e02-bcd9-3584ac62733f admin admin] PATH_INFO: `/v3/users/7d307b6e47b94ea1a93b3aba8cbdcff8` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:03.171985 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbec2235-2c56-4117-aded-79e161891ad4 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:03.186117 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbec2235-2c56-4117-aded-79e161891ad4 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:03.192025 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1aad673-9eac-4962-be7f-ca31f1a04484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:03.192486 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1797d0d-6a96-4e02-bcd9-3584ac62733f admin admin] RBAC: Authorizing `identity:get_user(user_id=7d307b6e47b94ea1a93b3aba8cbdcff8)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:03.193643 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aad673-9eac-4962-be7f-ca31f1a04484 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:03.193643 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aad673-9eac-4962-be7f-ca31f1a04484 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:03.193643 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aad673-9eac-4962-be7f-ca31f1a04484 admin admin] PATH_INFO: `/v3/projects/711fe35d158f4285974b4184777b46ac` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:03.195178 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1aad673-9eac-4962-be7f-ca31f1a04484 admin admin] RBAC: Authorizing `identity:get_project(project_id=711fe35d158f4285974b4184777b46ac)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:03.196294 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1797d0d-6a96-4e02-bcd9-3584ac62733f admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:03.197425 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1aad673-9eac-4962-be7f-ca31f1a04484 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:03.198457 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 146/290] 10.222.0.117 () {56 vars in 1203 bytes} [Tue Jan 25 02:23:03 2022] GET /identity/v3/users/7d307b6e47b94ea1a93b3aba8cbdcff8 => generated 294 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:03.199424 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 145/291] 10.222.0.117 () {56 vars in 1212 bytes} [Tue Jan 25 02:23:03 2022] GET /identity/v3/projects/711fe35d158f4285974b4184777b46ac => generated 303 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 02:23:03.205181 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1aad673-9eac-4962-be7f-ca31f1a04484 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:03.205364 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1797d0d-6a96-4e02-bcd9-3584ac62733f admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:03.216670 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1aad673-9eac-4962-be7f-ca31f1a04484 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:03.216979 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1797d0d-6a96-4e02-bcd9-3584ac62733f admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:03.222140 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47984e40-dedd-49db-a4e0-dd6afe10e702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:03.222570 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca387216-0284-4ed8-ac1d-d9b62a6ae1f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:03.222810 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47984e40-dedd-49db-a4e0-dd6afe10e702 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:03.223100 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47984e40-dedd-49db-a4e0-dd6afe10e702 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:03.223375 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47984e40-dedd-49db-a4e0-dd6afe10e702 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:03.224170 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca387216-0284-4ed8-ac1d-d9b62a6ae1f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:03.224281 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47984e40-dedd-49db-a4e0-dd6afe10e702 admin admin] RBAC: Adding query filter params (role.id=33a8e87420ed423f9cb29e0084eab5d2, user.id=7d307b6e47b94ea1a93b3aba8cbdcff8, scope.system=all) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:03.224563 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47984e40-dedd-49db-a4e0-dd6afe10e702 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:03.224850 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca387216-0284-4ed8-ac1d-d9b62a6ae1f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:03.225323 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca387216-0284-4ed8-ac1d-d9b62a6ae1f0 admin admin] PATH_INFO: `/v3/projects/711fe35d158f4285974b4184777b46ac/users/072b06358eaf4b878fc378c53be1be81/roles/3f17a45b07a243abb2d3005961a5d648` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:03.226463 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47984e40-dedd-49db-a4e0-dd6afe10e702 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:03.227884 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca387216-0284-4ed8-ac1d-d9b62a6ae1f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=711fe35d158f4285974b4184777b46ac, user_id=072b06358eaf4b878fc378c53be1be81, role_id=3f17a45b07a243abb2d3005961a5d648)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:03.231383 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca387216-0284-4ed8-ac1d-d9b62a6ae1f0 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:03.237332 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 146/292] 10.222.0.117 () {56 vars in 1334 bytes} [Tue Jan 25 02:23:03 2022] GET /identity/v3/role_assignments?user.id=7d307b6e47b94ea1a93b3aba8cbdcff8&scope.system=all&role.id=33a8e87420ed423f9cb29e0084eab5d2 => generated 227 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 02:23:03.248991 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 147/293] 10.222.0.117 () {58 vars in 1465 bytes} [Tue Jan 25 02:23:03 2022] PUT /identity/v3/projects/711fe35d158f4285974b4184777b46ac/users/072b06358eaf4b878fc378c53be1be81/roles/3f17a45b07a243abb2d3005961a5d648 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 25 02:23:05.544063 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487bdc30-c920-42d2-bbb2-77cba1f4ed91 None None] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:05.544583 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487bdc30-c920-42d2-bbb2-77cba1f4ed91 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:05.544658 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487bdc30-c920-42d2-bbb2-77cba1f4ed91 None None] PATH_INFO: `/` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:05.546475 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 147/294] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:23:05 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:23:05.552035 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9395f6e-c18f-497f-99da-a06b342e8d93 None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:05.552454 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9395f6e-c18f-497f-99da-a06b342e8d93 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:05.552613 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9395f6e-c18f-497f-99da-a06b342e8d93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:05.570982 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-d9395f6e-c18f-497f-99da-a06b342e8d93 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:23:05.572210 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-d9395f6e-c18f-497f-99da-a06b342e8d93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:23:05.597049 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a44b160-bfc4-40cc-b5b5-e53c0f96ae18 None None] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:05.597350 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a44b160-bfc4-40cc-b5b5-e53c0f96ae18 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:05.597604 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a44b160-bfc4-40cc-b5b5-e53c0f96ae18 None None] PATH_INFO: `/` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:05.599610 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 148/295] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:23:05 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jan 25 02:23:05.606334 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875d75c8-f8f0-423f-b8e6-65b3b13bd2a2 None None] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:05.606688 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875d75c8-f8f0-423f-b8e6-65b3b13bd2a2 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:05.607004 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875d75c8-f8f0-423f-b8e6-65b3b13bd2a2 None None] PATH_INFO: `/` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:05.608889 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 149/296] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:23:05 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jan 25 02:23:05.610796 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d43efc6-25b7-42a0-afc8-a5c8ce48677c None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:05.611155 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d43efc6-25b7-42a0-afc8-a5c8ce48677c None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:05.611435 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d43efc6-25b7-42a0-afc8-a5c8ce48677c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:05.632746 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-2d43efc6-25b7-42a0-afc8-a5c8ce48677c None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:23:05.633947 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-2d43efc6-25b7-42a0-afc8-a5c8ce48677c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:23:05.641701 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 148/297] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:23:05 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 25 02:23:05.642918 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a54a66-dc8a-4825-9f1d-62d67fa07ab4 None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:05.643202 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a54a66-dc8a-4825-9f1d-62d67fa07ab4 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:05.643541 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a54a66-dc8a-4825-9f1d-62d67fa07ab4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:05.650043 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 150/298] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:23:05 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 25 02:23:05.664261 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-47a54a66-dc8a-4825-9f1d-62d67fa07ab4 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:23:05.665758 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-47a54a66-dc8a-4825-9f1d-62d67fa07ab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:23:05.667218 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80428afd-374f-49c7-81a6-c913b5ce5bca None None] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:05.667516 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80428afd-374f-49c7-81a6-c913b5ce5bca None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:05.667847 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80428afd-374f-49c7-81a6-c913b5ce5bca None None] PATH_INFO: `/` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:05.669746 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 151/299] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:23:05 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jan 25 02:23:05.670312 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80428afd-374f-49c7-81a6-c913b5ce5bca None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:05.677376 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 149/300] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:23:05 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 25 02:23:05.678204 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a54a66-dc8a-4825-9f1d-62d67fa07ab4 None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:05.687213 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a54a66-dc8a-4825-9f1d-62d67fa07ab4 None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:05.687463 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80428afd-374f-49c7-81a6-c913b5ce5bca None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:05.691439 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bcad80-8a60-48ad-a3c2-f0da6ccdd754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:05.691556 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c893a460-8b62-4c9f-886f-870034eec554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:05.692249 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bcad80-8a60-48ad-a3c2-f0da6ccdd754 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:05.692345 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c893a460-8b62-4c9f-886f-870034eec554 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:05.692534 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bcad80-8a60-48ad-a3c2-f0da6ccdd754 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:05.692627 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c893a460-8b62-4c9f-886f-870034eec554 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:05.692808 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bcad80-8a60-48ad-a3c2-f0da6ccdd754 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:05.692901 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c893a460-8b62-4c9f-886f-870034eec554 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:05.703918 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bcad80-8a60-48ad-a3c2-f0da6ccdd754 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 25 02:23:05.704060 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c893a460-8b62-4c9f-886f-870034eec554 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 25 02:23:05.710792 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: WARNING keystone.server.flask.application [None req-c893a460-8b62-4c9f-886f-870034eec554 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jan 25 02:23:05.710897 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: WARNING keystone.server.flask.application [None req-54bcad80-8a60-48ad-a3c2-f0da6ccdd754 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 25 02:23:05.711994 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 150/302] 10.222.0.117 () {56 vars in 1125 bytes} [Tue Jan 25 02:23:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:23:05.717497 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 152/302] 10.222.0.117 () {56 vars in 1125 bytes} [Tue Jan 25 02:23:05 2022] GET /identity/v3/roles/reader => generated 84 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:23:05.717497 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c893a460-8b62-4c9f-886f-870034eec554 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:05.717647 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4d9360-1a86-4cce-9093-4d78aab9c674 None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:05.717647 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4d9360-1a86-4cce-9093-4d78aab9c674 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:05.717647 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4d9360-1a86-4cce-9093-4d78aab9c674 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:05.726560 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c893a460-8b62-4c9f-886f-870034eec554 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:05.731493 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c926040d-78fb-4970-8528-6f84311762e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:05.732293 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c926040d-78fb-4970-8528-6f84311762e2 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:05.732576 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c926040d-78fb-4970-8528-6f84311762e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:05.732855 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c926040d-78fb-4970-8528-6f84311762e2 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:05.733836 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-6b4d9360-1a86-4cce-9093-4d78aab9c674 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:23:05.734042 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c926040d-78fb-4970-8528-6f84311762e2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:05.735011 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-6b4d9360-1a86-4cce-9093-4d78aab9c674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:23:05.735761 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c926040d-78fb-4970-8528-6f84311762e2 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:05.737330 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 153/303] 10.222.0.117 () {56 vars in 1134 bytes} [Tue Jan 25 02:23:05 2022] GET /identity/v3/domains/default => generated 200 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:05.738069 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c926040d-78fb-4970-8528-6f84311762e2 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:05.742468 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 151/304] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:23:05 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 25 02:23:05.743230 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4d9360-1a86-4cce-9093-4d78aab9c674 None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:05.748687 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c926040d-78fb-4970-8528-6f84311762e2 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:05.752504 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4d9360-1a86-4cce-9093-4d78aab9c674 None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:05.753354 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b5348e-8513-46e9-a3fb-a930f710537e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:05.754178 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b5348e-8513-46e9-a3fb-a930f710537e admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:05.754659 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b5348e-8513-46e9-a3fb-a930f710537e admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:05.755111 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b5348e-8513-46e9-a3fb-a930f710537e admin admin] PATH_INFO: `/v3/roles` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:05.756068 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b5348e-8513-46e9-a3fb-a930f710537e admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:05.756540 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b5348e-8513-46e9-a3fb-a930f710537e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:05.756716 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24b68f4-005c-4fb3-9525-44c0adf58110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:05.757343 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24b68f4-005c-4fb3-9525-44c0adf58110 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:05.757621 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24b68f4-005c-4fb3-9525-44c0adf58110 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:05.757897 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24b68f4-005c-4fb3-9525-44c0adf58110 admin admin] PATH_INFO: `/v3/roles` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:05.758647 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24b68f4-005c-4fb3-9525-44c0adf58110 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:05.758948 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24b68f4-005c-4fb3-9525-44c0adf58110 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:05.759357 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b5348e-8513-46e9-a3fb-a930f710537e admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:05.760560 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24b68f4-005c-4fb3-9525-44c0adf58110 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:05.768290 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 154/305] 10.222.0.117 () {56 vars in 1127 bytes} [Tue Jan 25 02:23:05 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:05.768680 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 152/306] 10.222.0.117 () {56 vars in 1127 bytes} [Tue Jan 25 02:23:05 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:05.769475 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24b68f4-005c-4fb3-9525-44c0adf58110 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:05.769604 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b5348e-8513-46e9-a3fb-a930f710537e admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:05.779040 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b5348e-8513-46e9-a3fb-a930f710537e admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:05.781556 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24b68f4-005c-4fb3-9525-44c0adf58110 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:05.783313 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722f4ab5-ba56-4c9b-bd99-5704cc3464b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:05.783992 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722f4ab5-ba56-4c9b-bd99-5704cc3464b6 admin admin] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:05.784280 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722f4ab5-ba56-4c9b-bd99-5704cc3464b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:05.784557 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722f4ab5-ba56-4c9b-bd99-5704cc3464b6 admin admin] PATH_INFO: `/v3/groups` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:05.785252 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722f4ab5-ba56-4c9b-bd99-5704cc3464b6 admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:05.785759 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108378e4-cac3-4736-a8c9-f6469412b440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:05.786294 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: WARNING py.warnings [None req-722f4ab5-ba56-4c9b-bd99-5704cc3464b6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 25 02:23:05.786294 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: warnings.warn(msg) Jan 25 02:23:05.786294 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: Jan 25 02:23:05.786510 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108378e4-cac3-4736-a8c9-f6469412b440 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:05.786786 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108378e4-cac3-4736-a8c9-f6469412b440 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:05.787062 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108378e4-cac3-4736-a8c9-f6469412b440 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:05.787466 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722f4ab5-ba56-4c9b-bd99-5704cc3464b6 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:05.797851 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108378e4-cac3-4736-a8c9-f6469412b440 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 25 02:23:05.801931 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 155/307] 10.222.0.117 () {60 vars in 1160 bytes} [Tue Jan 25 02:23:05 2022] POST /identity/v3/groups => generated 230 bytes in 33 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 02:23:05.802712 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722f4ab5-ba56-4c9b-bd99-5704cc3464b6 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:05.805955 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: WARNING keystone.server.flask.application [None req-108378e4-cac3-4736-a8c9-f6469412b440 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jan 25 02:23:05.807232 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 153/308] 10.222.0.117 () {56 vars in 1125 bytes} [Tue Jan 25 02:23:05 2022] GET /identity/v3/roles/reader => generated 84 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:23:05.808055 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108378e4-cac3-4736-a8c9-f6469412b440 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:05.813686 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722f4ab5-ba56-4c9b-bd99-5704cc3464b6 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:05.818873 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67eba774-02c7-47bf-abb2-bcefe4e7acfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:05.820123 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eba774-02c7-47bf-abb2-bcefe4e7acfe admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:05.820467 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eba774-02c7-47bf-abb2-bcefe4e7acfe admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:05.820750 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eba774-02c7-47bf-abb2-bcefe4e7acfe admin admin] PATH_INFO: `/v3/users/072b06358eaf4b878fc378c53be1be81` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:05.822139 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67eba774-02c7-47bf-abb2-bcefe4e7acfe admin admin] RBAC: Authorizing `identity:get_user(user_id=072b06358eaf4b878fc378c53be1be81)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:05.823902 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108378e4-cac3-4736-a8c9-f6469412b440 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:05.825205 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67eba774-02c7-47bf-abb2-bcefe4e7acfe admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:05.831598 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 156/309] 10.222.0.117 () {56 vars in 1203 bytes} [Tue Jan 25 02:23:05 2022] GET /identity/v3/users/072b06358eaf4b878fc378c53be1be81 => generated 298 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:05.831598 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67eba774-02c7-47bf-abb2-bcefe4e7acfe admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:05.834507 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0a93e1-4eb1-4a71-b216-9abf66c9def6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:05.835399 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0a93e1-4eb1-4a71-b216-9abf66c9def6 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:05.835681 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0a93e1-4eb1-4a71-b216-9abf66c9def6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:05.836004 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0a93e1-4eb1-4a71-b216-9abf66c9def6 admin admin] PATH_INFO: `/v3/users/7d307b6e47b94ea1a93b3aba8cbdcff8` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:05.837287 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0a93e1-4eb1-4a71-b216-9abf66c9def6 admin admin] RBAC: Authorizing `identity:get_user(user_id=7d307b6e47b94ea1a93b3aba8cbdcff8)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:05.839460 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0a93e1-4eb1-4a71-b216-9abf66c9def6 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:05.842075 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 154/310] 10.222.0.117 () {56 vars in 1203 bytes} [Tue Jan 25 02:23:05 2022] GET /identity/v3/users/7d307b6e47b94ea1a93b3aba8cbdcff8 => generated 294 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:05.843074 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67eba774-02c7-47bf-abb2-bcefe4e7acfe admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:05.843182 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0a93e1-4eb1-4a71-b216-9abf66c9def6 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:05.847757 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b650be52-02bc-42e7-b9cf-6c8f8c331fa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:05.848440 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b650be52-02bc-42e7-b9cf-6c8f8c331fa5 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:05.848725 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b650be52-02bc-42e7-b9cf-6c8f8c331fa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:05.849005 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b650be52-02bc-42e7-b9cf-6c8f8c331fa5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:05.849789 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b650be52-02bc-42e7-b9cf-6c8f8c331fa5 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:05.850099 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b650be52-02bc-42e7-b9cf-6c8f8c331fa5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:05.851809 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b650be52-02bc-42e7-b9cf-6c8f8c331fa5 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:05.853286 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0a93e1-4eb1-4a71-b216-9abf66c9def6 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:05.858175 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c30994-f7f6-445f-80f3-fb24a41e6ffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:05.858858 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c30994-f7f6-445f-80f3-fb24a41e6ffe admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:05.859121 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c30994-f7f6-445f-80f3-fb24a41e6ffe admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:05.859396 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c30994-f7f6-445f-80f3-fb24a41e6ffe admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:05.865105 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 157/311] 10.222.0.117 () {56 vars in 1127 bytes} [Tue Jan 25 02:23:05 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:05.866230 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b650be52-02bc-42e7-b9cf-6c8f8c331fa5 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:05.873232 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c30994-f7f6-445f-80f3-fb24a41e6ffe admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:05.875205 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c30994-f7f6-445f-80f3-fb24a41e6ffe admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:05.876893 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b650be52-02bc-42e7-b9cf-6c8f8c331fa5 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:05.881475 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50094d6-d471-4727-b0d3-1553a0b0f1f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:05.882355 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50094d6-d471-4727-b0d3-1553a0b0f1f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:05.882640 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50094d6-d471-4727-b0d3-1553a0b0f1f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:05.882921 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50094d6-d471-4727-b0d3-1553a0b0f1f1 admin admin] PATH_INFO: `/v3/system/users/7d307b6e47b94ea1a93b3aba8cbdcff8/roles/33a8e87420ed423f9cb29e0084eab5d2` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:05.884655 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50094d6-d471-4727-b0d3-1553a0b0f1f1 admin admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=7d307b6e47b94ea1a93b3aba8cbdcff8, role_id=33a8e87420ed423f9cb29e0084eab5d2)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:05.890513 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 155/312] 10.222.0.117 () {58 vars in 1329 bytes} [Tue Jan 25 02:23:05 2022] GET /identity/v3/auth/tokens => generated 915 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 25 02:23:05.890752 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: WARNING py.warnings [None req-c50094d6-d471-4727-b0d3-1553a0b0f1f1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_system_grant_for_user": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 25 02:23:05.890752 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: warnings.warn(msg) Jan 25 02:23:05.890752 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: Jan 25 02:23:05.891435 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c30994-f7f6-445f-80f3-fb24a41e6ffe admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:05.891531 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50094d6-d471-4727-b0d3-1553a0b0f1f1 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:05.897718 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 158/313] 10.222.0.117 () {58 vars in 1360 bytes} [Tue Jan 25 02:23:05 2022] PUT /identity/v3/system/users/7d307b6e47b94ea1a93b3aba8cbdcff8/roles/33a8e87420ed423f9cb29e0084eab5d2 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:23:05.898698 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50094d6-d471-4727-b0d3-1553a0b0f1f1 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:05.908084 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c30994-f7f6-445f-80f3-fb24a41e6ffe admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:05.909994 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50094d6-d471-4727-b0d3-1553a0b0f1f1 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:05.914532 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11118337-6290-495f-b2ef-975923113715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:05.914785 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3abadc-326d-4d50-9f1b-f2154119a7a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:05.915584 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3abadc-326d-4d50-9f1b-f2154119a7a0 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:05.915906 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3abadc-326d-4d50-9f1b-f2154119a7a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:05.916187 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3abadc-326d-4d50-9f1b-f2154119a7a0 admin admin] PATH_INFO: `/v3/projects/711fe35d158f4285974b4184777b46ac` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:05.916727 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11118337-6290-495f-b2ef-975923113715 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:05.917367 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11118337-6290-495f-b2ef-975923113715 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:05.917864 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3abadc-326d-4d50-9f1b-f2154119a7a0 admin admin] RBAC: Authorizing `identity:get_project(project_id=711fe35d158f4285974b4184777b46ac)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:05.918429 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11118337-6290-495f-b2ef-975923113715 admin admin] PATH_INFO: `/v3/users/b51434525bb947729ef1d6351d6b8ada` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:05.920708 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3abadc-326d-4d50-9f1b-f2154119a7a0 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:05.927798 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 159/314] 10.222.0.117 () {56 vars in 1212 bytes} [Tue Jan 25 02:23:05 2022] GET /identity/v3/projects/711fe35d158f4285974b4184777b46ac => generated 303 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:05.932142 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3abadc-326d-4d50-9f1b-f2154119a7a0 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:05.943179 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11118337-6290-495f-b2ef-975923113715 admin admin] RBAC: Authorizing `identity:get_user(user_id=b51434525bb947729ef1d6351d6b8ada)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:05.944206 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3abadc-326d-4d50-9f1b-f2154119a7a0 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:05.946363 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11118337-6290-495f-b2ef-975923113715 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:05.948941 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 156/315] 10.222.0.117 () {56 vars in 1203 bytes} [Tue Jan 25 02:23:05 2022] GET /identity/v3/users/b51434525bb947729ef1d6351d6b8ada => generated 294 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:05.950363 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20feb5f-2f97-41c0-8f51-b0dc844e2b87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:05.951349 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20feb5f-2f97-41c0-8f51-b0dc844e2b87 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:05.951824 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20feb5f-2f97-41c0-8f51-b0dc844e2b87 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:05.952239 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20feb5f-2f97-41c0-8f51-b0dc844e2b87 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:05.953256 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20feb5f-2f97-41c0-8f51-b0dc844e2b87 admin admin] RBAC: Adding query filter params (role.id=3f17a45b07a243abb2d3005961a5d648, scope.project.id=711fe35d158f4285974b4184777b46ac, user.id=072b06358eaf4b878fc378c53be1be81) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:05.953728 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20feb5f-2f97-41c0-8f51-b0dc844e2b87 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:05.955874 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20feb5f-2f97-41c0-8f51-b0dc844e2b87 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:05.958840 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11118337-6290-495f-b2ef-975923113715 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:05.963910 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 160/316] 10.222.0.117 () {56 vars in 1400 bytes} [Tue Jan 25 02:23:05 2022] GET /identity/v3/role_assignments?user.id=072b06358eaf4b878fc378c53be1be81&scope.project.id=711fe35d158f4285974b4184777b46ac&role.id=3f17a45b07a243abb2d3005961a5d648 => generated 610 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:05.980464 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11118337-6290-495f-b2ef-975923113715 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:05.989235 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59c8c9f-ae32-45df-9c2e-e937e339c4e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:05.989924 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59c8c9f-ae32-45df-9c2e-e937e339c4e3 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:05.990209 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59c8c9f-ae32-45df-9c2e-e937e339c4e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:05.990486 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59c8c9f-ae32-45df-9c2e-e937e339c4e3 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:05.991363 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59c8c9f-ae32-45df-9c2e-e937e339c4e3 admin admin] RBAC: Adding query filter params (role.id=3f17a45b07a243abb2d3005961a5d648, user.id=b51434525bb947729ef1d6351d6b8ada, scope.system=all) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:05.991680 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59c8c9f-ae32-45df-9c2e-e937e339c4e3 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:05.993671 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59c8c9f-ae32-45df-9c2e-e937e339c4e3 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:06.007688 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 157/317] 10.222.0.117 () {56 vars in 1334 bytes} [Tue Jan 25 02:23:05 2022] GET /identity/v3/role_assignments?user.id=b51434525bb947729ef1d6351d6b8ada&scope.system=all&role.id=3f17a45b07a243abb2d3005961a5d648 => generated 227 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:08.121057 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b2ba10-2a75-40c5-a052-6e530e5bee35 None None] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:08.121565 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b2ba10-2a75-40c5-a052-6e530e5bee35 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:08.121639 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b2ba10-2a75-40c5-a052-6e530e5bee35 None None] PATH_INFO: `/` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:08.123523 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 161/318] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:23:08 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:23:08.128638 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6859b143-613e-44de-9f0b-50ad648862aa None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:08.129222 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6859b143-613e-44de-9f0b-50ad648862aa None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:08.129222 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6859b143-613e-44de-9f0b-50ad648862aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:08.141324 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afe13e3-7ff1-4e1c-98df-1e22c21e0a10 None None] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:08.141611 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afe13e3-7ff1-4e1c-98df-1e22c21e0a10 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:08.141886 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afe13e3-7ff1-4e1c-98df-1e22c21e0a10 None None] PATH_INFO: `/` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:08.143813 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 162/319] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:23:08 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jan 25 02:23:08.148194 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-6859b143-613e-44de-9f0b-50ad648862aa None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:23:08.148666 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d112294e-c691-40c9-984f-8aada87dbcdb None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:08.148948 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d112294e-c691-40c9-984f-8aada87dbcdb None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:08.149222 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d112294e-c691-40c9-984f-8aada87dbcdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:08.149391 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-6859b143-613e-44de-9f0b-50ad648862aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:23:08.158898 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 158/320] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:23:08 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 25 02:23:08.169585 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-d112294e-c691-40c9-984f-8aada87dbcdb None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:23:08.170762 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-d112294e-c691-40c9-984f-8aada87dbcdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:23:08.178241 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 163/321] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:23:08 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 25 02:23:08.181556 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6859b143-613e-44de-9f0b-50ad648862aa None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:08.190552 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6859b143-613e-44de-9f0b-50ad648862aa None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:08.194808 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cdebb0-b39f-4bdc-a683-892ee90acb3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:08.195589 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cdebb0-b39f-4bdc-a683-892ee90acb3f admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:08.195904 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cdebb0-b39f-4bdc-a683-892ee90acb3f admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:08.196181 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cdebb0-b39f-4bdc-a683-892ee90acb3f admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:08.197352 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cdebb0-b39f-4bdc-a683-892ee90acb3f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:08.199619 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cdebb0-b39f-4bdc-a683-892ee90acb3f admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:08.201344 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 159/322] 10.222.0.117 () {56 vars in 1134 bytes} [Tue Jan 25 02:23:08 2022] GET /identity/v3/domains/default => generated 200 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:08.202460 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d112294e-c691-40c9-984f-8aada87dbcdb None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:08.206337 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cdebb0-b39f-4bdc-a683-892ee90acb3f admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:08.211503 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d112294e-c691-40c9-984f-8aada87dbcdb None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:08.215873 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cdebb0-b39f-4bdc-a683-892ee90acb3f admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:08.216645 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4414b3-6789-49db-999b-0cdcc2f15c4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:08.217551 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4414b3-6789-49db-999b-0cdcc2f15c4d admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:08.217836 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4414b3-6789-49db-999b-0cdcc2f15c4d admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:08.218145 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4414b3-6789-49db-999b-0cdcc2f15c4d admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:08.220627 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29d9796-9be6-410e-9901-49f24a9b0979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:08.221278 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29d9796-9be6-410e-9901-49f24a9b0979 admin admin] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:08.221561 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29d9796-9be6-410e-9901-49f24a9b0979 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:08.221835 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29d9796-9be6-410e-9901-49f24a9b0979 admin admin] PATH_INFO: `/v3/groups` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:08.222536 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29d9796-9be6-410e-9901-49f24a9b0979 admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:08.223562 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: WARNING py.warnings [None req-b29d9796-9be6-410e-9901-49f24a9b0979 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 25 02:23:08.223562 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: warnings.warn(msg) Jan 25 02:23:08.223562 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: Jan 25 02:23:08.224776 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29d9796-9be6-410e-9901-49f24a9b0979 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:08.228759 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4414b3-6789-49db-999b-0cdcc2f15c4d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 25 02:23:08.235679 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: WARNING keystone.server.flask.application [None req-df4414b3-6789-49db-999b-0cdcc2f15c4d admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 25 02:23:08.236901 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 164/323] 10.222.0.117 () {56 vars in 1125 bytes} [Tue Jan 25 02:23:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:23:08.238115 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa73878-0a6c-40cc-aa47-ca29d709b32a None None] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:08.238397 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa73878-0a6c-40cc-aa47-ca29d709b32a None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:08.238670 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa73878-0a6c-40cc-aa47-ca29d709b32a None None] PATH_INFO: `/` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:08.243758 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 160/324] 10.222.0.117 () {60 vars in 1160 bytes} [Tue Jan 25 02:23:08 2022] POST /identity/v3/groups => generated 227 bytes in 33 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 25 02:23:08.243983 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 165/325] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:23:08 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:23:08.244064 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29d9796-9be6-410e-9901-49f24a9b0979 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:08.245521 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae65d70-57eb-4785-9f14-60b3641d16a8 None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:08.246348 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae65d70-57eb-4785-9f14-60b3641d16a8 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:08.246630 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae65d70-57eb-4785-9f14-60b3641d16a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:08.254396 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29d9796-9be6-410e-9901-49f24a9b0979 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:08.258860 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984197a4-5913-4d44-b7df-00c10719d2b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:08.259733 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984197a4-5913-4d44-b7df-00c10719d2b5 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:08.259890 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984197a4-5913-4d44-b7df-00c10719d2b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:08.260276 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984197a4-5913-4d44-b7df-00c10719d2b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:08.260906 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984197a4-5913-4d44-b7df-00c10719d2b5 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:08.261217 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984197a4-5913-4d44-b7df-00c10719d2b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:08.263949 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984197a4-5913-4d44-b7df-00c10719d2b5 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:08.266263 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-fae65d70-57eb-4785-9f14-60b3641d16a8 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:23:08.267483 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-fae65d70-57eb-4785-9f14-60b3641d16a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:23:08.278436 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 161/326] 10.222.0.117 () {56 vars in 1127 bytes} [Tue Jan 25 02:23:08 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:08.280035 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 166/327] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:23:08 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 25 02:23:08.280150 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984197a4-5913-4d44-b7df-00c10719d2b5 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:08.290330 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984197a4-5913-4d44-b7df-00c10719d2b5 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:08.295037 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741507ec-959a-45e6-baca-41287e5226f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:08.295959 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741507ec-959a-45e6-baca-41287e5226f1 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:08.296244 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741507ec-959a-45e6-baca-41287e5226f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:08.296522 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741507ec-959a-45e6-baca-41287e5226f1 admin admin] PATH_INFO: `/v3/users/7d307b6e47b94ea1a93b3aba8cbdcff8` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:08.297830 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741507ec-959a-45e6-baca-41287e5226f1 admin admin] RBAC: Authorizing `identity:get_user(user_id=7d307b6e47b94ea1a93b3aba8cbdcff8)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:08.300081 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741507ec-959a-45e6-baca-41287e5226f1 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:08.302380 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 162/328] 10.222.0.117 () {56 vars in 1203 bytes} [Tue Jan 25 02:23:08 2022] GET /identity/v3/users/7d307b6e47b94ea1a93b3aba8cbdcff8 => generated 294 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 02:23:08.303132 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae65d70-57eb-4785-9f14-60b3641d16a8 None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:08.308112 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741507ec-959a-45e6-baca-41287e5226f1 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:08.313309 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae65d70-57eb-4785-9f14-60b3641d16a8 None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:08.317867 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb371c0-2b14-46ee-ad48-3a37a2daedbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:08.318678 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb371c0-2b14-46ee-ad48-3a37a2daedbd admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:08.318961 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb371c0-2b14-46ee-ad48-3a37a2daedbd admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:08.319057 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741507ec-959a-45e6-baca-41287e5226f1 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:08.319235 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb371c0-2b14-46ee-ad48-3a37a2daedbd admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:08.326257 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4714dab-8e3f-4a80-b709-53f86e3c5dc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:08.326985 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4714dab-8e3f-4a80-b709-53f86e3c5dc4 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:08.327272 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4714dab-8e3f-4a80-b709-53f86e3c5dc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:08.327544 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4714dab-8e3f-4a80-b709-53f86e3c5dc4 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:08.328456 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4714dab-8e3f-4a80-b709-53f86e3c5dc4 admin admin] RBAC: Adding query filter params (role.id=33a8e87420ed423f9cb29e0084eab5d2, user.id=7d307b6e47b94ea1a93b3aba8cbdcff8, scope.system=all) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:08.329091 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4714dab-8e3f-4a80-b709-53f86e3c5dc4 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:08.330874 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4714dab-8e3f-4a80-b709-53f86e3c5dc4 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:08.332821 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb371c0-2b14-46ee-ad48-3a37a2daedbd admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 25 02:23:08.340773 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: WARNING keystone.server.flask.application [None req-1bb371c0-2b14-46ee-ad48-3a37a2daedbd admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jan 25 02:23:08.343732 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 167/329] 10.222.0.117 () {56 vars in 1125 bytes} [Tue Jan 25 02:23:08 2022] GET /identity/v3/roles/reader => generated 84 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 25 02:23:08.348366 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb371c0-2b14-46ee-ad48-3a37a2daedbd admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:08.359733 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 163/330] 10.222.0.117 () {56 vars in 1334 bytes} [Tue Jan 25 02:23:08 2022] GET /identity/v3/role_assignments?user.id=7d307b6e47b94ea1a93b3aba8cbdcff8&scope.system=all&role.id=33a8e87420ed423f9cb29e0084eab5d2 => generated 512 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 02:23:08.361806 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb371c0-2b14-46ee-ad48-3a37a2daedbd admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:08.366431 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ee3f82-365d-463a-b96b-7d0c0ffc4a11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:08.367116 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ee3f82-365d-463a-b96b-7d0c0ffc4a11 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:08.367398 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ee3f82-365d-463a-b96b-7d0c0ffc4a11 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:08.367672 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ee3f82-365d-463a-b96b-7d0c0ffc4a11 admin admin] PATH_INFO: `/v3/roles` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:08.368525 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ee3f82-365d-463a-b96b-7d0c0ffc4a11 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:08.368836 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ee3f82-365d-463a-b96b-7d0c0ffc4a11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:08.370615 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ee3f82-365d-463a-b96b-7d0c0ffc4a11 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:08.381674 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 168/331] 10.222.0.117 () {56 vars in 1127 bytes} [Tue Jan 25 02:23:08 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 02:23:08.388122 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4714dab-8e3f-4a80-b709-53f86e3c5dc4 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:08.398723 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4714dab-8e3f-4a80-b709-53f86e3c5dc4 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:08.403400 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bff9bb-892d-4f86-97b2-ba9f54a7bb02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:08.404417 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bff9bb-892d-4f86-97b2-ba9f54a7bb02 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:08.404772 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bff9bb-892d-4f86-97b2-ba9f54a7bb02 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:08.405115 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bff9bb-892d-4f86-97b2-ba9f54a7bb02 admin admin] PATH_INFO: `/v3/users/b51434525bb947729ef1d6351d6b8ada` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:08.406508 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bff9bb-892d-4f86-97b2-ba9f54a7bb02 admin admin] RBAC: Authorizing `identity:get_user(user_id=b51434525bb947729ef1d6351d6b8ada)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:08.408820 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bff9bb-892d-4f86-97b2-ba9f54a7bb02 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:08.410863 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 164/332] 10.222.0.117 () {56 vars in 1203 bytes} [Tue Jan 25 02:23:08 2022] GET /identity/v3/users/b51434525bb947729ef1d6351d6b8ada => generated 294 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 02:23:08.416691 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ee3f82-365d-463a-b96b-7d0c0ffc4a11 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:08.427543 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ee3f82-365d-463a-b96b-7d0c0ffc4a11 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:08.432185 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746112b3-e2a4-4517-a303-c740752d8252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:08.433098 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746112b3-e2a4-4517-a303-c740752d8252 admin admin] REQUEST_METHOD: `PUT` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:08.434045 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746112b3-e2a4-4517-a303-c740752d8252 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:08.434333 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746112b3-e2a4-4517-a303-c740752d8252 admin admin] PATH_INFO: `/v3/system/users/b51434525bb947729ef1d6351d6b8ada/roles/3f17a45b07a243abb2d3005961a5d648` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:08.435978 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746112b3-e2a4-4517-a303-c740752d8252 admin admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=b51434525bb947729ef1d6351d6b8ada, role_id=3f17a45b07a243abb2d3005961a5d648)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:08.437625 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746112b3-e2a4-4517-a303-c740752d8252 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:08.445684 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 169/333] 10.222.0.117 () {58 vars in 1360 bytes} [Tue Jan 25 02:23:08 2022] PUT /identity/v3/system/users/b51434525bb947729ef1d6351d6b8ada/roles/3f17a45b07a243abb2d3005961a5d648 => generated 0 bytes in 29 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:23:11.050990 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd23d71-e64a-4d2f-9fd4-d92f9815616c None None] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:11.052070 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd23d71-e64a-4d2f-9fd4-d92f9815616c None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:11.052581 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd23d71-e64a-4d2f-9fd4-d92f9815616c None None] PATH_INFO: `/` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:11.054781 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 165/334] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:23:11 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:23:11.065467 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f4637a-f87b-4e51-aee8-c4a46d90c770 None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:11.066403 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f4637a-f87b-4e51-aee8-c4a46d90c770 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:11.066899 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f4637a-f87b-4e51-aee8-c4a46d90c770 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:11.092650 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-29f4637a-f87b-4e51-aee8-c4a46d90c770 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:23:11.094184 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-29f4637a-f87b-4e51-aee8-c4a46d90c770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:23:11.102246 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 170/335] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:23:11 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 25 02:23:11.147165 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd23d71-e64a-4d2f-9fd4-d92f9815616c None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:11.165726 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd23d71-e64a-4d2f-9fd4-d92f9815616c None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:11.171736 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ba4b20-a47e-409e-ae83-c0426af12933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:11.172768 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ba4b20-a47e-409e-ae83-c0426af12933 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:11.173251 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ba4b20-a47e-409e-ae83-c0426af12933 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:11.173731 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ba4b20-a47e-409e-ae83-c0426af12933 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:11.190346 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ba4b20-a47e-409e-ae83-c0426af12933 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 25 02:23:11.198372 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: WARNING keystone.server.flask.application [None req-d1ba4b20-a47e-409e-ae83-c0426af12933 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jan 25 02:23:11.200786 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 166/336] 10.222.0.117 () {56 vars in 1125 bytes} [Tue Jan 25 02:23:11 2022] GET /identity/v3/roles/reader => generated 84 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:23:11.206719 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f4637a-f87b-4e51-aee8-c4a46d90c770 None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:11.220306 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f4637a-f87b-4e51-aee8-c4a46d90c770 None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:11.227686 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b694bdb-4022-4cb2-9a15-33d139ca0e96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:11.228680 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b694bdb-4022-4cb2-9a15-33d139ca0e96 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:11.229179 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b694bdb-4022-4cb2-9a15-33d139ca0e96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:11.229651 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b694bdb-4022-4cb2-9a15-33d139ca0e96 admin admin] PATH_INFO: `/v3/roles` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:11.231543 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b694bdb-4022-4cb2-9a15-33d139ca0e96 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:11.232081 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b694bdb-4022-4cb2-9a15-33d139ca0e96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:11.233906 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b694bdb-4022-4cb2-9a15-33d139ca0e96 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:11.248761 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 171/337] 10.222.0.117 () {56 vars in 1127 bytes} [Tue Jan 25 02:23:11 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:11.256929 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ba4b20-a47e-409e-ae83-c0426af12933 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:11.269899 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ba4b20-a47e-409e-ae83-c0426af12933 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:11.274823 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a58915-3277-4311-9661-1903f6ea7f70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:11.276031 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a58915-3277-4311-9661-1903f6ea7f70 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:11.276522 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a58915-3277-4311-9661-1903f6ea7f70 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:11.277521 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a58915-3277-4311-9661-1903f6ea7f70 admin admin] PATH_INFO: `/v3/users/b51434525bb947729ef1d6351d6b8ada` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:11.279785 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a58915-3277-4311-9661-1903f6ea7f70 admin admin] RBAC: Authorizing `identity:get_user(user_id=b51434525bb947729ef1d6351d6b8ada)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:11.282246 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a58915-3277-4311-9661-1903f6ea7f70 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:11.284300 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 167/338] 10.222.0.117 () {56 vars in 1203 bytes} [Tue Jan 25 02:23:11 2022] GET /identity/v3/users/b51434525bb947729ef1d6351d6b8ada => generated 294 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:11.290349 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b694bdb-4022-4cb2-9a15-33d139ca0e96 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:11.302739 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b694bdb-4022-4cb2-9a15-33d139ca0e96 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:11.312650 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a651963e-78c6-4dbe-ac24-3ebd751b92c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:11.313686 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a651963e-78c6-4dbe-ac24-3ebd751b92c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:11.314171 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a651963e-78c6-4dbe-ac24-3ebd751b92c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:11.314644 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a651963e-78c6-4dbe-ac24-3ebd751b92c2 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:11.315683 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a651963e-78c6-4dbe-ac24-3ebd751b92c2 admin admin] RBAC: Adding query filter params (role.id=3f17a45b07a243abb2d3005961a5d648, user.id=b51434525bb947729ef1d6351d6b8ada, scope.system=all) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:11.316236 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a651963e-78c6-4dbe-ac24-3ebd751b92c2 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:11.318638 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a651963e-78c6-4dbe-ac24-3ebd751b92c2 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:11.338199 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 172/339] 10.222.0.117 () {56 vars in 1334 bytes} [Tue Jan 25 02:23:11 2022] GET /identity/v3/role_assignments?user.id=b51434525bb947729ef1d6351d6b8ada&scope.system=all&role.id=3f17a45b07a243abb2d3005961a5d648 => generated 512 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:11.459796 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e84d485-2e2e-47e9-8f6e-b8173b37bc0c None None] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:11.460515 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e84d485-2e2e-47e9-8f6e-b8173b37bc0c None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:11.461030 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e84d485-2e2e-47e9-8f6e-b8173b37bc0c None None] PATH_INFO: `/` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:11.463044 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 168/340] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:23:11 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:23:11.469003 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bdf548-a823-4b7c-830c-ec57b98c7fdf None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:11.469608 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bdf548-a823-4b7c-830c-ec57b98c7fdf None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:11.470083 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bdf548-a823-4b7c-830c-ec57b98c7fdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:11.494465 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-c7bdf548-a823-4b7c-830c-ec57b98c7fdf None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:23:11.496581 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-c7bdf548-a823-4b7c-830c-ec57b98c7fdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:23:11.513287 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 173/341] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:23:11 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 25 02:23:11.554895 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e84d485-2e2e-47e9-8f6e-b8173b37bc0c None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:11.570343 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8647795c-ce71-4c5c-b708-eba64f91b579 None None] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:11.572054 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8647795c-ce71-4c5c-b708-eba64f91b579 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:11.572690 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8647795c-ce71-4c5c-b708-eba64f91b579 None None] PATH_INFO: `/` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:11.577098 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 174/342] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:23:11 2022] GET /identity => generated 271 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:23:11.578885 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e84d485-2e2e-47e9-8f6e-b8173b37bc0c None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:11.583201 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8971c3d5-e999-44d9-baf4-db6e58e1f00f None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:11.583756 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8971c3d5-e999-44d9-baf4-db6e58e1f00f None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:11.584234 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8971c3d5-e999-44d9-baf4-db6e58e1f00f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:11.596693 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ba57a7-5bcc-489e-b5f4-f0c7b8283245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:11.599099 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ba57a7-5bcc-489e-b5f4-f0c7b8283245 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:11.599611 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ba57a7-5bcc-489e-b5f4-f0c7b8283245 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:11.601735 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ba57a7-5bcc-489e-b5f4-f0c7b8283245 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:11.633453 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-8971c3d5-e999-44d9-baf4-db6e58e1f00f None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:23:11.634399 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ba57a7-5bcc-489e-b5f4-f0c7b8283245 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 25 02:23:11.646666 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-8971c3d5-e999-44d9-baf4-db6e58e1f00f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:23:11.651483 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: WARNING keystone.server.flask.application [None req-46ba57a7-5bcc-489e-b5f4-f0c7b8283245 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 25 02:23:11.658125 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 169/343] 10.222.0.117 () {56 vars in 1125 bytes} [Tue Jan 25 02:23:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 104 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:23:11.660812 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 175/344] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:23:11 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 25 02:23:11.664995 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ba57a7-5bcc-489e-b5f4-f0c7b8283245 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:11.681144 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ba57a7-5bcc-489e-b5f4-f0c7b8283245 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:11.687427 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b96c7f-f2af-40c6-abd1-fc04275c5d99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:11.688118 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b96c7f-f2af-40c6-abd1-fc04275c5d99 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:11.688398 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b96c7f-f2af-40c6-abd1-fc04275c5d99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:11.688669 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b96c7f-f2af-40c6-abd1-fc04275c5d99 admin admin] PATH_INFO: `/v3/roles` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:11.689442 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b96c7f-f2af-40c6-abd1-fc04275c5d99 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:11.689733 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b96c7f-f2af-40c6-abd1-fc04275c5d99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:11.691334 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b96c7f-f2af-40c6-abd1-fc04275c5d99 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:11.701776 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8971c3d5-e999-44d9-baf4-db6e58e1f00f None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:11.710931 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8971c3d5-e999-44d9-baf4-db6e58e1f00f None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:11.720153 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 170/345] 10.222.0.117 () {56 vars in 1127 bytes} [Tue Jan 25 02:23:11 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:11.723246 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4128c987-471b-40cf-a7ad-a9359e5a0d4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:11.724079 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4128c987-471b-40cf-a7ad-a9359e5a0d4d admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:11.724356 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4128c987-471b-40cf-a7ad-a9359e5a0d4d admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:11.724628 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4128c987-471b-40cf-a7ad-a9359e5a0d4d admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:11.726160 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b96c7f-f2af-40c6-abd1-fc04275c5d99 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:11.750805 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4128c987-471b-40cf-a7ad-a9359e5a0d4d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 25 02:23:11.764249 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b96c7f-f2af-40c6-abd1-fc04275c5d99 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:11.768730 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9cb932-28d6-4c26-861f-5a0ffb308a61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:11.769386 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9cb932-28d6-4c26-861f-5a0ffb308a61 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:11.769663 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9cb932-28d6-4c26-861f-5a0ffb308a61 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:11.769932 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9cb932-28d6-4c26-861f-5a0ffb308a61 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:11.771425 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: WARNING keystone.server.flask.application [None req-4128c987-471b-40cf-a7ad-a9359e5a0d4d admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 25 02:23:11.772713 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 176/346] 10.222.0.117 () {56 vars in 1125 bytes} [Tue Jan 25 02:23:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 25 02:23:11.779870 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4128c987-471b-40cf-a7ad-a9359e5a0d4d admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:11.789375 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9cb932-28d6-4c26-861f-5a0ffb308a61 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:11.791143 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9cb932-28d6-4c26-861f-5a0ffb308a61 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:11.799788 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4128c987-471b-40cf-a7ad-a9359e5a0d4d admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:11.806260 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 171/347] 10.222.0.117 () {58 vars in 1329 bytes} [Tue Jan 25 02:23:11 2022] GET /identity/v3/auth/tokens => generated 915 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jan 25 02:23:11.808783 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a7364e-f6db-42ea-a855-547a3ebd4895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:11.808783 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a7364e-f6db-42ea-a855-547a3ebd4895 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:11.808783 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a7364e-f6db-42ea-a855-547a3ebd4895 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:11.808783 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a7364e-f6db-42ea-a855-547a3ebd4895 admin admin] PATH_INFO: `/v3/roles` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:11.810001 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a7364e-f6db-42ea-a855-547a3ebd4895 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:11.812256 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9cb932-28d6-4c26-861f-5a0ffb308a61 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:11.815939 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a7364e-f6db-42ea-a855-547a3ebd4895 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:11.817826 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a7364e-f6db-42ea-a855-547a3ebd4895 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:11.826039 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9cb932-28d6-4c26-861f-5a0ffb308a61 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:11.830474 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 177/348] 10.222.0.117 () {56 vars in 1127 bytes} [Tue Jan 25 02:23:11 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:11.837141 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6eb2ab-cc41-4ad3-9e6e-4a36a8d84f64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:11.838316 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6eb2ab-cc41-4ad3-9e6e-4a36a8d84f64 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:11.838802 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6eb2ab-cc41-4ad3-9e6e-4a36a8d84f64 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:11.839324 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6eb2ab-cc41-4ad3-9e6e-4a36a8d84f64 admin admin] PATH_INFO: `/v3/projects/26e358bfb5294c7f9855f86b5dbeedac` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:11.841836 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6eb2ab-cc41-4ad3-9e6e-4a36a8d84f64 admin admin] RBAC: Authorizing `identity:get_project(project_id=26e358bfb5294c7f9855f86b5dbeedac)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:11.844268 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6eb2ab-cc41-4ad3-9e6e-4a36a8d84f64 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:11.846848 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 172/349] 10.222.0.117 () {56 vars in 1212 bytes} [Tue Jan 25 02:23:11 2022] GET /identity/v3/projects/26e358bfb5294c7f9855f86b5dbeedac => generated 299 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 02:23:11.849625 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a7364e-f6db-42ea-a855-547a3ebd4895 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:11.858983 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6eb2ab-cc41-4ad3-9e6e-4a36a8d84f64 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:11.861438 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a7364e-f6db-42ea-a855-547a3ebd4895 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:11.873800 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec08dbeb-3e73-445c-89d9-581baa9ce286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:11.874869 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec08dbeb-3e73-445c-89d9-581baa9ce286 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:11.875886 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec08dbeb-3e73-445c-89d9-581baa9ce286 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:11.876619 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec08dbeb-3e73-445c-89d9-581baa9ce286 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:11.887207 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6eb2ab-cc41-4ad3-9e6e-4a36a8d84f64 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:11.902035 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc44f360-4f92-47d7-a9ea-bbc5de979ae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:11.905189 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec08dbeb-3e73-445c-89d9-581baa9ce286 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:11.907223 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc44f360-4f92-47d7-a9ea-bbc5de979ae3 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:11.907840 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc44f360-4f92-47d7-a9ea-bbc5de979ae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:11.908390 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc44f360-4f92-47d7-a9ea-bbc5de979ae3 admin admin] PATH_INFO: `/v3/groups/22728d139c334673858eb9e957f09bc5` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:11.910443 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec08dbeb-3e73-445c-89d9-581baa9ce286 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:11.922602 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc44f360-4f92-47d7-a9ea-bbc5de979ae3 admin admin] RBAC: Authorizing `identity:get_group(group_id=22728d139c334673858eb9e957f09bc5)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:11.924093 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: WARNING py.warnings [None req-bc44f360-4f92-47d7-a9ea-bbc5de979ae3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 25 02:23:11.924093 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: warnings.warn(msg) Jan 25 02:23:11.924093 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: Jan 25 02:23:11.925733 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc44f360-4f92-47d7-a9ea-bbc5de979ae3 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:11.927643 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 173/351] 10.222.0.117 () {56 vars in 1206 bytes} [Tue Jan 25 02:23:11 2022] GET /identity/v3/groups/22728d139c334673858eb9e957f09bc5 => generated 227 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:11.927796 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 178/351] 10.222.0.117 () {58 vars in 1329 bytes} [Tue Jan 25 02:23:11 2022] GET /identity/v3/auth/tokens => generated 915 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 25 02:23:11.931780 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3731c9-8ace-463b-b877-dd90f3bf142d None None] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:11.931780 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3731c9-8ace-463b-b877-dd90f3bf142d None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:11.931780 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3731c9-8ace-463b-b877-dd90f3bf142d None None] PATH_INFO: `/` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:11.931780 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 179/352] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:23:11 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:23:11.934527 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc44f360-4f92-47d7-a9ea-bbc5de979ae3 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:11.936627 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3731c9-8ace-463b-b877-dd90f3bf142d None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:11.947418 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc44f360-4f92-47d7-a9ea-bbc5de979ae3 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:11.952370 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3731c9-8ace-463b-b877-dd90f3bf142d None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:11.955501 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d92e7aa-ceb4-4067-9c3b-0bb322826463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:11.956566 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d92e7aa-ceb4-4067-9c3b-0bb322826463 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:11.956686 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d92e7aa-ceb4-4067-9c3b-0bb322826463 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:11.956917 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d92e7aa-ceb4-4067-9c3b-0bb322826463 admin admin] PATH_INFO: `/v3/projects/711fe35d158f4285974b4184777b46ac` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:11.958111 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d92e7aa-ceb4-4067-9c3b-0bb322826463 admin admin] RBAC: Authorizing `identity:get_project(project_id=711fe35d158f4285974b4184777b46ac)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:11.958522 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee3325e-1d52-4b0a-b3b9-2182dada1099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:11.959425 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee3325e-1d52-4b0a-b3b9-2182dada1099 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:11.960228 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d92e7aa-ceb4-4067-9c3b-0bb322826463 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:11.960643 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee3325e-1d52-4b0a-b3b9-2182dada1099 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:11.961203 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee3325e-1d52-4b0a-b3b9-2182dada1099 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:11.961906 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 180/353] 10.222.0.117 () {56 vars in 1212 bytes} [Tue Jan 25 02:23:11 2022] GET /identity/v3/projects/711fe35d158f4285974b4184777b46ac => generated 303 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:11.962599 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee3325e-1d52-4b0a-b3b9-2182dada1099 admin admin] RBAC: Adding query filter params (group.id=22728d139c334673858eb9e957f09bc5, role.id=33a8e87420ed423f9cb29e0084eab5d2, scope.project.id=26e358bfb5294c7f9855f86b5dbeedac) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:11.963033 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4a1144-a300-4a2c-98ea-da98933034cf None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:11.963316 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4a1144-a300-4a2c-98ea-da98933034cf None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:11.963588 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4a1144-a300-4a2c-98ea-da98933034cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:11.963686 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee3325e-1d52-4b0a-b3b9-2182dada1099 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:11.966640 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee3325e-1d52-4b0a-b3b9-2182dada1099 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:11.973950 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 174/354] 10.222.0.117 () {56 vars in 1402 bytes} [Tue Jan 25 02:23:11 2022] GET /identity/v3/role_assignments?group.id=22728d139c334673858eb9e957f09bc5&scope.project.id=26e358bfb5294c7f9855f86b5dbeedac&role.id=33a8e87420ed423f9cb29e0084eab5d2 => generated 261 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:11.975167 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee3325e-1d52-4b0a-b3b9-2182dada1099 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:11.984163 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-ae4a1144-a300-4a2c-98ea-da98933034cf None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:23:11.985406 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-ae4a1144-a300-4a2c-98ea-da98933034cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:23:11.995790 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 181/355] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:23:11 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 25 02:23:12.000208 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee3325e-1d52-4b0a-b3b9-2182dada1099 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:12.017397 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cea88ec-a28c-4ef0-9e5b-12a1238d1347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:12.018711 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cea88ec-a28c-4ef0-9e5b-12a1238d1347 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:12.019246 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cea88ec-a28c-4ef0-9e5b-12a1238d1347 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:12.019353 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4a1144-a300-4a2c-98ea-da98933034cf None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:12.019923 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cea88ec-a28c-4ef0-9e5b-12a1238d1347 admin admin] PATH_INFO: `/v3/groups/22728d139c334673858eb9e957f09bc5` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:12.021600 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cea88ec-a28c-4ef0-9e5b-12a1238d1347 admin admin] RBAC: Authorizing `identity:get_group(group_id=22728d139c334673858eb9e957f09bc5)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:12.023902 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cea88ec-a28c-4ef0-9e5b-12a1238d1347 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:12.026222 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 175/356] 10.222.0.117 () {56 vars in 1206 bytes} [Tue Jan 25 02:23:11 2022] GET /identity/v3/groups/22728d139c334673858eb9e957f09bc5 => generated 227 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:12.030484 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4a1144-a300-4a2c-98ea-da98933034cf None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:12.034878 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cea88ec-a28c-4ef0-9e5b-12a1238d1347 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:12.035294 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28d7e3c-f53a-4e20-9cf7-06c787ac8906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:12.036161 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28d7e3c-f53a-4e20-9cf7-06c787ac8906 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:12.036445 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28d7e3c-f53a-4e20-9cf7-06c787ac8906 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:12.036720 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28d7e3c-f53a-4e20-9cf7-06c787ac8906 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:12.047208 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cea88ec-a28c-4ef0-9e5b-12a1238d1347 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:12.051720 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28d7e3c-f53a-4e20-9cf7-06c787ac8906 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 25 02:23:12.057307 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: WARNING keystone.server.flask.application [None req-e28d7e3c-f53a-4e20-9cf7-06c787ac8906 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jan 25 02:23:12.058548 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 182/357] 10.222.0.117 () {56 vars in 1140 bytes} [Tue Jan 25 02:23:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 25 02:23:12.059187 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d968b4-4d57-4011-9909-edf26c1b65c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:12.060449 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d968b4-4d57-4011-9909-edf26c1b65c5 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:12.060934 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d968b4-4d57-4011-9909-edf26c1b65c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:12.061500 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d968b4-4d57-4011-9909-edf26c1b65c5 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:12.062618 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d968b4-4d57-4011-9909-edf26c1b65c5 admin admin] RBAC: Adding query filter params (group.id=22728d139c334673858eb9e957f09bc5, role.id=33a8e87420ed423f9cb29e0084eab5d2, scope.project.id=711fe35d158f4285974b4184777b46ac) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:12.063138 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d968b4-4d57-4011-9909-edf26c1b65c5 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:12.064593 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28d7e3c-f53a-4e20-9cf7-06c787ac8906 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:12.065943 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d968b4-4d57-4011-9909-edf26c1b65c5 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:12.075685 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28d7e3c-f53a-4e20-9cf7-06c787ac8906 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:12.078670 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 176/358] 10.222.0.117 () {56 vars in 1402 bytes} [Tue Jan 25 02:23:12 2022] GET /identity/v3/role_assignments?group.id=22728d139c334673858eb9e957f09bc5&scope.project.id=711fe35d158f4285974b4184777b46ac&role.id=33a8e87420ed423f9cb29e0084eab5d2 => generated 261 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 02:23:12.080656 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20b3c27-1ae1-4752-bd0d-5d2fb8625c68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:12.081340 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20b3c27-1ae1-4752-bd0d-5d2fb8625c68 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:12.081620 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20b3c27-1ae1-4752-bd0d-5d2fb8625c68 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:12.081895 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20b3c27-1ae1-4752-bd0d-5d2fb8625c68 admin admin] PATH_INFO: `/v3/roles` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:12.082698 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20b3c27-1ae1-4752-bd0d-5d2fb8625c68 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:12.083001 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20b3c27-1ae1-4752-bd0d-5d2fb8625c68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:12.084969 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20b3c27-1ae1-4752-bd0d-5d2fb8625c68 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:12.096555 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 183/359] 10.222.0.117 () {56 vars in 1137 bytes} [Tue Jan 25 02:23:12 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 02:23:12.102231 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d968b4-4d57-4011-9909-edf26c1b65c5 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:12.117995 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d968b4-4d57-4011-9909-edf26c1b65c5 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:12.123368 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8630de4-9aaa-4156-b29b-af87d9405aa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:12.124442 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8630de4-9aaa-4156-b29b-af87d9405aa7 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:12.124963 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8630de4-9aaa-4156-b29b-af87d9405aa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:12.125475 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8630de4-9aaa-4156-b29b-af87d9405aa7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:12.135966 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8630de4-9aaa-4156-b29b-af87d9405aa7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:12.138446 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8630de4-9aaa-4156-b29b-af87d9405aa7 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:12.153706 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 177/360] 10.222.0.117 () {58 vars in 1329 bytes} [Tue Jan 25 02:23:12 2022] GET /identity/v3/auth/tokens => generated 915 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 25 02:23:12.160306 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20b3c27-1ae1-4752-bd0d-5d2fb8625c68 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:12.173059 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20b3c27-1ae1-4752-bd0d-5d2fb8625c68 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:12.177803 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4147773d-0291-4067-83d2-6c29e662eb2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:12.178765 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4147773d-0291-4067-83d2-6c29e662eb2d admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:12.179100 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4147773d-0291-4067-83d2-6c29e662eb2d admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:12.179377 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4147773d-0291-4067-83d2-6c29e662eb2d admin admin] PATH_INFO: `/v3/projects/26e358bfb5294c7f9855f86b5dbeedac` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:12.180970 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4147773d-0291-4067-83d2-6c29e662eb2d admin admin] RBAC: Authorizing `identity:get_project(project_id=26e358bfb5294c7f9855f86b5dbeedac)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:12.183109 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4147773d-0291-4067-83d2-6c29e662eb2d admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:12.185590 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 184/361] 10.222.0.117 () {56 vars in 1212 bytes} [Tue Jan 25 02:23:12 2022] GET /identity/v3/projects/26e358bfb5294c7f9855f86b5dbeedac => generated 299 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:12.191307 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8630de4-9aaa-4156-b29b-af87d9405aa7 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:12.201754 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8630de4-9aaa-4156-b29b-af87d9405aa7 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:12.208078 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f3030e-08b3-4103-8e48-b5a8a0a988a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:12.208963 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f3030e-08b3-4103-8e48-b5a8a0a988a4 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:12.209293 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f3030e-08b3-4103-8e48-b5a8a0a988a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:12.209565 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f3030e-08b3-4103-8e48-b5a8a0a988a4 admin admin] PATH_INFO: `/v3/groups/22728d139c334673858eb9e957f09bc5` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:12.210897 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f3030e-08b3-4103-8e48-b5a8a0a988a4 admin admin] RBAC: Authorizing `identity:get_group(group_id=22728d139c334673858eb9e957f09bc5)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:12.212986 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f3030e-08b3-4103-8e48-b5a8a0a988a4 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:12.215121 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 178/362] 10.222.0.117 () {56 vars in 1206 bytes} [Tue Jan 25 02:23:12 2022] GET /identity/v3/groups/22728d139c334673858eb9e957f09bc5 => generated 227 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:12.221333 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4147773d-0291-4067-83d2-6c29e662eb2d admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:12.232118 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4147773d-0291-4067-83d2-6c29e662eb2d admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:12.236972 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdd7091-ea18-45f5-8f66-e33df192ede3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:12.237697 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdd7091-ea18-45f5-8f66-e33df192ede3 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:12.237981 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdd7091-ea18-45f5-8f66-e33df192ede3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:12.238258 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdd7091-ea18-45f5-8f66-e33df192ede3 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:12.239181 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdd7091-ea18-45f5-8f66-e33df192ede3 admin admin] RBAC: Adding query filter params (group.id=22728d139c334673858eb9e957f09bc5, role.id=259d005f63d5455d8728277d6385bfba, scope.project.id=26e358bfb5294c7f9855f86b5dbeedac) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:12.239493 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdd7091-ea18-45f5-8f66-e33df192ede3 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:12.241497 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdd7091-ea18-45f5-8f66-e33df192ede3 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:12.249372 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 185/363] 10.222.0.117 () {56 vars in 1402 bytes} [Tue Jan 25 02:23:12 2022] GET /identity/v3/role_assignments?group.id=22728d139c334673858eb9e957f09bc5&scope.project.id=26e358bfb5294c7f9855f86b5dbeedac&role.id=259d005f63d5455d8728277d6385bfba => generated 261 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:12.637968 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf2ef09-2e9e-4c64-bbc4-d14b48ed6065 None None] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:12.638332 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf2ef09-2e9e-4c64-bbc4-d14b48ed6065 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:12.638531 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf2ef09-2e9e-4c64-bbc4-d14b48ed6065 None None] PATH_INFO: `/` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:12.640561 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 179/364] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:23:12 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:23:12.646097 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b76c577-c74d-413e-afc8-78210aa2ea77 None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:12.646387 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b76c577-c74d-413e-afc8-78210aa2ea77 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:12.646666 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b76c577-c74d-413e-afc8-78210aa2ea77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:12.665311 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-7b76c577-c74d-413e-afc8-78210aa2ea77 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:23:12.666514 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-7b76c577-c74d-413e-afc8-78210aa2ea77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:23:12.677230 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 186/365] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:23:12 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 25 02:23:12.701875 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf2ef09-2e9e-4c64-bbc4-d14b48ed6065 None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:12.714170 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf2ef09-2e9e-4c64-bbc4-d14b48ed6065 None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:12.719158 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a181c71-e46f-4db8-aea8-709aa24942b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:12.720023 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a181c71-e46f-4db8-aea8-709aa24942b2 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:12.720555 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a181c71-e46f-4db8-aea8-709aa24942b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:12.720935 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a181c71-e46f-4db8-aea8-709aa24942b2 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:12.736479 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a181c71-e46f-4db8-aea8-709aa24942b2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 25 02:23:12.743962 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: WARNING keystone.server.flask.application [None req-8a181c71-e46f-4db8-aea8-709aa24942b2 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jan 25 02:23:12.745530 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 180/366] 10.222.0.117 () {56 vars in 1140 bytes} [Tue Jan 25 02:23:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:23:12.751729 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b76c577-c74d-413e-afc8-78210aa2ea77 None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:12.761118 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b76c577-c74d-413e-afc8-78210aa2ea77 None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:12.771723 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8194ee20-d43f-42f8-a644-b5a53a15e8f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:12.772404 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8194ee20-d43f-42f8-a644-b5a53a15e8f1 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:12.772686 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8194ee20-d43f-42f8-a644-b5a53a15e8f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:12.772957 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8194ee20-d43f-42f8-a644-b5a53a15e8f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:12.773729 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8194ee20-d43f-42f8-a644-b5a53a15e8f1 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:12.774033 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8194ee20-d43f-42f8-a644-b5a53a15e8f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:12.775796 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8194ee20-d43f-42f8-a644-b5a53a15e8f1 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:12.789312 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 187/367] 10.222.0.117 () {56 vars in 1137 bytes} [Tue Jan 25 02:23:12 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:12.795270 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a181c71-e46f-4db8-aea8-709aa24942b2 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:12.807454 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a181c71-e46f-4db8-aea8-709aa24942b2 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:12.813157 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377beef3-855a-4351-99fc-e5938b9a462d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:12.813853 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377beef3-855a-4351-99fc-e5938b9a462d admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:12.814191 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377beef3-855a-4351-99fc-e5938b9a462d admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:12.814469 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377beef3-855a-4351-99fc-e5938b9a462d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:12.825143 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377beef3-855a-4351-99fc-e5938b9a462d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:12.826988 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377beef3-855a-4351-99fc-e5938b9a462d admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:12.837715 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 181/368] 10.222.0.117 () {58 vars in 1329 bytes} [Tue Jan 25 02:23:12 2022] GET /identity/v3/auth/tokens => generated 915 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 25 02:23:12.844048 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8194ee20-d43f-42f8-a644-b5a53a15e8f1 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:12.854425 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8194ee20-d43f-42f8-a644-b5a53a15e8f1 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:12.865928 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a66c288-01c3-4348-947e-b31fbdde86c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:12.866859 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a66c288-01c3-4348-947e-b31fbdde86c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:12.867138 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a66c288-01c3-4348-947e-b31fbdde86c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:12.867457 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a66c288-01c3-4348-947e-b31fbdde86c2 admin admin] PATH_INFO: `/v3/projects/711fe35d158f4285974b4184777b46ac` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:12.868757 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a66c288-01c3-4348-947e-b31fbdde86c2 admin admin] RBAC: Authorizing `identity:get_project(project_id=711fe35d158f4285974b4184777b46ac)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:12.871482 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a66c288-01c3-4348-947e-b31fbdde86c2 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:12.873571 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 188/369] 10.222.0.117 () {56 vars in 1212 bytes} [Tue Jan 25 02:23:12 2022] GET /identity/v3/projects/711fe35d158f4285974b4184777b46ac => generated 303 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:12.878838 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377beef3-855a-4351-99fc-e5938b9a462d admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:12.888182 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377beef3-855a-4351-99fc-e5938b9a462d admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:12.899919 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3482b97e-b4c7-4980-9134-f89bba5b88b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:12.900785 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3482b97e-b4c7-4980-9134-f89bba5b88b1 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:12.901070 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3482b97e-b4c7-4980-9134-f89bba5b88b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:12.901348 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3482b97e-b4c7-4980-9134-f89bba5b88b1 admin admin] PATH_INFO: `/v3/groups/22728d139c334673858eb9e957f09bc5` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:12.908421 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3482b97e-b4c7-4980-9134-f89bba5b88b1 admin admin] RBAC: Authorizing `identity:get_group(group_id=22728d139c334673858eb9e957f09bc5)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:12.910373 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3482b97e-b4c7-4980-9134-f89bba5b88b1 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:12.912362 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 182/370] 10.222.0.117 () {56 vars in 1206 bytes} [Tue Jan 25 02:23:12 2022] GET /identity/v3/groups/22728d139c334673858eb9e957f09bc5 => generated 227 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:12.918839 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a66c288-01c3-4348-947e-b31fbdde86c2 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:12.932614 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a66c288-01c3-4348-947e-b31fbdde86c2 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:12.939415 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c453ea8a-6b93-4bda-b73d-1f4eb70a25a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:12.940134 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c453ea8a-6b93-4bda-b73d-1f4eb70a25a7 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:12.940396 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c453ea8a-6b93-4bda-b73d-1f4eb70a25a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:12.940729 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c453ea8a-6b93-4bda-b73d-1f4eb70a25a7 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:12.941672 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c453ea8a-6b93-4bda-b73d-1f4eb70a25a7 admin admin] RBAC: Adding query filter params (group.id=22728d139c334673858eb9e957f09bc5, role.id=259d005f63d5455d8728277d6385bfba, scope.project.id=711fe35d158f4285974b4184777b46ac) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:12.941981 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c453ea8a-6b93-4bda-b73d-1f4eb70a25a7 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:12.944106 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c453ea8a-6b93-4bda-b73d-1f4eb70a25a7 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:12.956635 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 189/371] 10.222.0.117 () {56 vars in 1402 bytes} [Tue Jan 25 02:23:12 2022] GET /identity/v3/role_assignments?group.id=22728d139c334673858eb9e957f09bc5&scope.project.id=711fe35d158f4285974b4184777b46ac&role.id=259d005f63d5455d8728277d6385bfba => generated 261 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:13.299373 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4eb7a7-374f-4019-b554-6d8f17f77ed1 None None] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:13.300075 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4eb7a7-374f-4019-b554-6d8f17f77ed1 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:13.300075 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4eb7a7-374f-4019-b554-6d8f17f77ed1 None None] PATH_INFO: `/` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:13.301861 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 183/372] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:23:13 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:23:13.307078 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca4edc6-7cce-4089-92c4-1d40827f28d7 None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:13.307569 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca4edc6-7cce-4089-92c4-1d40827f28d7 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:13.307745 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca4edc6-7cce-4089-92c4-1d40827f28d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:13.327169 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-8ca4edc6-7cce-4089-92c4-1d40827f28d7 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:23:13.328401 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-8ca4edc6-7cce-4089-92c4-1d40827f28d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:23:13.336424 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 190/373] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:23:13 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 25 02:23:13.361149 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4eb7a7-374f-4019-b554-6d8f17f77ed1 None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:13.374591 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4eb7a7-374f-4019-b554-6d8f17f77ed1 None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:13.379120 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2140d400-64b3-4c79-9117-d62abb49ff66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:13.379990 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2140d400-64b3-4c79-9117-d62abb49ff66 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:13.380273 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2140d400-64b3-4c79-9117-d62abb49ff66 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:13.380544 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2140d400-64b3-4c79-9117-d62abb49ff66 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:13.393046 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2140d400-64b3-4c79-9117-d62abb49ff66 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 25 02:23:13.400120 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: WARNING keystone.server.flask.application [None req-2140d400-64b3-4c79-9117-d62abb49ff66 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 25 02:23:13.401686 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 184/374] 10.222.0.117 () {56 vars in 1122 bytes} [Tue Jan 25 02:23:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:23:13.408136 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca4edc6-7cce-4089-92c4-1d40827f28d7 None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:13.417551 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca4edc6-7cce-4089-92c4-1d40827f28d7 None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:13.422301 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7fa138-3af3-4dc7-a5bc-648bf989ff22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:13.422976 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7fa138-3af3-4dc7-a5bc-648bf989ff22 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:13.423256 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7fa138-3af3-4dc7-a5bc-648bf989ff22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:13.423532 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7fa138-3af3-4dc7-a5bc-648bf989ff22 admin admin] PATH_INFO: `/v3/roles` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:13.424347 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7fa138-3af3-4dc7-a5bc-648bf989ff22 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:13.424707 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7fa138-3af3-4dc7-a5bc-648bf989ff22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:13.426377 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7fa138-3af3-4dc7-a5bc-648bf989ff22 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:13.435917 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 191/375] 10.222.0.117 () {56 vars in 1125 bytes} [Tue Jan 25 02:23:13 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:13.442428 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2140d400-64b3-4c79-9117-d62abb49ff66 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:13.454085 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2140d400-64b3-4c79-9117-d62abb49ff66 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:13.458670 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8633c12-a365-42d6-8613-754bb491645a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:13.459358 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8633c12-a365-42d6-8613-754bb491645a admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:13.459645 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8633c12-a365-42d6-8613-754bb491645a admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:13.460054 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8633c12-a365-42d6-8613-754bb491645a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:13.470804 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8633c12-a365-42d6-8613-754bb491645a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:13.472663 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8633c12-a365-42d6-8613-754bb491645a admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:13.484351 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 185/376] 10.222.0.117 () {58 vars in 1329 bytes} [Tue Jan 25 02:23:13 2022] GET /identity/v3/auth/tokens => generated 915 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 25 02:23:13.489863 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7fa138-3af3-4dc7-a5bc-648bf989ff22 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:13.500866 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7fa138-3af3-4dc7-a5bc-648bf989ff22 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:13.505376 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935c875b-b5a6-4766-9f60-11bdfdf831ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:13.506332 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935c875b-b5a6-4766-9f60-11bdfdf831ea admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:13.506611 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935c875b-b5a6-4766-9f60-11bdfdf831ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:13.506886 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935c875b-b5a6-4766-9f60-11bdfdf831ea admin admin] PATH_INFO: `/v3/projects/705a3c6650674528a0096768eea3fe81` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:13.508174 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935c875b-b5a6-4766-9f60-11bdfdf831ea admin admin] RBAC: Authorizing `identity:get_project(project_id=705a3c6650674528a0096768eea3fe81)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:13.510206 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935c875b-b5a6-4766-9f60-11bdfdf831ea admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:13.513011 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 192/377] 10.222.0.117 () {56 vars in 1212 bytes} [Tue Jan 25 02:23:13 2022] GET /identity/v3/projects/705a3c6650674528a0096768eea3fe81 => generated 345 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:13.518561 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8633c12-a365-42d6-8613-754bb491645a admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:13.528371 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8633c12-a365-42d6-8613-754bb491645a admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:13.533021 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503e5678-9776-40ef-bbc5-d709222290f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:13.533965 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503e5678-9776-40ef-bbc5-d709222290f7 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:13.534248 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503e5678-9776-40ef-bbc5-d709222290f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:13.534525 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503e5678-9776-40ef-bbc5-d709222290f7 admin admin] PATH_INFO: `/v3/groups/d01cae825f3c469996dfee7eeb82048c` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:13.539800 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503e5678-9776-40ef-bbc5-d709222290f7 admin admin] RBAC: Authorizing `identity:get_group(group_id=d01cae825f3c469996dfee7eeb82048c)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:13.541833 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503e5678-9776-40ef-bbc5-d709222290f7 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:13.544193 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 186/378] 10.222.0.117 () {56 vars in 1206 bytes} [Tue Jan 25 02:23:13 2022] GET /identity/v3/groups/d01cae825f3c469996dfee7eeb82048c => generated 230 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:13.549974 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935c875b-b5a6-4766-9f60-11bdfdf831ea admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:13.561085 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935c875b-b5a6-4766-9f60-11bdfdf831ea admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:13.565871 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87c5fe9-8bd5-4c9b-98e7-9b98a99b85ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:13.566584 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87c5fe9-8bd5-4c9b-98e7-9b98a99b85ec admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:13.566864 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87c5fe9-8bd5-4c9b-98e7-9b98a99b85ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:13.567185 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87c5fe9-8bd5-4c9b-98e7-9b98a99b85ec admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:13.568073 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87c5fe9-8bd5-4c9b-98e7-9b98a99b85ec admin admin] RBAC: Adding query filter params (group.id=d01cae825f3c469996dfee7eeb82048c, role.id=d8dbc6d83d9d41d28c3feb8b3485b291, scope.project.id=705a3c6650674528a0096768eea3fe81) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:13.568434 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87c5fe9-8bd5-4c9b-98e7-9b98a99b85ec admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:13.570399 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87c5fe9-8bd5-4c9b-98e7-9b98a99b85ec admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:13.577903 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 193/379] 10.222.0.117 () {56 vars in 1402 bytes} [Tue Jan 25 02:23:13 2022] GET /identity/v3/role_assignments?group.id=d01cae825f3c469996dfee7eeb82048c&scope.project.id=705a3c6650674528a0096768eea3fe81&role.id=d8dbc6d83d9d41d28c3feb8b3485b291 => generated 261 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:15.161127 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21910c6-2a33-46ee-b754-6a835b1176cb None None] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:15.161969 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21910c6-2a33-46ee-b754-6a835b1176cb None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:15.162439 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21910c6-2a33-46ee-b754-6a835b1176cb None None] PATH_INFO: `/` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:15.164676 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 187/380] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:23:15 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:23:15.171143 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690482fb-e7d2-4a68-a477-d834e059fe6c None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:15.172015 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690482fb-e7d2-4a68-a477-d834e059fe6c None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:15.172435 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690482fb-e7d2-4a68-a477-d834e059fe6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:15.191946 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-690482fb-e7d2-4a68-a477-d834e059fe6c None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:23:15.193353 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-690482fb-e7d2-4a68-a477-d834e059fe6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:23:15.205935 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 194/381] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:23:15 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 25 02:23:15.248017 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21910c6-2a33-46ee-b754-6a835b1176cb None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:15.266333 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21910c6-2a33-46ee-b754-6a835b1176cb None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:15.274648 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e652f9e8-1949-4043-8640-8c119da015ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:15.275635 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e652f9e8-1949-4043-8640-8c119da015ef admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:15.276110 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e652f9e8-1949-4043-8640-8c119da015ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:15.276525 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e652f9e8-1949-4043-8640-8c119da015ef admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:15.298953 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e652f9e8-1949-4043-8640-8c119da015ef admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 25 02:23:15.306587 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: WARNING keystone.server.flask.application [None req-e652f9e8-1949-4043-8640-8c119da015ef admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jan 25 02:23:15.308926 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 188/382] 10.222.0.117 () {56 vars in 1140 bytes} [Tue Jan 25 02:23:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:23:15.315026 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690482fb-e7d2-4a68-a477-d834e059fe6c None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:15.325261 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690482fb-e7d2-4a68-a477-d834e059fe6c None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:15.332095 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8974366-62f8-4304-95d2-077127e04cbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:15.332944 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8974366-62f8-4304-95d2-077127e04cbd admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:15.333391 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8974366-62f8-4304-95d2-077127e04cbd admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:15.333803 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8974366-62f8-4304-95d2-077127e04cbd admin admin] PATH_INFO: `/v3/roles` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:15.334713 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8974366-62f8-4304-95d2-077127e04cbd admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:15.335160 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8974366-62f8-4304-95d2-077127e04cbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:15.337253 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b915ab95-f986-4411-8c69-f56b023ac694 None None] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:15.337687 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b915ab95-f986-4411-8c69-f56b023ac694 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:15.338126 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b915ab95-f986-4411-8c69-f56b023ac694 None None] PATH_INFO: `/` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:15.340751 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 189/383] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:23:15 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:23:15.342297 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8974366-62f8-4304-95d2-077127e04cbd admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:15.346400 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a28ef55-a029-4a0c-9658-935f388ce7a9 None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:15.346857 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a28ef55-a029-4a0c-9658-935f388ce7a9 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:15.347286 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a28ef55-a029-4a0c-9658-935f388ce7a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:15.366890 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 195/384] 10.222.0.117 () {56 vars in 1137 bytes} [Tue Jan 25 02:23:15 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:15.372443 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8974366-62f8-4304-95d2-077127e04cbd admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:15.382041 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-5a28ef55-a029-4a0c-9658-935f388ce7a9 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:23:15.383553 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-5a28ef55-a029-4a0c-9658-935f388ce7a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:23:15.393656 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8974366-62f8-4304-95d2-077127e04cbd admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:15.404959 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd045540-ef28-40d2-ab21-478f00d3dd51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:15.406079 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd045540-ef28-40d2-ab21-478f00d3dd51 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:15.406685 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 190/385] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:23:15 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 25 02:23:15.407132 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd045540-ef28-40d2-ab21-478f00d3dd51 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:15.407623 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd045540-ef28-40d2-ab21-478f00d3dd51 admin admin] PATH_INFO: `/v3/groups/22728d139c334673858eb9e957f09bc5` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:15.409071 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd045540-ef28-40d2-ab21-478f00d3dd51 admin admin] RBAC: Authorizing `identity:get_group(group_id=22728d139c334673858eb9e957f09bc5)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:15.410276 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: WARNING py.warnings [None req-cd045540-ef28-40d2-ab21-478f00d3dd51 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 25 02:23:15.410276 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: warnings.warn(msg) Jan 25 02:23:15.410276 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: Jan 25 02:23:15.411928 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd045540-ef28-40d2-ab21-478f00d3dd51 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:15.414287 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 196/386] 10.222.0.117 () {56 vars in 1206 bytes} [Tue Jan 25 02:23:15 2022] GET /identity/v3/groups/22728d139c334673858eb9e957f09bc5 => generated 227 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:15.419624 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a28ef55-a029-4a0c-9658-935f388ce7a9 None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:15.429547 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a28ef55-a029-4a0c-9658-935f388ce7a9 None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:15.435532 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd045540-ef28-40d2-ab21-478f00d3dd51 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:15.445276 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb1a03a-0b32-4b92-a3ca-9750ec2a2294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:15.447458 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd045540-ef28-40d2-ab21-478f00d3dd51 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:15.448524 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb1a03a-0b32-4b92-a3ca-9750ec2a2294 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:15.449635 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb1a03a-0b32-4b92-a3ca-9750ec2a2294 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:15.450852 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb1a03a-0b32-4b92-a3ca-9750ec2a2294 admin admin] PATH_INFO: `/v3/projects/26e358bfb5294c7f9855f86b5dbeedac` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:15.452961 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb1a03a-0b32-4b92-a3ca-9750ec2a2294 admin admin] RBAC: Authorizing `identity:get_project(project_id=26e358bfb5294c7f9855f86b5dbeedac)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:15.456058 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb1a03a-0b32-4b92-a3ca-9750ec2a2294 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:15.458418 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 191/387] 10.222.0.117 () {56 vars in 1212 bytes} [Tue Jan 25 02:23:15 2022] GET /identity/v3/projects/26e358bfb5294c7f9855f86b5dbeedac => generated 299 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:15.459801 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5ab6d2-7819-4daf-a543-b01da5a94c76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:15.461222 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5ab6d2-7819-4daf-a543-b01da5a94c76 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:15.461222 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5ab6d2-7819-4daf-a543-b01da5a94c76 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:15.461222 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5ab6d2-7819-4daf-a543-b01da5a94c76 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:15.465688 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb1a03a-0b32-4b92-a3ca-9750ec2a2294 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:15.483718 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5ab6d2-7819-4daf-a543-b01da5a94c76 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 25 02:23:15.489979 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb1a03a-0b32-4b92-a3ca-9750ec2a2294 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:15.497881 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: WARNING keystone.server.flask.application [None req-1e5ab6d2-7819-4daf-a543-b01da5a94c76 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 25 02:23:15.499208 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8053c9b-cccf-4cba-a409-31b04daf401a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:15.500408 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8053c9b-cccf-4cba-a409-31b04daf401a admin admin] REQUEST_METHOD: `PUT` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:15.500914 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8053c9b-cccf-4cba-a409-31b04daf401a admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:15.501596 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8053c9b-cccf-4cba-a409-31b04daf401a admin admin] PATH_INFO: `/v3/projects/26e358bfb5294c7f9855f86b5dbeedac/groups/22728d139c334673858eb9e957f09bc5/roles/259d005f63d5455d8728277d6385bfba` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:15.502911 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 197/388] 10.222.0.117 () {56 vars in 1125 bytes} [Tue Jan 25 02:23:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:23:15.505547 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8053c9b-cccf-4cba-a409-31b04daf401a admin admin] RBAC: Authorizing `identity:create_grant(project_id=26e358bfb5294c7f9855f86b5dbeedac, group_id=22728d139c334673858eb9e957f09bc5, role_id=259d005f63d5455d8728277d6385bfba)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:15.508583 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5ab6d2-7819-4daf-a543-b01da5a94c76 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:15.512690 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8053c9b-cccf-4cba-a409-31b04daf401a admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:15.523586 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5ab6d2-7819-4daf-a543-b01da5a94c76 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:15.530044 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cc223a-8128-4e83-8d97-62d324995210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:15.537035 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 192/389] 10.222.0.117 () {58 vars in 1468 bytes} [Tue Jan 25 02:23:15 2022] PUT /identity/v3/projects/26e358bfb5294c7f9855f86b5dbeedac/groups/22728d139c334673858eb9e957f09bc5/roles/259d005f63d5455d8728277d6385bfba => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:23:15.537547 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cc223a-8128-4e83-8d97-62d324995210 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:15.537972 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cc223a-8128-4e83-8d97-62d324995210 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:15.538436 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cc223a-8128-4e83-8d97-62d324995210 admin admin] PATH_INFO: `/v3/roles` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:15.539399 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cc223a-8128-4e83-8d97-62d324995210 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:15.539871 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cc223a-8128-4e83-8d97-62d324995210 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:15.541681 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cc223a-8128-4e83-8d97-62d324995210 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:15.552698 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 198/390] 10.222.0.117 () {56 vars in 1127 bytes} [Tue Jan 25 02:23:15 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 02:23:15.559182 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8053c9b-cccf-4cba-a409-31b04daf401a admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:15.636063 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8053c9b-cccf-4cba-a409-31b04daf401a admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:15.641373 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75c6cb5-d9bd-4bb7-b8ae-f1e9860429df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:15.642471 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75c6cb5-d9bd-4bb7-b8ae-f1e9860429df admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:15.642903 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75c6cb5-d9bd-4bb7-b8ae-f1e9860429df admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:15.643390 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75c6cb5-d9bd-4bb7-b8ae-f1e9860429df admin admin] PATH_INFO: `/v3/groups/22728d139c334673858eb9e957f09bc5` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:15.644811 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75c6cb5-d9bd-4bb7-b8ae-f1e9860429df admin admin] RBAC: Authorizing `identity:get_group(group_id=22728d139c334673858eb9e957f09bc5)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:15.646871 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75c6cb5-d9bd-4bb7-b8ae-f1e9860429df admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:15.648672 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 193/391] 10.222.0.117 () {56 vars in 1206 bytes} [Tue Jan 25 02:23:15 2022] GET /identity/v3/groups/22728d139c334673858eb9e957f09bc5 => generated 227 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:15.655473 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cc223a-8128-4e83-8d97-62d324995210 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:15.665844 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cc223a-8128-4e83-8d97-62d324995210 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:15.672739 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc18b492-eb09-46db-b878-60d00be02944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:15.673826 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc18b492-eb09-46db-b878-60d00be02944 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:15.674283 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc18b492-eb09-46db-b878-60d00be02944 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:15.674735 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc18b492-eb09-46db-b878-60d00be02944 admin admin] PATH_INFO: `/v3/projects/26e358bfb5294c7f9855f86b5dbeedac` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:15.676236 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc18b492-eb09-46db-b878-60d00be02944 admin admin] RBAC: Authorizing `identity:get_project(project_id=26e358bfb5294c7f9855f86b5dbeedac)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:15.679716 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc18b492-eb09-46db-b878-60d00be02944 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:15.680670 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 199/392] 10.222.0.117 () {56 vars in 1212 bytes} [Tue Jan 25 02:23:15 2022] GET /identity/v3/projects/26e358bfb5294c7f9855f86b5dbeedac => generated 299 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:15.686417 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75c6cb5-d9bd-4bb7-b8ae-f1e9860429df admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:15.697602 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75c6cb5-d9bd-4bb7-b8ae-f1e9860429df admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:15.702907 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10260b0-a8ad-4eba-a7ed-a94dba296d7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:15.703858 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10260b0-a8ad-4eba-a7ed-a94dba296d7f admin admin] REQUEST_METHOD: `PUT` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:15.704191 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10260b0-a8ad-4eba-a7ed-a94dba296d7f admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:15.704521 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10260b0-a8ad-4eba-a7ed-a94dba296d7f admin admin] PATH_INFO: `/v3/projects/26e358bfb5294c7f9855f86b5dbeedac/groups/22728d139c334673858eb9e957f09bc5/roles/33a8e87420ed423f9cb29e0084eab5d2` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:15.706600 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10260b0-a8ad-4eba-a7ed-a94dba296d7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=26e358bfb5294c7f9855f86b5dbeedac, group_id=22728d139c334673858eb9e957f09bc5, role_id=33a8e87420ed423f9cb29e0084eab5d2)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:15.709483 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10260b0-a8ad-4eba-a7ed-a94dba296d7f admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:15.733607 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c8de09-4c26-4712-9f96-b6b8e1690456 None None] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:15.733944 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c8de09-4c26-4712-9f96-b6b8e1690456 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:15.734228 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c8de09-4c26-4712-9f96-b6b8e1690456 None None] PATH_INFO: `/` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:15.736393 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 200/393] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:23:15 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:23:15.738735 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 194/394] 10.222.0.117 () {58 vars in 1468 bytes} [Tue Jan 25 02:23:15 2022] PUT /identity/v3/projects/26e358bfb5294c7f9855f86b5dbeedac/groups/22728d139c334673858eb9e957f09bc5/roles/33a8e87420ed423f9cb29e0084eab5d2 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:23:15.755535 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8dede7-2fbe-450f-99d1-94d7ea0fe315 None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:15.755911 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8dede7-2fbe-450f-99d1-94d7ea0fe315 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:15.756127 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8dede7-2fbe-450f-99d1-94d7ea0fe315 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:15.781175 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-fd8dede7-2fbe-450f-99d1-94d7ea0fe315 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:23:15.782534 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-fd8dede7-2fbe-450f-99d1-94d7ea0fe315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:23:15.864549 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 201/395] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:23:15 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 25 02:23:15.907016 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10260b0-a8ad-4eba-a7ed-a94dba296d7f admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:15.916954 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10260b0-a8ad-4eba-a7ed-a94dba296d7f admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:15.922430 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e60458-bcee-42bb-892c-2dd51bf83ff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:15.923297 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e60458-bcee-42bb-892c-2dd51bf83ff6 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:15.923583 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e60458-bcee-42bb-892c-2dd51bf83ff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:15.923880 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e60458-bcee-42bb-892c-2dd51bf83ff6 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:15.943089 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e60458-bcee-42bb-892c-2dd51bf83ff6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 25 02:23:15.951160 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: WARNING keystone.server.flask.application [None req-27e60458-bcee-42bb-892c-2dd51bf83ff6 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 25 02:23:15.952845 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 195/396] 10.222.0.117 () {56 vars in 1125 bytes} [Tue Jan 25 02:23:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:23:15.958708 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8dede7-2fbe-450f-99d1-94d7ea0fe315 None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:15.973489 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8dede7-2fbe-450f-99d1-94d7ea0fe315 None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:15.980666 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d1f416-219d-48bf-a75e-79d72db02176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:15.981784 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d1f416-219d-48bf-a75e-79d72db02176 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:15.982288 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d1f416-219d-48bf-a75e-79d72db02176 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:15.982771 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d1f416-219d-48bf-a75e-79d72db02176 admin admin] PATH_INFO: `/v3/roles` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:15.983801 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d1f416-219d-48bf-a75e-79d72db02176 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:15.984338 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d1f416-219d-48bf-a75e-79d72db02176 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:15.986198 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d1f416-219d-48bf-a75e-79d72db02176 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:15.996473 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 202/397] 10.222.0.117 () {56 vars in 1127 bytes} [Tue Jan 25 02:23:15 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:16.002141 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e60458-bcee-42bb-892c-2dd51bf83ff6 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:16.016900 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e60458-bcee-42bb-892c-2dd51bf83ff6 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:16.023089 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54f8d8e-b5c9-4798-84c5-c57ed5a2d35d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:16.024325 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54f8d8e-b5c9-4798-84c5-c57ed5a2d35d admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:16.024828 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54f8d8e-b5c9-4798-84c5-c57ed5a2d35d admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:16.025528 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54f8d8e-b5c9-4798-84c5-c57ed5a2d35d admin admin] PATH_INFO: `/v3/groups/22728d139c334673858eb9e957f09bc5` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:16.027920 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54f8d8e-b5c9-4798-84c5-c57ed5a2d35d admin admin] RBAC: Authorizing `identity:get_group(group_id=22728d139c334673858eb9e957f09bc5)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:16.030116 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54f8d8e-b5c9-4798-84c5-c57ed5a2d35d admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:16.032320 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 196/398] 10.222.0.117 () {56 vars in 1206 bytes} [Tue Jan 25 02:23:16 2022] GET /identity/v3/groups/22728d139c334673858eb9e957f09bc5 => generated 227 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:16.038209 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d1f416-219d-48bf-a75e-79d72db02176 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:16.051859 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d1f416-219d-48bf-a75e-79d72db02176 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:16.057814 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ce71a6-2f39-45b6-b04a-a1520ba64d78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:16.059487 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ce71a6-2f39-45b6-b04a-a1520ba64d78 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:16.060036 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ce71a6-2f39-45b6-b04a-a1520ba64d78 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:16.060536 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ce71a6-2f39-45b6-b04a-a1520ba64d78 admin admin] PATH_INFO: `/v3/projects/711fe35d158f4285974b4184777b46ac` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:16.061977 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ce71a6-2f39-45b6-b04a-a1520ba64d78 admin admin] RBAC: Authorizing `identity:get_project(project_id=711fe35d158f4285974b4184777b46ac)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:16.064397 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ce71a6-2f39-45b6-b04a-a1520ba64d78 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:16.066601 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 203/399] 10.222.0.117 () {56 vars in 1212 bytes} [Tue Jan 25 02:23:16 2022] GET /identity/v3/projects/711fe35d158f4285974b4184777b46ac => generated 303 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:16.072454 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54f8d8e-b5c9-4798-84c5-c57ed5a2d35d admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:16.084070 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aad1b8f-904d-4951-b448-dea12e60a8ad None None] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:16.084371 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aad1b8f-904d-4951-b448-dea12e60a8ad None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:16.084636 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aad1b8f-904d-4951-b448-dea12e60a8ad None None] PATH_INFO: `/` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:16.086717 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 204/400] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:23:16 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:23:16.087142 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54f8d8e-b5c9-4798-84c5-c57ed5a2d35d admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:16.092112 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f07bed3-3b8e-4e27-9926-00ebc5d7e891 None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:16.092402 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f07bed3-3b8e-4e27-9926-00ebc5d7e891 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:16.092686 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f07bed3-3b8e-4e27-9926-00ebc5d7e891 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:16.093013 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb74656b-d834-4335-95da-93ead7dbe96c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:16.094220 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb74656b-d834-4335-95da-93ead7dbe96c admin admin] REQUEST_METHOD: `PUT` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:16.094723 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb74656b-d834-4335-95da-93ead7dbe96c admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:16.095197 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb74656b-d834-4335-95da-93ead7dbe96c admin admin] PATH_INFO: `/v3/projects/711fe35d158f4285974b4184777b46ac/groups/22728d139c334673858eb9e957f09bc5/roles/33a8e87420ed423f9cb29e0084eab5d2` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:16.097709 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb74656b-d834-4335-95da-93ead7dbe96c admin admin] RBAC: Authorizing `identity:create_grant(project_id=711fe35d158f4285974b4184777b46ac, group_id=22728d139c334673858eb9e957f09bc5, role_id=33a8e87420ed423f9cb29e0084eab5d2)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:16.101834 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb74656b-d834-4335-95da-93ead7dbe96c admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:16.120665 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-8f07bed3-3b8e-4e27-9926-00ebc5d7e891 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:23:16.123208 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-8f07bed3-3b8e-4e27-9926-00ebc5d7e891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:23:16.129542 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 197/401] 10.222.0.117 () {58 vars in 1468 bytes} [Tue Jan 25 02:23:16 2022] PUT /identity/v3/projects/711fe35d158f4285974b4184777b46ac/groups/22728d139c334673858eb9e957f09bc5/roles/33a8e87420ed423f9cb29e0084eab5d2 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:23:16.130387 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a1e50b-2cd1-4690-8ccc-7a40dc85f02e None None] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:16.130678 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a1e50b-2cd1-4690-8ccc-7a40dc85f02e None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:16.130958 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a1e50b-2cd1-4690-8ccc-7a40dc85f02e None None] PATH_INFO: `/` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:16.132769 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 198/402] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:23:16 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:23:16.143493 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb42db91-ddcd-4ab1-9b3b-62942a863d9e None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:16.143881 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb42db91-ddcd-4ab1-9b3b-62942a863d9e None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:16.144265 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb42db91-ddcd-4ab1-9b3b-62942a863d9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:16.182818 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-eb42db91-ddcd-4ab1-9b3b-62942a863d9e None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:23:16.186635 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-eb42db91-ddcd-4ab1-9b3b-62942a863d9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:23:16.238247 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 205/403] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:23:16 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 25 02:23:16.299061 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 199/404] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:23:16 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 25 02:23:16.301771 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f07bed3-3b8e-4e27-9926-00ebc5d7e891 None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:16.317490 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f07bed3-3b8e-4e27-9926-00ebc5d7e891 None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:16.326450 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1a70c2-cf8d-44f9-b1a3-04205d367d55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:16.327581 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1a70c2-cf8d-44f9-b1a3-04205d367d55 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:16.328165 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1a70c2-cf8d-44f9-b1a3-04205d367d55 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:16.328612 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1a70c2-cf8d-44f9-b1a3-04205d367d55 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:16.347616 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1a70c2-cf8d-44f9-b1a3-04205d367d55 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 25 02:23:16.355657 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: WARNING keystone.server.flask.application [None req-2a1a70c2-cf8d-44f9-b1a3-04205d367d55 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jan 25 02:23:16.357455 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 206/405] 10.222.0.117 () {56 vars in 1140 bytes} [Tue Jan 25 02:23:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 25 02:23:16.358970 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb42db91-ddcd-4ab1-9b3b-62942a863d9e None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:16.362859 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1a70c2-cf8d-44f9-b1a3-04205d367d55 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:16.374455 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb42db91-ddcd-4ab1-9b3b-62942a863d9e None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:16.379800 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1a70c2-cf8d-44f9-b1a3-04205d367d55 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:16.383523 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ed12cf-1054-4d90-8860-75f711a2cead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:16.384366 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ed12cf-1054-4d90-8860-75f711a2cead admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:16.384641 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ed12cf-1054-4d90-8860-75f711a2cead admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:16.384913 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ed12cf-1054-4d90-8860-75f711a2cead admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:16.388055 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1588450-e1cb-4f89-b533-4cd885fa4c78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:16.389061 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1588450-e1cb-4f89-b533-4cd885fa4c78 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:16.389586 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1588450-e1cb-4f89-b533-4cd885fa4c78 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:16.390132 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1588450-e1cb-4f89-b533-4cd885fa4c78 admin admin] PATH_INFO: `/v3/roles` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:16.391578 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1588450-e1cb-4f89-b533-4cd885fa4c78 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:16.392088 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1588450-e1cb-4f89-b533-4cd885fa4c78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:16.394518 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1588450-e1cb-4f89-b533-4cd885fa4c78 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:16.403013 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ed12cf-1054-4d90-8860-75f711a2cead admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 25 02:23:16.408910 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 207/406] 10.222.0.117 () {56 vars in 1137 bytes} [Tue Jan 25 02:23:16 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:16.410800 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: WARNING keystone.server.flask.application [None req-52ed12cf-1054-4d90-8860-75f711a2cead admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 25 02:23:16.412340 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 200/407] 10.222.0.117 () {56 vars in 1122 bytes} [Tue Jan 25 02:23:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 25 02:23:16.415813 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1588450-e1cb-4f89-b533-4cd885fa4c78 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:16.417630 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ed12cf-1054-4d90-8860-75f711a2cead admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:16.426959 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1588450-e1cb-4f89-b533-4cd885fa4c78 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:16.433024 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a26d7a-2031-459e-944d-71a4a8b065b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:16.433870 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ed12cf-1054-4d90-8860-75f711a2cead admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:16.434237 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a26d7a-2031-459e-944d-71a4a8b065b1 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:16.434690 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a26d7a-2031-459e-944d-71a4a8b065b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:16.435077 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a26d7a-2031-459e-944d-71a4a8b065b1 admin admin] PATH_INFO: `/v3/groups/22728d139c334673858eb9e957f09bc5` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:16.436505 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a26d7a-2031-459e-944d-71a4a8b065b1 admin admin] RBAC: Authorizing `identity:get_group(group_id=22728d139c334673858eb9e957f09bc5)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:16.438677 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a26d7a-2031-459e-944d-71a4a8b065b1 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:16.440765 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 208/408] 10.222.0.117 () {56 vars in 1206 bytes} [Tue Jan 25 02:23:16 2022] GET /identity/v3/groups/22728d139c334673858eb9e957f09bc5 => generated 227 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:16.443331 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc745ea1-098d-4eb9-be9d-5aca82da1e33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:16.447298 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc745ea1-098d-4eb9-be9d-5aca82da1e33 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:16.447298 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc745ea1-098d-4eb9-be9d-5aca82da1e33 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:16.447298 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc745ea1-098d-4eb9-be9d-5aca82da1e33 admin admin] PATH_INFO: `/v3/roles` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:16.447298 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc745ea1-098d-4eb9-be9d-5aca82da1e33 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:16.447298 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc745ea1-098d-4eb9-be9d-5aca82da1e33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:16.447632 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc745ea1-098d-4eb9-be9d-5aca82da1e33 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:16.449800 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a26d7a-2031-459e-944d-71a4a8b065b1 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:16.462714 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a26d7a-2031-459e-944d-71a4a8b065b1 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:16.471893 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 201/409] 10.222.0.117 () {56 vars in 1125 bytes} [Tue Jan 25 02:23:16 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:16.473642 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99724e87-ae8b-4109-acd1-9fbd7ac16d64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:16.476804 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc745ea1-098d-4eb9-be9d-5aca82da1e33 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:16.479391 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99724e87-ae8b-4109-acd1-9fbd7ac16d64 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:16.479905 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99724e87-ae8b-4109-acd1-9fbd7ac16d64 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:16.481633 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99724e87-ae8b-4109-acd1-9fbd7ac16d64 admin admin] PATH_INFO: `/v3/projects/711fe35d158f4285974b4184777b46ac` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:16.483390 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99724e87-ae8b-4109-acd1-9fbd7ac16d64 admin admin] RBAC: Authorizing `identity:get_project(project_id=711fe35d158f4285974b4184777b46ac)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:16.487906 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99724e87-ae8b-4109-acd1-9fbd7ac16d64 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:16.491989 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 209/410] 10.222.0.117 () {56 vars in 1212 bytes} [Tue Jan 25 02:23:16 2022] GET /identity/v3/projects/711fe35d158f4285974b4184777b46ac => generated 303 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:16.494461 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc745ea1-098d-4eb9-be9d-5aca82da1e33 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:16.497359 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99724e87-ae8b-4109-acd1-9fbd7ac16d64 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:16.507481 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532af4f5-f9f6-4382-9fd3-38f7fce9580f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:16.508787 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532af4f5-f9f6-4382-9fd3-38f7fce9580f admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:16.509267 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532af4f5-f9f6-4382-9fd3-38f7fce9580f admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:16.509738 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532af4f5-f9f6-4382-9fd3-38f7fce9580f admin admin] PATH_INFO: `/v3/groups/d01cae825f3c469996dfee7eeb82048c` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:16.511155 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532af4f5-f9f6-4382-9fd3-38f7fce9580f admin admin] RBAC: Authorizing `identity:get_group(group_id=d01cae825f3c469996dfee7eeb82048c)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:16.514100 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532af4f5-f9f6-4382-9fd3-38f7fce9580f admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:16.516413 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 202/411] 10.222.0.117 () {56 vars in 1206 bytes} [Tue Jan 25 02:23:16 2022] GET /identity/v3/groups/d01cae825f3c469996dfee7eeb82048c => generated 230 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:16.517842 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99724e87-ae8b-4109-acd1-9fbd7ac16d64 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:16.524145 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532af4f5-f9f6-4382-9fd3-38f7fce9580f admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:16.533253 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b809c66-c69a-44da-baf8-68bbdef8e0e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:16.534144 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b809c66-c69a-44da-baf8-68bbdef8e0e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:16.534429 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b809c66-c69a-44da-baf8-68bbdef8e0e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:16.534713 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b809c66-c69a-44da-baf8-68bbdef8e0e4 admin admin] PATH_INFO: `/v3/projects/711fe35d158f4285974b4184777b46ac/groups/22728d139c334673858eb9e957f09bc5/roles/259d005f63d5455d8728277d6385bfba` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:16.536467 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532af4f5-f9f6-4382-9fd3-38f7fce9580f admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:16.540999 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b809c66-c69a-44da-baf8-68bbdef8e0e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=711fe35d158f4285974b4184777b46ac, group_id=22728d139c334673858eb9e957f09bc5, role_id=259d005f63d5455d8728277d6385bfba)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:16.541693 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ea7c1d-cd40-4ee6-872a-23621a896de2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:16.542911 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ea7c1d-cd40-4ee6-872a-23621a896de2 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:16.543390 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ea7c1d-cd40-4ee6-872a-23621a896de2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:16.543764 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b809c66-c69a-44da-baf8-68bbdef8e0e4 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:16.544124 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ea7c1d-cd40-4ee6-872a-23621a896de2 admin admin] PATH_INFO: `/v3/projects/705a3c6650674528a0096768eea3fe81` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:16.545618 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ea7c1d-cd40-4ee6-872a-23621a896de2 admin admin] RBAC: Authorizing `identity:get_project(project_id=705a3c6650674528a0096768eea3fe81)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:16.547829 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ea7c1d-cd40-4ee6-872a-23621a896de2 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:16.552077 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 203/412] 10.222.0.117 () {56 vars in 1212 bytes} [Tue Jan 25 02:23:16 2022] GET /identity/v3/projects/705a3c6650674528a0096768eea3fe81 => generated 345 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 02:23:16.558975 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ea7c1d-cd40-4ee6-872a-23621a896de2 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:16.570217 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 210/413] 10.222.0.117 () {58 vars in 1468 bytes} [Tue Jan 25 02:23:16 2022] PUT /identity/v3/projects/711fe35d158f4285974b4184777b46ac/groups/22728d139c334673858eb9e957f09bc5/roles/259d005f63d5455d8728277d6385bfba => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:23:16.573141 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ea7c1d-cd40-4ee6-872a-23621a896de2 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:16.650827 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6dc051-7e08-4948-8507-025da8d25d2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:16.652197 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6dc051-7e08-4948-8507-025da8d25d2f admin admin] REQUEST_METHOD: `PUT` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:16.652682 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6dc051-7e08-4948-8507-025da8d25d2f admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:16.653362 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6dc051-7e08-4948-8507-025da8d25d2f admin admin] PATH_INFO: `/v3/projects/705a3c6650674528a0096768eea3fe81/groups/d01cae825f3c469996dfee7eeb82048c/roles/d8dbc6d83d9d41d28c3feb8b3485b291` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:16.657416 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6dc051-7e08-4948-8507-025da8d25d2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=705a3c6650674528a0096768eea3fe81, group_id=d01cae825f3c469996dfee7eeb82048c, role_id=d8dbc6d83d9d41d28c3feb8b3485b291)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:16.660597 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6dc051-7e08-4948-8507-025da8d25d2f admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:16.678715 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 204/414] 10.222.0.117 () {58 vars in 1468 bytes} [Tue Jan 25 02:23:16 2022] PUT /identity/v3/projects/705a3c6650674528a0096768eea3fe81/groups/d01cae825f3c469996dfee7eeb82048c/roles/d8dbc6d83d9d41d28c3feb8b3485b291 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:23:18.473021 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc89ee88-5409-458b-b71a-dc83d49a0c65 None None] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:18.473566 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc89ee88-5409-458b-b71a-dc83d49a0c65 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:18.473566 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc89ee88-5409-458b-b71a-dc83d49a0c65 None None] PATH_INFO: `/` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:18.475347 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 211/415] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:23:18 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:23:18.483055 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4769091-4847-47f3-9f31-68c3891f6687 None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:18.483525 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4769091-4847-47f3-9f31-68c3891f6687 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:18.483622 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4769091-4847-47f3-9f31-68c3891f6687 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:18.512797 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-b4769091-4847-47f3-9f31-68c3891f6687 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:23:18.514015 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-b4769091-4847-47f3-9f31-68c3891f6687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:23:18.530221 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4705cb48-a6be-4336-b7bd-90a5a56ac7ef None None] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:18.531142 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4705cb48-a6be-4336-b7bd-90a5a56ac7ef None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:18.531652 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4705cb48-a6be-4336-b7bd-90a5a56ac7ef None None] PATH_INFO: `/` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:18.533946 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 212/416] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:23:18 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:23:18.539198 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97824d5b-c2c9-48e5-b5a0-1bb5a415a6fb None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:18.539966 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97824d5b-c2c9-48e5-b5a0-1bb5a415a6fb None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:18.539966 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97824d5b-c2c9-48e5-b5a0-1bb5a415a6fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:18.580709 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-97824d5b-c2c9-48e5-b5a0-1bb5a415a6fb None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:23:18.581932 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-97824d5b-c2c9-48e5-b5a0-1bb5a415a6fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:23:18.607764 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 205/417] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:23:18 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 25 02:23:18.661245 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 213/418] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:23:18 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 25 02:23:18.670951 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4769091-4847-47f3-9f31-68c3891f6687 None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:18.689812 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97824d5b-c2c9-48e5-b5a0-1bb5a415a6fb None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:18.690087 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4769091-4847-47f3-9f31-68c3891f6687 None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:18.701717 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97824d5b-c2c9-48e5-b5a0-1bb5a415a6fb None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:18.704347 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de932e2e-bc63-4297-824c-0c995995d145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:18.705156 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de932e2e-bc63-4297-824c-0c995995d145 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:18.705433 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de932e2e-bc63-4297-824c-0c995995d145 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:18.705705 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de932e2e-bc63-4297-824c-0c995995d145 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:18.714349 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eed8e0e-2737-45d0-adb5-fc7de58e5e0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:18.716052 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eed8e0e-2737-45d0-adb5-fc7de58e5e0b admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:18.716338 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eed8e0e-2737-45d0-adb5-fc7de58e5e0b admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:18.716609 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eed8e0e-2737-45d0-adb5-fc7de58e5e0b admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:18.727749 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de932e2e-bc63-4297-824c-0c995995d145 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 25 02:23:18.736771 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: WARNING keystone.server.flask.application [None req-de932e2e-bc63-4297-824c-0c995995d145 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 25 02:23:18.738532 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 206/419] 10.222.0.117 () {56 vars in 1125 bytes} [Tue Jan 25 02:23:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:23:18.743111 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eed8e0e-2737-45d0-adb5-fc7de58e5e0b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 25 02:23:18.748761 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de932e2e-bc63-4297-824c-0c995995d145 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:18.752117 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: WARNING keystone.server.flask.application [None req-4eed8e0e-2737-45d0-adb5-fc7de58e5e0b admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jan 25 02:23:18.753821 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 214/420] 10.222.0.117 () {56 vars in 1140 bytes} [Tue Jan 25 02:23:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:23:18.760604 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eed8e0e-2737-45d0-adb5-fc7de58e5e0b admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:18.762541 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de932e2e-bc63-4297-824c-0c995995d145 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:18.771978 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eed8e0e-2737-45d0-adb5-fc7de58e5e0b admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:18.777936 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dae23f3-ec57-400f-a59a-5dfbb6bb1e7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:18.778072 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dae23f3-ec57-400f-a59a-5dfbb6bb1e7f admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:18.778260 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dae23f3-ec57-400f-a59a-5dfbb6bb1e7f admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:18.778522 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dae23f3-ec57-400f-a59a-5dfbb6bb1e7f admin admin] PATH_INFO: `/v3/roles` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:18.783329 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dae23f3-ec57-400f-a59a-5dfbb6bb1e7f admin admin] RBAC: Adding query filter params (name=member) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:18.783329 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dae23f3-ec57-400f-a59a-5dfbb6bb1e7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:18.783329 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dae23f3-ec57-400f-a59a-5dfbb6bb1e7f admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:18.784693 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2837df0e-4306-40ac-a0aa-597f36a20470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:18.785352 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2837df0e-4306-40ac-a0aa-597f36a20470 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:18.785626 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2837df0e-4306-40ac-a0aa-597f36a20470 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:18.785895 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2837df0e-4306-40ac-a0aa-597f36a20470 admin admin] PATH_INFO: `/v3/roles` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:18.786652 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2837df0e-4306-40ac-a0aa-597f36a20470 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:18.786951 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2837df0e-4306-40ac-a0aa-597f36a20470 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:18.788562 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2837df0e-4306-40ac-a0aa-597f36a20470 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:18.803188 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 207/421] 10.222.0.117 () {56 vars in 1127 bytes} [Tue Jan 25 02:23:18 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:18.807438 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 215/422] 10.222.0.117 () {56 vars in 1137 bytes} [Tue Jan 25 02:23:18 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:18.809683 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dae23f3-ec57-400f-a59a-5dfbb6bb1e7f admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:18.821469 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2837df0e-4306-40ac-a0aa-597f36a20470 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:18.827193 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dae23f3-ec57-400f-a59a-5dfbb6bb1e7f admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:18.832134 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb9b171-3fca-451e-abef-09917cdb6559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:18.832797 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb9b171-3fca-451e-abef-09917cdb6559 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:18.833074 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb9b171-3fca-451e-abef-09917cdb6559 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:18.833341 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb9b171-3fca-451e-abef-09917cdb6559 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:18.839906 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2837df0e-4306-40ac-a0aa-597f36a20470 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:18.847811 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb9b171-3fca-451e-abef-09917cdb6559 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:18.849574 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb9b171-3fca-451e-abef-09917cdb6559 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:18.854652 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6c6ab7-5f21-4e58-bb09-457a32c9e1b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:18.855447 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6c6ab7-5f21-4e58-bb09-457a32c9e1b4 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:18.855982 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6c6ab7-5f21-4e58-bb09-457a32c9e1b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:18.856313 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6c6ab7-5f21-4e58-bb09-457a32c9e1b4 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:18.866572 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6c6ab7-5f21-4e58-bb09-457a32c9e1b4 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:18.867265 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 208/423] 10.222.0.117 () {58 vars in 1329 bytes} [Tue Jan 25 02:23:18 2022] GET /identity/v3/auth/tokens => generated 915 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jan 25 02:23:18.868581 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6c6ab7-5f21-4e58-bb09-457a32c9e1b4 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:18.873184 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb9b171-3fca-451e-abef-09917cdb6559 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:18.883041 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 216/424] 10.222.0.117 () {58 vars in 1329 bytes} [Tue Jan 25 02:23:18 2022] GET /identity/v3/auth/tokens => generated 915 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 25 02:23:18.885166 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6c6ab7-5f21-4e58-bb09-457a32c9e1b4 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:18.893875 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb9b171-3fca-451e-abef-09917cdb6559 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:18.895750 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6c6ab7-5f21-4e58-bb09-457a32c9e1b4 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:18.903137 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8f8abc-1f64-42fe-bae0-dccd4aa0add3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:18.904043 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8f8abc-1f64-42fe-bae0-dccd4aa0add3 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:18.904319 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8f8abc-1f64-42fe-bae0-dccd4aa0add3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:18.904588 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8f8abc-1f64-42fe-bae0-dccd4aa0add3 admin admin] PATH_INFO: `/v3/projects/26e358bfb5294c7f9855f86b5dbeedac` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:18.905672 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6746b267-7ede-4bc3-a4ec-ac9c04ac130d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:18.906499 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6746b267-7ede-4bc3-a4ec-ac9c04ac130d admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:18.906771 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6746b267-7ede-4bc3-a4ec-ac9c04ac130d admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:18.907031 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6746b267-7ede-4bc3-a4ec-ac9c04ac130d admin admin] PATH_INFO: `/v3/projects/26e358bfb5294c7f9855f86b5dbeedac` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:18.908240 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6746b267-7ede-4bc3-a4ec-ac9c04ac130d admin admin] RBAC: Authorizing `identity:get_project(project_id=26e358bfb5294c7f9855f86b5dbeedac)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:18.910281 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6746b267-7ede-4bc3-a4ec-ac9c04ac130d admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:18.912150 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 217/425] 10.222.0.117 () {56 vars in 1212 bytes} [Tue Jan 25 02:23:18 2022] GET /identity/v3/projects/26e358bfb5294c7f9855f86b5dbeedac => generated 299 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:18.916435 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8f8abc-1f64-42fe-bae0-dccd4aa0add3 admin admin] RBAC: Authorizing `identity:get_project(project_id=26e358bfb5294c7f9855f86b5dbeedac)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:18.918944 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8f8abc-1f64-42fe-bae0-dccd4aa0add3 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:18.920990 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 209/426] 10.222.0.117 () {56 vars in 1212 bytes} [Tue Jan 25 02:23:18 2022] GET /identity/v3/projects/26e358bfb5294c7f9855f86b5dbeedac => generated 299 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 02:23:18.922786 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6746b267-7ede-4bc3-a4ec-ac9c04ac130d admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:18.928543 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8f8abc-1f64-42fe-bae0-dccd4aa0add3 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:18.941493 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6746b267-7ede-4bc3-a4ec-ac9c04ac130d admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:18.946112 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8f8abc-1f64-42fe-bae0-dccd4aa0add3 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:18.952698 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c756f9d-87b9-4b29-98c2-2512acbb69d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:18.953553 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c756f9d-87b9-4b29-98c2-2512acbb69d4 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:18.953832 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c756f9d-87b9-4b29-98c2-2512acbb69d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:18.954101 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c756f9d-87b9-4b29-98c2-2512acbb69d4 admin admin] PATH_INFO: `/v3/groups/22728d139c334673858eb9e957f09bc5` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:18.956475 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732ac60b-0757-4d43-9615-ae1933cc23cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:18.957319 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732ac60b-0757-4d43-9615-ae1933cc23cf admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:18.957595 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732ac60b-0757-4d43-9615-ae1933cc23cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:18.957862 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732ac60b-0757-4d43-9615-ae1933cc23cf admin admin] PATH_INFO: `/v3/groups/22728d139c334673858eb9e957f09bc5` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:18.959049 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c756f9d-87b9-4b29-98c2-2512acbb69d4 admin admin] RBAC: Authorizing `identity:get_group(group_id=22728d139c334673858eb9e957f09bc5)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:18.960975 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c756f9d-87b9-4b29-98c2-2512acbb69d4 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:18.962727 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 218/427] 10.222.0.117 () {56 vars in 1206 bytes} [Tue Jan 25 02:23:18 2022] GET /identity/v3/groups/22728d139c334673858eb9e957f09bc5 => generated 227 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:18.968377 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732ac60b-0757-4d43-9615-ae1933cc23cf admin admin] RBAC: Authorizing `identity:get_group(group_id=22728d139c334673858eb9e957f09bc5)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:18.970522 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732ac60b-0757-4d43-9615-ae1933cc23cf admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:18.972508 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 210/428] 10.222.0.117 () {56 vars in 1206 bytes} [Tue Jan 25 02:23:18 2022] GET /identity/v3/groups/22728d139c334673858eb9e957f09bc5 => generated 227 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:18.974070 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c756f9d-87b9-4b29-98c2-2512acbb69d4 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:18.979997 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732ac60b-0757-4d43-9615-ae1933cc23cf admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:18.990279 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c756f9d-87b9-4b29-98c2-2512acbb69d4 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:18.999184 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732ac60b-0757-4d43-9615-ae1933cc23cf admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:19.001274 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacff3fd-0911-4ef0-a4f0-bbbb578a3bff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:19.001925 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacff3fd-0911-4ef0-a4f0-bbbb578a3bff admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:19.002201 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacff3fd-0911-4ef0-a4f0-bbbb578a3bff admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:19.002475 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacff3fd-0911-4ef0-a4f0-bbbb578a3bff admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:19.003321 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacff3fd-0911-4ef0-a4f0-bbbb578a3bff admin admin] RBAC: Adding query filter params (group.id=22728d139c334673858eb9e957f09bc5, role.id=259d005f63d5455d8728277d6385bfba, scope.project.id=26e358bfb5294c7f9855f86b5dbeedac) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:19.003626 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacff3fd-0911-4ef0-a4f0-bbbb578a3bff admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:19.005507 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacff3fd-0911-4ef0-a4f0-bbbb578a3bff admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:19.011927 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14d53e2-823f-4a35-8f90-ba4711c40db7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:19.012633 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14d53e2-823f-4a35-8f90-ba4711c40db7 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:19.012912 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14d53e2-823f-4a35-8f90-ba4711c40db7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:19.013189 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14d53e2-823f-4a35-8f90-ba4711c40db7 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:19.014034 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14d53e2-823f-4a35-8f90-ba4711c40db7 admin admin] RBAC: Adding query filter params (group.id=22728d139c334673858eb9e957f09bc5, role.id=33a8e87420ed423f9cb29e0084eab5d2, scope.project.id=26e358bfb5294c7f9855f86b5dbeedac) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:19.014338 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14d53e2-823f-4a35-8f90-ba4711c40db7 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:19.016250 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14d53e2-823f-4a35-8f90-ba4711c40db7 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:19.022778 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 219/429] 10.222.0.117 () {56 vars in 1402 bytes} [Tue Jan 25 02:23:18 2022] GET /identity/v3/role_assignments?group.id=22728d139c334673858eb9e957f09bc5&scope.project.id=26e358bfb5294c7f9855f86b5dbeedac&role.id=259d005f63d5455d8728277d6385bfba => generated 613 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 02:23:19.033754 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 211/430] 10.222.0.117 () {56 vars in 1402 bytes} [Tue Jan 25 02:23:18 2022] GET /identity/v3/role_assignments?group.id=22728d139c334673858eb9e957f09bc5&scope.project.id=26e358bfb5294c7f9855f86b5dbeedac&role.id=33a8e87420ed423f9cb29e0084eab5d2 => generated 613 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:19.187802 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b99c4fe-2841-4a84-ae70-6f1a942d866d None None] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:19.188188 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b99c4fe-2841-4a84-ae70-6f1a942d866d None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:19.188361 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b99c4fe-2841-4a84-ae70-6f1a942d866d None None] PATH_INFO: `/` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:19.190095 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 220/431] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:23:19 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:23:19.207045 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca7b15a-7427-427e-81e0-ac758e605b58 None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:19.207354 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca7b15a-7427-427e-81e0-ac758e605b58 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:19.207580 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca7b15a-7427-427e-81e0-ac758e605b58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:19.232575 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-fca7b15a-7427-427e-81e0-ac758e605b58 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:23:19.233727 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-fca7b15a-7427-427e-81e0-ac758e605b58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:23:19.246954 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 212/432] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:23:19 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 25 02:23:19.274859 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b99c4fe-2841-4a84-ae70-6f1a942d866d None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:19.290312 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b99c4fe-2841-4a84-ae70-6f1a942d866d None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:19.298363 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3760b9d-e354-4bd1-8c60-cc8e4f6f292f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:19.299161 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3760b9d-e354-4bd1-8c60-cc8e4f6f292f admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:19.299440 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3760b9d-e354-4bd1-8c60-cc8e4f6f292f admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:19.299726 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3760b9d-e354-4bd1-8c60-cc8e4f6f292f admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:19.314921 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3760b9d-e354-4bd1-8c60-cc8e4f6f292f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 25 02:23:19.322142 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: WARNING keystone.server.flask.application [None req-a3760b9d-e354-4bd1-8c60-cc8e4f6f292f admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 25 02:23:19.324470 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 221/433] 10.222.0.117 () {56 vars in 1125 bytes} [Tue Jan 25 02:23:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:23:19.333192 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca7b15a-7427-427e-81e0-ac758e605b58 None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:19.347126 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca7b15a-7427-427e-81e0-ac758e605b58 None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:19.352660 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f891161-0c39-4e15-901b-4a542c8abc75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:19.353330 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f891161-0c39-4e15-901b-4a542c8abc75 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:19.353603 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f891161-0c39-4e15-901b-4a542c8abc75 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:19.353875 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f891161-0c39-4e15-901b-4a542c8abc75 admin admin] PATH_INFO: `/v3/roles` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:19.354645 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f891161-0c39-4e15-901b-4a542c8abc75 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:19.354981 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f891161-0c39-4e15-901b-4a542c8abc75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:19.357039 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f891161-0c39-4e15-901b-4a542c8abc75 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:19.370481 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 213/434] 10.222.0.117 () {56 vars in 1127 bytes} [Tue Jan 25 02:23:19 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:19.376915 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3760b9d-e354-4bd1-8c60-cc8e4f6f292f admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:19.390077 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3760b9d-e354-4bd1-8c60-cc8e4f6f292f admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:19.400187 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff2df31-1867-4348-873d-34d3ff79d4f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:19.401068 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff2df31-1867-4348-873d-34d3ff79d4f9 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:19.401497 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff2df31-1867-4348-873d-34d3ff79d4f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:19.402482 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff2df31-1867-4348-873d-34d3ff79d4f9 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:19.411929 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff2df31-1867-4348-873d-34d3ff79d4f9 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:19.413978 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff2df31-1867-4348-873d-34d3ff79d4f9 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:19.425894 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 222/435] 10.222.0.117 () {58 vars in 1329 bytes} [Tue Jan 25 02:23:19 2022] GET /identity/v3/auth/tokens => generated 915 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 25 02:23:19.431622 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f891161-0c39-4e15-901b-4a542c8abc75 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:19.444441 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f891161-0c39-4e15-901b-4a542c8abc75 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:19.451430 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de0e3d6-af5d-4628-b4dc-48ebde0ec246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:19.452550 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de0e3d6-af5d-4628-b4dc-48ebde0ec246 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:19.452961 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de0e3d6-af5d-4628-b4dc-48ebde0ec246 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:19.453337 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de0e3d6-af5d-4628-b4dc-48ebde0ec246 admin admin] PATH_INFO: `/v3/projects/711fe35d158f4285974b4184777b46ac` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:19.454637 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de0e3d6-af5d-4628-b4dc-48ebde0ec246 admin admin] RBAC: Authorizing `identity:get_project(project_id=711fe35d158f4285974b4184777b46ac)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:19.456871 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de0e3d6-af5d-4628-b4dc-48ebde0ec246 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:19.459002 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 214/436] 10.222.0.117 () {56 vars in 1212 bytes} [Tue Jan 25 02:23:19 2022] GET /identity/v3/projects/711fe35d158f4285974b4184777b46ac => generated 303 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:19.465038 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff2df31-1867-4348-873d-34d3ff79d4f9 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:19.475411 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff2df31-1867-4348-873d-34d3ff79d4f9 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:19.480775 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3679322a-65a9-4e53-84a2-475d45ffee9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:19.482090 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3679322a-65a9-4e53-84a2-475d45ffee9a admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:19.482468 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3679322a-65a9-4e53-84a2-475d45ffee9a admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:19.482885 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3679322a-65a9-4e53-84a2-475d45ffee9a admin admin] PATH_INFO: `/v3/groups/22728d139c334673858eb9e957f09bc5` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:19.484197 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3679322a-65a9-4e53-84a2-475d45ffee9a admin admin] RBAC: Authorizing `identity:get_group(group_id=22728d139c334673858eb9e957f09bc5)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:19.486283 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3679322a-65a9-4e53-84a2-475d45ffee9a admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:19.489217 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 223/437] 10.222.0.117 () {56 vars in 1206 bytes} [Tue Jan 25 02:23:19 2022] GET /identity/v3/groups/22728d139c334673858eb9e957f09bc5 => generated 227 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:19.493925 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de0e3d6-af5d-4628-b4dc-48ebde0ec246 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:19.505488 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de0e3d6-af5d-4628-b4dc-48ebde0ec246 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:19.510196 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2253ca9-1753-40a6-b80f-71991e03f18e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:19.510946 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2253ca9-1753-40a6-b80f-71991e03f18e admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:19.512034 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2253ca9-1753-40a6-b80f-71991e03f18e admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:19.512425 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2253ca9-1753-40a6-b80f-71991e03f18e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:19.513375 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2253ca9-1753-40a6-b80f-71991e03f18e admin admin] RBAC: Adding query filter params (group.id=22728d139c334673858eb9e957f09bc5, role.id=33a8e87420ed423f9cb29e0084eab5d2, scope.project.id=711fe35d158f4285974b4184777b46ac) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:19.513807 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2253ca9-1753-40a6-b80f-71991e03f18e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:19.515819 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2253ca9-1753-40a6-b80f-71991e03f18e admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:19.524220 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 215/438] 10.222.0.117 () {56 vars in 1402 bytes} [Tue Jan 25 02:23:19 2022] GET /identity/v3/role_assignments?group.id=22728d139c334673858eb9e957f09bc5&scope.project.id=711fe35d158f4285974b4184777b46ac&role.id=33a8e87420ed423f9cb29e0084eab5d2 => generated 613 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:19.845568 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d913263-6792-4a0a-9ab1-48a7743c01a1 None None] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:19.845914 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d913263-6792-4a0a-9ab1-48a7743c01a1 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:19.846090 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d913263-6792-4a0a-9ab1-48a7743c01a1 None None] PATH_INFO: `/` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:19.847846 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 224/439] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:23:19 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:23:19.853222 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dc2e40-71e4-461b-a525-0828bac98d89 None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:19.853515 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dc2e40-71e4-461b-a525-0828bac98d89 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:19.853797 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dc2e40-71e4-461b-a525-0828bac98d89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:19.872894 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-d7dc2e40-71e4-461b-a525-0828bac98d89 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:23:19.874089 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-d7dc2e40-71e4-461b-a525-0828bac98d89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:23:19.881883 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 216/440] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:23:19 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 25 02:23:19.906733 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d913263-6792-4a0a-9ab1-48a7743c01a1 None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:19.915408 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae3d8d7-4180-47fb-9b14-2d4b540b5b9b None None] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:19.915714 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae3d8d7-4180-47fb-9b14-2d4b540b5b9b None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:19.916003 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae3d8d7-4180-47fb-9b14-2d4b540b5b9b None None] PATH_INFO: `/` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:19.917818 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 217/441] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:23:19 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jan 25 02:23:19.920806 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d913263-6792-4a0a-9ab1-48a7743c01a1 None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:19.923189 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b7090f-49d2-4a01-94f6-e30448429bf4 None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:19.923479 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b7090f-49d2-4a01-94f6-e30448429bf4 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:19.923793 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b7090f-49d2-4a01-94f6-e30448429bf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:19.926241 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38882675-f0a8-4e87-b95b-5896d6412e53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:19.927037 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38882675-f0a8-4e87-b95b-5896d6412e53 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:19.927319 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38882675-f0a8-4e87-b95b-5896d6412e53 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:19.927589 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38882675-f0a8-4e87-b95b-5896d6412e53 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:19.938770 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38882675-f0a8-4e87-b95b-5896d6412e53 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 25 02:23:19.941633 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-c2b7090f-49d2-4a01-94f6-e30448429bf4 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:23:19.942823 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-c2b7090f-49d2-4a01-94f6-e30448429bf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:23:19.946125 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: WARNING keystone.server.flask.application [None req-38882675-f0a8-4e87-b95b-5896d6412e53 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jan 25 02:23:19.947298 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 225/442] 10.222.0.117 () {56 vars in 1140 bytes} [Tue Jan 25 02:23:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:23:19.951450 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 218/443] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:23:19 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 25 02:23:19.953794 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38882675-f0a8-4e87-b95b-5896d6412e53 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:19.963486 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38882675-f0a8-4e87-b95b-5896d6412e53 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:19.968514 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74323dc6-1119-4e93-99fe-17f6d6a6b84a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:19.969165 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74323dc6-1119-4e93-99fe-17f6d6a6b84a admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:19.969442 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74323dc6-1119-4e93-99fe-17f6d6a6b84a admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:19.969712 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74323dc6-1119-4e93-99fe-17f6d6a6b84a admin admin] PATH_INFO: `/v3/roles` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:19.970724 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74323dc6-1119-4e93-99fe-17f6d6a6b84a admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:19.971027 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74323dc6-1119-4e93-99fe-17f6d6a6b84a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:19.972674 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74323dc6-1119-4e93-99fe-17f6d6a6b84a admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:19.976002 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b7090f-49d2-4a01-94f6-e30448429bf4 None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:19.982839 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 226/444] 10.222.0.117 () {56 vars in 1137 bytes} [Tue Jan 25 02:23:19 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 02:23:19.985454 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b7090f-49d2-4a01-94f6-e30448429bf4 None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:19.988531 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74323dc6-1119-4e93-99fe-17f6d6a6b84a admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:19.990097 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9bc959-21f0-456a-85b5-a76318872f55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:19.990882 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9bc959-21f0-456a-85b5-a76318872f55 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:19.991159 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9bc959-21f0-456a-85b5-a76318872f55 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:19.991427 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9bc959-21f0-456a-85b5-a76318872f55 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:19.998894 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74323dc6-1119-4e93-99fe-17f6d6a6b84a admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:20.002569 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9bc959-21f0-456a-85b5-a76318872f55 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 25 02:23:20.003899 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f754904b-5c61-44b0-86ae-399c4c9ab7bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:20.004540 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f754904b-5c61-44b0-86ae-399c4c9ab7bc admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:20.007400 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f754904b-5c61-44b0-86ae-399c4c9ab7bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:20.007400 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f754904b-5c61-44b0-86ae-399c4c9ab7bc admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:20.009845 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: WARNING keystone.server.flask.application [None req-af9bc959-21f0-456a-85b5-a76318872f55 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 25 02:23:20.011670 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 219/445] 10.222.0.117 () {56 vars in 1122 bytes} [Tue Jan 25 02:23:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 25 02:23:20.016889 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f754904b-5c61-44b0-86ae-399c4c9ab7bc admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:20.019091 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f754904b-5c61-44b0-86ae-399c4c9ab7bc admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:20.019214 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9bc959-21f0-456a-85b5-a76318872f55 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:20.029791 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9bc959-21f0-456a-85b5-a76318872f55 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:20.031137 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 227/446] 10.222.0.117 () {58 vars in 1329 bytes} [Tue Jan 25 02:23:19 2022] GET /identity/v3/auth/tokens => generated 915 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 25 02:23:20.034904 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d4f585-3493-4975-90e0-c57c47b35999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:20.035502 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d4f585-3493-4975-90e0-c57c47b35999 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:20.035793 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f754904b-5c61-44b0-86ae-399c4c9ab7bc admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:20.035900 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d4f585-3493-4975-90e0-c57c47b35999 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:20.036123 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d4f585-3493-4975-90e0-c57c47b35999 admin admin] PATH_INFO: `/v3/roles` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:20.036823 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d4f585-3493-4975-90e0-c57c47b35999 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:20.037127 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d4f585-3493-4975-90e0-c57c47b35999 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:20.038711 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d4f585-3493-4975-90e0-c57c47b35999 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:20.045272 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f754904b-5c61-44b0-86ae-399c4c9ab7bc admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:20.050117 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 220/447] 10.222.0.117 () {56 vars in 1125 bytes} [Tue Jan 25 02:23:20 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 02:23:20.051311 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc59efd5-faf3-4a5d-b243-8d7f1a892769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:20.052659 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc59efd5-faf3-4a5d-b243-8d7f1a892769 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:20.052659 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc59efd5-faf3-4a5d-b243-8d7f1a892769 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:20.052820 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc59efd5-faf3-4a5d-b243-8d7f1a892769 admin admin] PATH_INFO: `/v3/projects/711fe35d158f4285974b4184777b46ac` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:20.055320 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc59efd5-faf3-4a5d-b243-8d7f1a892769 admin admin] RBAC: Authorizing `identity:get_project(project_id=711fe35d158f4285974b4184777b46ac)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:20.055431 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d4f585-3493-4975-90e0-c57c47b35999 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:20.056140 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc59efd5-faf3-4a5d-b243-8d7f1a892769 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:20.057904 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 228/448] 10.222.0.117 () {56 vars in 1212 bytes} [Tue Jan 25 02:23:20 2022] GET /identity/v3/projects/711fe35d158f4285974b4184777b46ac => generated 303 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 02:23:20.064733 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc59efd5-faf3-4a5d-b243-8d7f1a892769 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:20.065946 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d4f585-3493-4975-90e0-c57c47b35999 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:20.070369 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99188b9-aa06-4a1a-8d57-e7823252abb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:20.071009 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99188b9-aa06-4a1a-8d57-e7823252abb3 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:20.071289 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99188b9-aa06-4a1a-8d57-e7823252abb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:20.071560 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99188b9-aa06-4a1a-8d57-e7823252abb3 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:20.076047 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc59efd5-faf3-4a5d-b243-8d7f1a892769 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:20.080537 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607e3c3b-d26d-4f19-b78d-226f5ed02db1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:20.080669 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99188b9-aa06-4a1a-8d57-e7823252abb3 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:20.081376 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607e3c3b-d26d-4f19-b78d-226f5ed02db1 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:20.081656 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607e3c3b-d26d-4f19-b78d-226f5ed02db1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:20.081926 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607e3c3b-d26d-4f19-b78d-226f5ed02db1 admin admin] PATH_INFO: `/v3/groups/22728d139c334673858eb9e957f09bc5` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:20.082405 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99188b9-aa06-4a1a-8d57-e7823252abb3 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:20.083652 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607e3c3b-d26d-4f19-b78d-226f5ed02db1 admin admin] RBAC: Authorizing `identity:get_group(group_id=22728d139c334673858eb9e957f09bc5)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:20.085576 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607e3c3b-d26d-4f19-b78d-226f5ed02db1 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:20.087637 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 229/449] 10.222.0.117 () {56 vars in 1206 bytes} [Tue Jan 25 02:23:20 2022] GET /identity/v3/groups/22728d139c334673858eb9e957f09bc5 => generated 227 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:20.092401 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 221/450] 10.222.0.117 () {58 vars in 1329 bytes} [Tue Jan 25 02:23:20 2022] GET /identity/v3/auth/tokens => generated 915 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jan 25 02:23:20.096708 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607e3c3b-d26d-4f19-b78d-226f5ed02db1 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:20.098091 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99188b9-aa06-4a1a-8d57-e7823252abb3 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:20.107029 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99188b9-aa06-4a1a-8d57-e7823252abb3 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:20.107187 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607e3c3b-d26d-4f19-b78d-226f5ed02db1 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:20.111678 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dc36d6-8ef4-4fe8-a726-7102eb7b65e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:20.113111 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1ca210-4435-47de-b287-2cd5e12e2aee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:20.113240 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dc36d6-8ef4-4fe8-a726-7102eb7b65e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:20.113240 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dc36d6-8ef4-4fe8-a726-7102eb7b65e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:20.113240 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dc36d6-8ef4-4fe8-a726-7102eb7b65e5 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:20.113479 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1ca210-4435-47de-b287-2cd5e12e2aee admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:20.113479 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1ca210-4435-47de-b287-2cd5e12e2aee admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:20.113624 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1ca210-4435-47de-b287-2cd5e12e2aee admin admin] PATH_INFO: `/v3/projects/705a3c6650674528a0096768eea3fe81` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:20.113745 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dc36d6-8ef4-4fe8-a726-7102eb7b65e5 admin admin] RBAC: Adding query filter params (group.id=22728d139c334673858eb9e957f09bc5, role.id=259d005f63d5455d8728277d6385bfba, scope.project.id=711fe35d158f4285974b4184777b46ac) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:20.114058 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dc36d6-8ef4-4fe8-a726-7102eb7b65e5 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:20.114935 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1ca210-4435-47de-b287-2cd5e12e2aee admin admin] RBAC: Authorizing `identity:get_project(project_id=705a3c6650674528a0096768eea3fe81)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:20.116667 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dc36d6-8ef4-4fe8-a726-7102eb7b65e5 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:20.116779 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1ca210-4435-47de-b287-2cd5e12e2aee admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:20.118408 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 222/451] 10.222.0.117 () {56 vars in 1212 bytes} [Tue Jan 25 02:23:20 2022] GET /identity/v3/projects/705a3c6650674528a0096768eea3fe81 => generated 345 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 02:23:20.122675 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 230/452] 10.222.0.117 () {56 vars in 1402 bytes} [Tue Jan 25 02:23:20 2022] GET /identity/v3/role_assignments?group.id=22728d139c334673858eb9e957f09bc5&scope.project.id=711fe35d158f4285974b4184777b46ac&role.id=259d005f63d5455d8728277d6385bfba => generated 613 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:20.124126 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1ca210-4435-47de-b287-2cd5e12e2aee admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:20.138624 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1ca210-4435-47de-b287-2cd5e12e2aee admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:20.143473 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d7c4ab-e755-4979-baea-fda0d74414ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:20.144490 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d7c4ab-e755-4979-baea-fda0d74414ef admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:20.144774 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d7c4ab-e755-4979-baea-fda0d74414ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:20.145053 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d7c4ab-e755-4979-baea-fda0d74414ef admin admin] PATH_INFO: `/v3/groups/d01cae825f3c469996dfee7eeb82048c` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:20.146416 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d7c4ab-e755-4979-baea-fda0d74414ef admin admin] RBAC: Authorizing `identity:get_group(group_id=d01cae825f3c469996dfee7eeb82048c)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:20.148362 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d7c4ab-e755-4979-baea-fda0d74414ef admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:20.150077 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 223/453] 10.222.0.117 () {56 vars in 1206 bytes} [Tue Jan 25 02:23:20 2022] GET /identity/v3/groups/d01cae825f3c469996dfee7eeb82048c => generated 230 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 02:23:20.156717 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dc36d6-8ef4-4fe8-a726-7102eb7b65e5 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:20.167112 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dc36d6-8ef4-4fe8-a726-7102eb7b65e5 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:20.172630 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97be06bc-4167-4809-8afe-24f81632e4fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:20.173351 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97be06bc-4167-4809-8afe-24f81632e4fb admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:20.173635 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97be06bc-4167-4809-8afe-24f81632e4fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:20.173912 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97be06bc-4167-4809-8afe-24f81632e4fb admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:20.174883 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97be06bc-4167-4809-8afe-24f81632e4fb admin admin] RBAC: Adding query filter params (group.id=d01cae825f3c469996dfee7eeb82048c, role.id=d8dbc6d83d9d41d28c3feb8b3485b291, scope.project.id=705a3c6650674528a0096768eea3fe81) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:20.175192 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97be06bc-4167-4809-8afe-24f81632e4fb admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:20.177366 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97be06bc-4167-4809-8afe-24f81632e4fb admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:20.185147 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 231/454] 10.222.0.117 () {56 vars in 1402 bytes} [Tue Jan 25 02:23:20 2022] GET /identity/v3/role_assignments?group.id=d01cae825f3c469996dfee7eeb82048c&scope.project.id=705a3c6650674528a0096768eea3fe81&role.id=d8dbc6d83d9d41d28c3feb8b3485b291 => generated 613 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:23.120262 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8064b6a3-436b-4f2b-a422-cd20eccea0ec None None] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:23.121421 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8064b6a3-436b-4f2b-a422-cd20eccea0ec None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:23.121738 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8064b6a3-436b-4f2b-a422-cd20eccea0ec None None] PATH_INFO: `/` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:23.123743 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 224/455] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:23:23 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:23:23.129392 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c06c5b8-a61d-4146-8465-2c6b90582497 None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:23.129825 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c06c5b8-a61d-4146-8465-2c6b90582497 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:23.129993 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c06c5b8-a61d-4146-8465-2c6b90582497 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:23.156668 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-7c06c5b8-a61d-4146-8465-2c6b90582497 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:23:23.157856 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-7c06c5b8-a61d-4146-8465-2c6b90582497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:23:23.167174 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 232/456] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:23:23 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 25 02:23:23.194225 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8064b6a3-436b-4f2b-a422-cd20eccea0ec None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:23.213608 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8064b6a3-436b-4f2b-a422-cd20eccea0ec None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:23.222653 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f12c27-0c03-4585-8aa7-5f2b80865d8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:23.223437 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f12c27-0c03-4585-8aa7-5f2b80865d8d admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:23.223722 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f12c27-0c03-4585-8aa7-5f2b80865d8d admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:23.223999 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f12c27-0c03-4585-8aa7-5f2b80865d8d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:23.239403 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f12c27-0c03-4585-8aa7-5f2b80865d8d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:23.241257 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f12c27-0c03-4585-8aa7-5f2b80865d8d admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:23.271093 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: WARNING keystone.server.flask.application [None req-a7f12c27-0c03-4585-8aa7-5f2b80865d8d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 25 02:23:23.272631 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 225/457] 10.222.0.117 () {56 vars in 1134 bytes} [Tue Jan 25 02:23:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:23:23.278891 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c06c5b8-a61d-4146-8465-2c6b90582497 None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:23.293384 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c06c5b8-a61d-4146-8465-2c6b90582497 None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:23.310286 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930af969-6faa-4649-b546-fd708de4b56f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:23.310959 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930af969-6faa-4649-b546-fd708de4b56f admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:23.311240 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930af969-6faa-4649-b546-fd708de4b56f admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:23.311510 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930af969-6faa-4649-b546-fd708de4b56f admin admin] PATH_INFO: `/v3/domains` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:23.312278 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930af969-6faa-4649-b546-fd708de4b56f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:23.312578 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930af969-6faa-4649-b546-fd708de4b56f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:23.314251 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930af969-6faa-4649-b546-fd708de4b56f admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:23.337044 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 233/458] 10.222.0.117 () {56 vars in 1135 bytes} [Tue Jan 25 02:23:23 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:23.343032 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f12c27-0c03-4585-8aa7-5f2b80865d8d admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:23.357676 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f12c27-0c03-4585-8aa7-5f2b80865d8d admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:23.369980 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da9f676-3590-4378-a040-7d552c1f9659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:23.371241 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da9f676-3590-4378-a040-7d552c1f9659 admin admin] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:23.371657 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da9f676-3590-4378-a040-7d552c1f9659 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:23.372149 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da9f676-3590-4378-a040-7d552c1f9659 admin admin] PATH_INFO: `/v3/users` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:23.372738 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aac67aa-faf9-4b0b-a3d5-f6877d89353b None None] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:23.372926 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da9f676-3590-4378-a040-7d552c1f9659 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:23.373400 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aac67aa-faf9-4b0b-a3d5-f6877d89353b None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:23.373889 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aac67aa-faf9-4b0b-a3d5-f6877d89353b None None] PATH_INFO: `/` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:23.375066 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da9f676-3590-4378-a040-7d552c1f9659 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:23.376638 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 234/459] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:23:23 2022] GET /identity => generated 271 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jan 25 02:23:23.382143 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c31ded-b974-4aaa-b12c-c6ce8cd114a4 None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:23.382665 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c31ded-b974-4aaa-b12c-c6ce8cd114a4 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:23.383141 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c31ded-b974-4aaa-b12c-c6ce8cd114a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:23.402237 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-44c31ded-b974-4aaa-b12c-c6ce8cd114a4 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:23:23.403763 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-44c31ded-b974-4aaa-b12c-c6ce8cd114a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:23:23.412786 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 226/460] 10.222.0.117 () {60 vars in 1158 bytes} [Tue Jan 25 02:23:23 2022] POST /identity/v3/users => generated 247 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 02:23:23.414656 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 235/461] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:23:23 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 25 02:23:23.445168 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da9f676-3590-4378-a040-7d552c1f9659 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:23.457449 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da9f676-3590-4378-a040-7d552c1f9659 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:23.468795 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23298ad4-780b-43dd-a60f-4dc8f6ec0529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:23.469616 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23298ad4-780b-43dd-a60f-4dc8f6ec0529 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:23.469902 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23298ad4-780b-43dd-a60f-4dc8f6ec0529 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:23.470432 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23298ad4-780b-43dd-a60f-4dc8f6ec0529 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:23.484310 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23298ad4-780b-43dd-a60f-4dc8f6ec0529 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:23.486209 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23298ad4-780b-43dd-a60f-4dc8f6ec0529 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:23.500473 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3052323a-fad6-4a55-a64d-c570c4d56c37 None None] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:23.501102 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3052323a-fad6-4a55-a64d-c570c4d56c37 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:23.501575 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3052323a-fad6-4a55-a64d-c570c4d56c37 None None] PATH_INFO: `/` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:23.503824 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 236/462] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:23:23 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jan 25 02:23:23.508787 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a759b925-8a47-4257-996f-0fb17bd5531a None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:23.509371 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a759b925-8a47-4257-996f-0fb17bd5531a None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:23.509846 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a759b925-8a47-4257-996f-0fb17bd5531a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:23.514273 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: WARNING keystone.server.flask.application [None req-23298ad4-780b-43dd-a60f-4dc8f6ec0529 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 25 02:23:23.519722 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 227/463] 10.222.0.117 () {56 vars in 1134 bytes} [Tue Jan 25 02:23:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:23:23.531107 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23298ad4-780b-43dd-a60f-4dc8f6ec0529 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:23.536607 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-a759b925-8a47-4257-996f-0fb17bd5531a None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:23:23.538215 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-a759b925-8a47-4257-996f-0fb17bd5531a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:23:23.548842 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23298ad4-780b-43dd-a60f-4dc8f6ec0529 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:23.553119 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 237/464] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:23:23 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 25 02:23:23.560679 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12780ff0-2061-4d76-8518-6ebaf4e1323f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:23.561748 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12780ff0-2061-4d76-8518-6ebaf4e1323f admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:23.562235 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12780ff0-2061-4d76-8518-6ebaf4e1323f admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:23.562712 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12780ff0-2061-4d76-8518-6ebaf4e1323f admin admin] PATH_INFO: `/v3/domains` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:23.563673 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12780ff0-2061-4d76-8518-6ebaf4e1323f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:23.564205 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12780ff0-2061-4d76-8518-6ebaf4e1323f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:23.565485 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: WARNING py.warnings [None req-12780ff0-2061-4d76-8518-6ebaf4e1323f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 25 02:23:23.565485 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: warnings.warn(msg) Jan 25 02:23:23.565485 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: Jan 25 02:23:23.566726 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12780ff0-2061-4d76-8518-6ebaf4e1323f admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:23.580858 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a759b925-8a47-4257-996f-0fb17bd5531a None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:23.602558 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a759b925-8a47-4257-996f-0fb17bd5531a None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:23.609159 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 228/465] 10.222.0.117 () {56 vars in 1135 bytes} [Tue Jan 25 02:23:23 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 02:23:23.616127 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12780ff0-2061-4d76-8518-6ebaf4e1323f admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:23.618741 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3ff054-a504-4660-ab68-cfec9181beec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:23.623596 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3ff054-a504-4660-ab68-cfec9181beec admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:23.624212 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3ff054-a504-4660-ab68-cfec9181beec admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:23.628988 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3ff054-a504-4660-ab68-cfec9181beec admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:23.637882 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12780ff0-2061-4d76-8518-6ebaf4e1323f admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:23.649581 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3ff054-a504-4660-ab68-cfec9181beec admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:23.651015 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1ef235-bdcd-4248-89aa-43834818268e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:23.652362 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1ef235-bdcd-4248-89aa-43834818268e admin admin] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:23.652680 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1ef235-bdcd-4248-89aa-43834818268e admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:23.653155 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1ef235-bdcd-4248-89aa-43834818268e admin admin] PATH_INFO: `/v3/users` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:23.653535 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3ff054-a504-4660-ab68-cfec9181beec admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:23.654077 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1ef235-bdcd-4248-89aa-43834818268e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:23.656108 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1ef235-bdcd-4248-89aa-43834818268e admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:23.679592 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 229/466] 10.222.0.117 () {60 vars in 1158 bytes} [Tue Jan 25 02:23:23 2022] POST /identity/v3/users => generated 249 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 02:23:23.679871 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: WARNING keystone.server.flask.application [None req-2f3ff054-a504-4660-ab68-cfec9181beec admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 25 02:23:23.681544 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 238/467] 10.222.0.117 () {56 vars in 1134 bytes} [Tue Jan 25 02:23:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 101 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:23:23.688409 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1ef235-bdcd-4248-89aa-43834818268e admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:23.702341 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1ef235-bdcd-4248-89aa-43834818268e admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:23.708890 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2f8556-2e87-4360-a33e-a03e1d777aa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:23.710000 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2f8556-2e87-4360-a33e-a03e1d777aa3 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:23.710487 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2f8556-2e87-4360-a33e-a03e1d777aa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:23.710962 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2f8556-2e87-4360-a33e-a03e1d777aa3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:23.712043 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2f8556-2e87-4360-a33e-a03e1d777aa3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:23.712576 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2f8556-2e87-4360-a33e-a03e1d777aa3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:23.715306 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2f8556-2e87-4360-a33e-a03e1d777aa3 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:23.731876 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 230/468] 10.222.0.117 () {56 vars in 1135 bytes} [Tue Jan 25 02:23:23 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:23.737656 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3ff054-a504-4660-ab68-cfec9181beec admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:23.750516 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3ff054-a504-4660-ab68-cfec9181beec admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:23.756090 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920d50e8-cdd0-4a70-bf65-1d1b2b68a0e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:23.757186 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920d50e8-cdd0-4a70-bf65-1d1b2b68a0e7 admin admin] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:23.757716 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920d50e8-cdd0-4a70-bf65-1d1b2b68a0e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:23.758234 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920d50e8-cdd0-4a70-bf65-1d1b2b68a0e7 admin admin] PATH_INFO: `/v3/users` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:23.759254 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920d50e8-cdd0-4a70-bf65-1d1b2b68a0e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:23.762205 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920d50e8-cdd0-4a70-bf65-1d1b2b68a0e7 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:23.789788 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 239/469] 10.222.0.117 () {60 vars in 1158 bytes} [Tue Jan 25 02:23:23 2022] POST /identity/v3/users => generated 249 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 02:23:23.808860 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc4cf63-6023-478b-8718-49c35d7ea595 None None] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:23.809677 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc4cf63-6023-478b-8718-49c35d7ea595 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:23.810297 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc4cf63-6023-478b-8718-49c35d7ea595 None None] PATH_INFO: `/` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:23.812483 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 231/470] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:23:23 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:23:23.818689 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671fa4a2-46a4-4e2f-a9f8-59b262f99301 None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:23.818977 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671fa4a2-46a4-4e2f-a9f8-59b262f99301 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:23.819258 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671fa4a2-46a4-4e2f-a9f8-59b262f99301 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:23.846747 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-671fa4a2-46a4-4e2f-a9f8-59b262f99301 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:23:23.848087 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-671fa4a2-46a4-4e2f-a9f8-59b262f99301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:23:23.856767 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 240/471] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:23:23 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 25 02:23:23.885379 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc4cf63-6023-478b-8718-49c35d7ea595 None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:23.904151 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc4cf63-6023-478b-8718-49c35d7ea595 None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:23.910299 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb748733-13dd-4e54-8a39-14aa81f0ef4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:23.911522 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb748733-13dd-4e54-8a39-14aa81f0ef4b admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:23.912067 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb748733-13dd-4e54-8a39-14aa81f0ef4b admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:23.912548 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb748733-13dd-4e54-8a39-14aa81f0ef4b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:23.926601 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb748733-13dd-4e54-8a39-14aa81f0ef4b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:23.928928 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb748733-13dd-4e54-8a39-14aa81f0ef4b admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:23.948063 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: WARNING keystone.server.flask.application [None req-bb748733-13dd-4e54-8a39-14aa81f0ef4b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 25 02:23:23.950610 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 232/472] 10.222.0.117 () {56 vars in 1134 bytes} [Tue Jan 25 02:23:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:23:23.956280 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671fa4a2-46a4-4e2f-a9f8-59b262f99301 None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:23.966964 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671fa4a2-46a4-4e2f-a9f8-59b262f99301 None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:23.972502 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d761c646-a24b-468a-8d73-4c3ac1a3663f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:23.973527 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d761c646-a24b-468a-8d73-4c3ac1a3663f admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:23.974012 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d761c646-a24b-468a-8d73-4c3ac1a3663f admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:23.974541 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d761c646-a24b-468a-8d73-4c3ac1a3663f admin admin] PATH_INFO: `/v3/domains` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:23.975503 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d761c646-a24b-468a-8d73-4c3ac1a3663f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:23.976080 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d761c646-a24b-468a-8d73-4c3ac1a3663f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:23.978099 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d761c646-a24b-468a-8d73-4c3ac1a3663f admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:23.991870 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 241/473] 10.222.0.117 () {56 vars in 1135 bytes} [Tue Jan 25 02:23:23 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 02:23:23.998445 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb748733-13dd-4e54-8a39-14aa81f0ef4b admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:24.012084 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb748733-13dd-4e54-8a39-14aa81f0ef4b admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:24.017420 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9061e050-0c4e-438a-8d2d-45bfa1b03199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:24.018366 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9061e050-0c4e-438a-8d2d-45bfa1b03199 admin admin] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:24.018907 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9061e050-0c4e-438a-8d2d-45bfa1b03199 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:24.019381 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9061e050-0c4e-438a-8d2d-45bfa1b03199 admin admin] PATH_INFO: `/v3/users` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:24.020395 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9061e050-0c4e-438a-8d2d-45bfa1b03199 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:24.022743 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9061e050-0c4e-438a-8d2d-45bfa1b03199 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:24.050119 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 233/474] 10.222.0.117 () {60 vars in 1158 bytes} [Tue Jan 25 02:23:23 2022] POST /identity/v3/users => generated 250 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 02:23:24.442152 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e36f5a-7e21-462f-b95e-f4c714cad47c None None] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:24.443158 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e36f5a-7e21-462f-b95e-f4c714cad47c None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:24.443643 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e36f5a-7e21-462f-b95e-f4c714cad47c None None] PATH_INFO: `/` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:24.445900 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 242/475] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:23:24 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:23:24.451983 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ea8d10-9bc4-4e29-9201-eb7b713656a6 None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:24.452902 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ea8d10-9bc4-4e29-9201-eb7b713656a6 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:24.453382 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ea8d10-9bc4-4e29-9201-eb7b713656a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:24.473537 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-75ea8d10-9bc4-4e29-9201-eb7b713656a6 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:23:24.476234 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-75ea8d10-9bc4-4e29-9201-eb7b713656a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:23:24.489766 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 234/476] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:23:24 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 25 02:23:24.512982 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e36f5a-7e21-462f-b95e-f4c714cad47c None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:24.526231 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e36f5a-7e21-462f-b95e-f4c714cad47c None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:24.534329 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052f62da-5f22-40ff-98ab-08affc34c3f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:24.535311 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052f62da-5f22-40ff-98ab-08affc34c3f1 admin admin] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:24.535861 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052f62da-5f22-40ff-98ab-08affc34c3f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:24.536340 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052f62da-5f22-40ff-98ab-08affc34c3f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:24.537305 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052f62da-5f22-40ff-98ab-08affc34c3f1 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:24.539102 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052f62da-5f22-40ff-98ab-08affc34c3f1 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:24.548884 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.sql.core [None req-052f62da-5f22-40ff-98ab-08affc34c3f1 admin admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jan 25 02:23:24.548884 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jan 25 02:23:24.548884 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [parameters: {'id': '34dcdef56bed40acabe7c8540a41fb7c', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jan 25 02:23:24.548884 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79121) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jan 25 02:23:24.567286 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: WARNING keystone.server.flask.application [None req-052f62da-5f22-40ff-98ab-08affc34c3f1 admin admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jan 25 02:23:24.569374 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 243/477] 10.222.0.117 () {60 vars in 1157 bytes} [Tue Jan 25 02:23:24 2022] POST /identity/v3/roles => generated 144 bytes in 57 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:23:24.576790 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ea8d10-9bc4-4e29-9201-eb7b713656a6 None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:24.586399 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ea8d10-9bc4-4e29-9201-eb7b713656a6 None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:24.601511 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d537a033-c089-4f16-84e1-199ee92e2386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:24.602666 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d537a033-c089-4f16-84e1-199ee92e2386 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:24.603212 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d537a033-c089-4f16-84e1-199ee92e2386 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:24.603731 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d537a033-c089-4f16-84e1-199ee92e2386 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:24.617543 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d537a033-c089-4f16-84e1-199ee92e2386 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 25 02:23:24.625653 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: WARNING keystone.server.flask.application [None req-d537a033-c089-4f16-84e1-199ee92e2386 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jan 25 02:23:24.627386 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 235/478] 10.222.0.117 () {56 vars in 1140 bytes} [Tue Jan 25 02:23:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:23:24.634086 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052f62da-5f22-40ff-98ab-08affc34c3f1 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:24.648968 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052f62da-5f22-40ff-98ab-08affc34c3f1 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:24.657016 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f2e672-e314-4452-8cb9-2730e690fd01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:24.657748 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f2e672-e314-4452-8cb9-2730e690fd01 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:24.658023 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f2e672-e314-4452-8cb9-2730e690fd01 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:24.658290 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f2e672-e314-4452-8cb9-2730e690fd01 admin admin] PATH_INFO: `/v3/roles` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:24.659160 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f2e672-e314-4452-8cb9-2730e690fd01 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:24.659465 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f2e672-e314-4452-8cb9-2730e690fd01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:24.661246 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f2e672-e314-4452-8cb9-2730e690fd01 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:24.671624 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 244/479] 10.222.0.117 () {56 vars in 1137 bytes} [Tue Jan 25 02:23:24 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:26.242667 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eea2251-3d6c-4bc4-bbec-3846842ee72a None None] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:26.243191 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eea2251-3d6c-4bc4-bbec-3846842ee72a None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:26.243191 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eea2251-3d6c-4bc4-bbec-3846842ee72a None None] PATH_INFO: `/` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:26.245265 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 236/480] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:23:26 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:23:26.251589 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917f3035-b92f-49d4-bcc8-c98f270aac70 None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:26.252155 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917f3035-b92f-49d4-bcc8-c98f270aac70 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:26.252155 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917f3035-b92f-49d4-bcc8-c98f270aac70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:26.280795 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-917f3035-b92f-49d4-bcc8-c98f270aac70 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:23:26.282020 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-917f3035-b92f-49d4-bcc8-c98f270aac70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:23:26.290266 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 245/481] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:23:26 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 25 02:23:26.335969 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eea2251-3d6c-4bc4-bbec-3846842ee72a None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:26.356569 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eea2251-3d6c-4bc4-bbec-3846842ee72a None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:26.361136 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d5b8bd-f340-4594-8bb7-44cc388c0d77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:26.361941 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d5b8bd-f340-4594-8bb7-44cc388c0d77 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:26.362218 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d5b8bd-f340-4594-8bb7-44cc388c0d77 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:26.362486 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d5b8bd-f340-4594-8bb7-44cc388c0d77 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:26.378928 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d5b8bd-f340-4594-8bb7-44cc388c0d77 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 25 02:23:26.390665 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: WARNING keystone.server.flask.application [None req-f8d5b8bd-f340-4594-8bb7-44cc388c0d77 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 25 02:23:26.393645 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 237/482] 10.222.0.117 () {56 vars in 1128 bytes} [Tue Jan 25 02:23:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:23:26.402854 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917f3035-b92f-49d4-bcc8-c98f270aac70 None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:26.413913 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917f3035-b92f-49d4-bcc8-c98f270aac70 None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:26.419461 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47a0208-d984-4023-a9e6-29997dcb931b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:26.420408 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47a0208-d984-4023-a9e6-29997dcb931b admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:26.420891 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47a0208-d984-4023-a9e6-29997dcb931b admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:26.421365 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47a0208-d984-4023-a9e6-29997dcb931b admin admin] PATH_INFO: `/v3/roles` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:26.422360 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47a0208-d984-4023-a9e6-29997dcb931b admin admin] RBAC: Adding query filter params (name=service) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:26.422862 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47a0208-d984-4023-a9e6-29997dcb931b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:26.424728 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47a0208-d984-4023-a9e6-29997dcb931b admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:26.435027 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 246/483] 10.222.0.117 () {56 vars in 1129 bytes} [Tue Jan 25 02:23:26 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:26.440680 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d5b8bd-f340-4594-8bb7-44cc388c0d77 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:26.450973 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d5b8bd-f340-4594-8bb7-44cc388c0d77 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:26.455821 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f82d622-5dd7-474c-9b4a-b6fbf732ed7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:26.456831 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f82d622-5dd7-474c-9b4a-b6fbf732ed7a admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:26.457313 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f82d622-5dd7-474c-9b4a-b6fbf732ed7a admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:26.457807 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f82d622-5dd7-474c-9b4a-b6fbf732ed7a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:26.471422 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f82d622-5dd7-474c-9b4a-b6fbf732ed7a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:26.473576 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f82d622-5dd7-474c-9b4a-b6fbf732ed7a admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:26.491284 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: WARNING keystone.server.flask.application [None req-3f82d622-5dd7-474c-9b4a-b6fbf732ed7a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 25 02:23:26.493202 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 238/484] 10.222.0.117 () {56 vars in 1134 bytes} [Tue Jan 25 02:23:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:23:26.499527 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47a0208-d984-4023-a9e6-29997dcb931b admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:26.509733 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47a0208-d984-4023-a9e6-29997dcb931b admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:26.515229 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a52d01-4cf4-4c78-8777-44a08dc94009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:26.516174 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a52d01-4cf4-4c78-8777-44a08dc94009 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:26.516663 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a52d01-4cf4-4c78-8777-44a08dc94009 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:26.517172 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a52d01-4cf4-4c78-8777-44a08dc94009 admin admin] PATH_INFO: `/v3/domains` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:26.518110 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a52d01-4cf4-4c78-8777-44a08dc94009 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:26.518686 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a52d01-4cf4-4c78-8777-44a08dc94009 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:26.520637 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a52d01-4cf4-4c78-8777-44a08dc94009 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:26.522159 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a7a0cb-b8ce-420b-89b2-f7512a1fa542 None None] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:26.522442 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a7a0cb-b8ce-420b-89b2-f7512a1fa542 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:26.522844 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a7a0cb-b8ce-420b-89b2-f7512a1fa542 None None] PATH_INFO: `/` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:26.524780 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 239/485] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:23:26 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jan 25 02:23:26.530642 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee1b1a7-eb99-4c38-8c76-d71a95d675bc None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:26.530932 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee1b1a7-eb99-4c38-8c76-d71a95d675bc None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:26.531207 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee1b1a7-eb99-4c38-8c76-d71a95d675bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:26.537849 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 247/486] 10.222.0.117 () {56 vars in 1135 bytes} [Tue Jan 25 02:23:26 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:26.544240 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a52d01-4cf4-4c78-8777-44a08dc94009 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:26.555491 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a52d01-4cf4-4c78-8777-44a08dc94009 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:26.561214 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032290c1-d0ee-4c2d-970d-e124ce53bc2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:26.562246 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032290c1-d0ee-4c2d-970d-e124ce53bc2b admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:26.562753 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032290c1-d0ee-4c2d-970d-e124ce53bc2b admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:26.563227 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032290c1-d0ee-4c2d-970d-e124ce53bc2b admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:26.566096 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-6ee1b1a7-eb99-4c38-8c76-d71a95d675bc None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:23:26.567338 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-6ee1b1a7-eb99-4c38-8c76-d71a95d675bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:23:26.571964 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032290c1-d0ee-4c2d-970d-e124ce53bc2b admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:26.574824 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032290c1-d0ee-4c2d-970d-e124ce53bc2b admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:26.585963 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 240/487] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:23:26 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 25 02:23:26.596937 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: WARNING keystone.server.flask.application [None req-032290c1-d0ee-4c2d-970d-e124ce53bc2b admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jan 25 02:23:26.598724 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 248/488] 10.222.0.117 () {56 vars in 1119 bytes} [Tue Jan 25 02:23:26 2022] GET /identity/v3/users/nova => generated 82 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 25 02:23:26.604298 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee1b1a7-eb99-4c38-8c76-d71a95d675bc None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:26.615016 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee1b1a7-eb99-4c38-8c76-d71a95d675bc None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:26.619969 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e55282e-c799-488c-96ea-f4afabdfa652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:26.620898 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e55282e-c799-488c-96ea-f4afabdfa652 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:26.621385 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e55282e-c799-488c-96ea-f4afabdfa652 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:26.621858 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e55282e-c799-488c-96ea-f4afabdfa652 admin admin] PATH_INFO: `/v3/users` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:26.622960 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e55282e-c799-488c-96ea-f4afabdfa652 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:26.624502 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032290c1-d0ee-4c2d-970d-e124ce53bc2b admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:26.634509 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032290c1-d0ee-4c2d-970d-e124ce53bc2b admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:26.634844 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e55282e-c799-488c-96ea-f4afabdfa652 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:26.636689 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: WARNING py.warnings [None req-3e55282e-c799-488c-96ea-f4afabdfa652 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_users": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 25 02:23:26.636689 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: warnings.warn(msg) Jan 25 02:23:26.636689 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: Jan 25 02:23:26.639607 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e55282e-c799-488c-96ea-f4afabdfa652 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:26.653706 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97f6961-c9fc-412d-b126-72574bbf23c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:26.654516 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97f6961-c9fc-412d-b126-72574bbf23c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:26.654795 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97f6961-c9fc-412d-b126-72574bbf23c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:26.655066 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97f6961-c9fc-412d-b126-72574bbf23c2 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:26.666710 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97f6961-c9fc-412d-b126-72574bbf23c2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 25 02:23:26.675849 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: WARNING keystone.server.flask.application [None req-d97f6961-c9fc-412d-b126-72574bbf23c2 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 25 02:23:26.680708 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 249/489] 10.222.0.117 () {56 vars in 1128 bytes} [Tue Jan 25 02:23:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 25 02:23:26.682081 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bdf22e-205a-4452-b45f-e5f09c40c2fb None None] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:26.682368 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bdf22e-205a-4452-b45f-e5f09c40c2fb None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:26.682646 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bdf22e-205a-4452-b45f-e5f09c40c2fb None None] PATH_INFO: `/` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:26.686070 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 250/490] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:23:26 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:23:26.686070 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bdf22e-205a-4452-b45f-e5f09c40c2fb None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:26.704628 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bdf22e-205a-4452-b45f-e5f09c40c2fb None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:26.709235 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b40230-db39-402f-8f14-38bf13188e79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:26.709784 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b40230-db39-402f-8f14-38bf13188e79 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:26.709997 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 241/491] 10.222.0.117 () {56 vars in 1159 bytes} [Tue Jan 25 02:23:26 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 370 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:26.710096 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b40230-db39-402f-8f14-38bf13188e79 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:26.710273 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b40230-db39-402f-8f14-38bf13188e79 admin admin] PATH_INFO: `/v3/roles` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:26.715515 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b40230-db39-402f-8f14-38bf13188e79 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:26.715515 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b40230-db39-402f-8f14-38bf13188e79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:26.715515 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b40230-db39-402f-8f14-38bf13188e79 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:26.717996 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0a7caa-faab-4f54-a78a-0f6479a69087 None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:26.718869 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0a7caa-faab-4f54-a78a-0f6479a69087 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:26.720098 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0a7caa-faab-4f54-a78a-0f6479a69087 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:26.728121 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 251/492] 10.222.0.117 () {56 vars in 1129 bytes} [Tue Jan 25 02:23:26 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:26.730254 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b40230-db39-402f-8f14-38bf13188e79 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:26.746182 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b40230-db39-402f-8f14-38bf13188e79 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:26.751530 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-9b0a7caa-faab-4f54-a78a-0f6479a69087 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:23:26.752798 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-9b0a7caa-faab-4f54-a78a-0f6479a69087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:23:26.761942 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7cb0e3-6b0f-46b0-b064-12ef76a2322e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:26.762600 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7cb0e3-6b0f-46b0-b064-12ef76a2322e admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:26.762882 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7cb0e3-6b0f-46b0-b064-12ef76a2322e admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:26.763154 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7cb0e3-6b0f-46b0-b064-12ef76a2322e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:26.770469 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 242/493] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:23:26 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 25 02:23:26.772189 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0a7caa-faab-4f54-a78a-0f6479a69087 None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:26.782086 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0a7caa-faab-4f54-a78a-0f6479a69087 None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:26.784759 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7cb0e3-6b0f-46b0-b064-12ef76a2322e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:26.786546 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7cb0e3-6b0f-46b0-b064-12ef76a2322e admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:26.787602 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd0b1a5-e5da-480b-bb15-1e5f36ab269e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:26.788665 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd0b1a5-e5da-480b-bb15-1e5f36ab269e admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:26.789149 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd0b1a5-e5da-480b-bb15-1e5f36ab269e admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:26.789669 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd0b1a5-e5da-480b-bb15-1e5f36ab269e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:26.802332 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd0b1a5-e5da-480b-bb15-1e5f36ab269e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:26.805013 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd0b1a5-e5da-480b-bb15-1e5f36ab269e admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:26.806909 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 252/494] 10.222.0.117 () {58 vars in 1329 bytes} [Tue Jan 25 02:23:26 2022] GET /identity/v3/auth/tokens => generated 915 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 25 02:23:26.807747 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7cb0e3-6b0f-46b0-b064-12ef76a2322e admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:26.817918 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7cb0e3-6b0f-46b0-b064-12ef76a2322e admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:26.822344 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656359d5-9094-44ec-a50a-33dd6f674cfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:26.823115 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656359d5-9094-44ec-a50a-33dd6f674cfe admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:26.823395 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656359d5-9094-44ec-a50a-33dd6f674cfe admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:26.824271 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656359d5-9094-44ec-a50a-33dd6f674cfe admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:26.828670 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: WARNING keystone.server.flask.application [None req-8dd0b1a5-e5da-480b-bb15-1e5f36ab269e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 25 02:23:26.830792 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 243/495] 10.222.0.117 () {56 vars in 1134 bytes} [Tue Jan 25 02:23:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:23:26.831801 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd0b1a5-e5da-480b-bb15-1e5f36ab269e admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:26.840466 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656359d5-9094-44ec-a50a-33dd6f674cfe admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 25 02:23:26.843355 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd0b1a5-e5da-480b-bb15-1e5f36ab269e admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:26.848062 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: WARNING keystone.server.flask.application [None req-656359d5-9094-44ec-a50a-33dd6f674cfe admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 25 02:23:26.850030 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89283db8-cbc8-44ac-bce1-c65b5219c265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:26.851027 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89283db8-cbc8-44ac-bce1-c65b5219c265 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:26.851509 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89283db8-cbc8-44ac-bce1-c65b5219c265 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:26.852006 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89283db8-cbc8-44ac-bce1-c65b5219c265 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:26.854036 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 253/496] 10.222.0.117 () {56 vars in 1128 bytes} [Tue Jan 25 02:23:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:23:26.855435 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656359d5-9094-44ec-a50a-33dd6f674cfe admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:26.865578 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89283db8-cbc8-44ac-bce1-c65b5219c265 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:26.865997 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656359d5-9094-44ec-a50a-33dd6f674cfe admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:26.868629 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89283db8-cbc8-44ac-bce1-c65b5219c265 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:26.871420 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45ace03-89ca-4d28-b50d-cab54814d8d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:26.872253 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45ace03-89ca-4d28-b50d-cab54814d8d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:26.872535 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45ace03-89ca-4d28-b50d-cab54814d8d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:26.872810 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45ace03-89ca-4d28-b50d-cab54814d8d0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:26.873596 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45ace03-89ca-4d28-b50d-cab54814d8d0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:26.873946 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45ace03-89ca-4d28-b50d-cab54814d8d0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:26.875586 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45ace03-89ca-4d28-b50d-cab54814d8d0 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:26.889687 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 254/497] 10.222.0.117 () {56 vars in 1135 bytes} [Tue Jan 25 02:23:26 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:26.890517 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45ace03-89ca-4d28-b50d-cab54814d8d0 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:26.892503 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: WARNING keystone.server.flask.application [None req-89283db8-cbc8-44ac-bce1-c65b5219c265 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 25 02:23:26.893905 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 244/498] 10.222.0.117 () {56 vars in 1134 bytes} [Tue Jan 25 02:23:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:23:26.900472 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89283db8-cbc8-44ac-bce1-c65b5219c265 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:26.909404 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45ace03-89ca-4d28-b50d-cab54814d8d0 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:26.912506 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89283db8-cbc8-44ac-bce1-c65b5219c265 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:26.914072 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48185964-e8f4-499c-9ae0-1689f66c2abf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:26.914776 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48185964-e8f4-499c-9ae0-1689f66c2abf admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:26.915080 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48185964-e8f4-499c-9ae0-1689f66c2abf admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:26.915383 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48185964-e8f4-499c-9ae0-1689f66c2abf admin admin] PATH_INFO: `/v3/roles` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:26.916188 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48185964-e8f4-499c-9ae0-1689f66c2abf admin admin] RBAC: Adding query filter params (name=service) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:26.916592 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48185964-e8f4-499c-9ae0-1689f66c2abf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:26.919198 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48185964-e8f4-499c-9ae0-1689f66c2abf admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:26.919813 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd43496-0773-4d9c-bba0-0ec44bac8f69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:26.920996 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd43496-0773-4d9c-bba0-0ec44bac8f69 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:26.921493 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd43496-0773-4d9c-bba0-0ec44bac8f69 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:26.922287 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd43496-0773-4d9c-bba0-0ec44bac8f69 admin admin] PATH_INFO: `/v3/users/glance` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:26.928817 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 255/499] 10.222.0.117 () {56 vars in 1129 bytes} [Tue Jan 25 02:23:26 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:26.931411 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd43496-0773-4d9c-bba0-0ec44bac8f69 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:26.934623 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48185964-e8f4-499c-9ae0-1689f66c2abf admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:26.935273 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd43496-0773-4d9c-bba0-0ec44bac8f69 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:26.944518 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48185964-e8f4-499c-9ae0-1689f66c2abf admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:26.949904 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892cc6f3-ecc5-497d-a174-b0e7ba0c2a01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:26.950686 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892cc6f3-ecc5-497d-a174-b0e7ba0c2a01 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:26.951160 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892cc6f3-ecc5-497d-a174-b0e7ba0c2a01 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:26.951764 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892cc6f3-ecc5-497d-a174-b0e7ba0c2a01 admin admin] PATH_INFO: `/v3/domains` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:26.953163 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892cc6f3-ecc5-497d-a174-b0e7ba0c2a01 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:26.953788 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892cc6f3-ecc5-497d-a174-b0e7ba0c2a01 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:26.953996 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: WARNING keystone.server.flask.application [None req-abd43496-0773-4d9c-bba0-0ec44bac8f69 admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jan 25 02:23:26.955653 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 245/500] 10.222.0.117 () {56 vars in 1125 bytes} [Tue Jan 25 02:23:26 2022] GET /identity/v3/users/glance => generated 84 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 25 02:23:26.956606 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd43496-0773-4d9c-bba0-0ec44bac8f69 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:26.960541 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892cc6f3-ecc5-497d-a174-b0e7ba0c2a01 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:26.970914 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd43496-0773-4d9c-bba0-0ec44bac8f69 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:26.975738 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 256/501] 10.222.0.117 () {56 vars in 1135 bytes} [Tue Jan 25 02:23:26 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:26.979813 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892cc6f3-ecc5-497d-a174-b0e7ba0c2a01 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:26.984526 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671c181c-e662-406a-80a9-9a75ecfca8b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:26.985784 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671c181c-e662-406a-80a9-9a75ecfca8b2 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:26.986895 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671c181c-e662-406a-80a9-9a75ecfca8b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:26.987354 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671c181c-e662-406a-80a9-9a75ecfca8b2 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:26.990104 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892cc6f3-ecc5-497d-a174-b0e7ba0c2a01 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:26.994802 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9f02e9-1822-40a4-ab48-b860b856b5b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:26.996246 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9f02e9-1822-40a4-ab48-b860b856b5b2 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:26.996580 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9f02e9-1822-40a4-ab48-b860b856b5b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:26.997495 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9f02e9-1822-40a4-ab48-b860b856b5b2 admin admin] PATH_INFO: `/v3/users` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:26.998106 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9f02e9-1822-40a4-ab48-b860b856b5b2 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:26.998480 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9f02e9-1822-40a4-ab48-b860b856b5b2 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:26.999846 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: WARNING py.warnings [None req-6e9f02e9-1822-40a4-ab48-b860b856b5b2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_users": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 25 02:23:26.999846 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: warnings.warn(msg) Jan 25 02:23:26.999846 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: Jan 25 02:23:27.000990 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9f02e9-1822-40a4-ab48-b860b856b5b2 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:27.002498 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671c181c-e662-406a-80a9-9a75ecfca8b2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:27.004897 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671c181c-e662-406a-80a9-9a75ecfca8b2 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:27.026448 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: WARNING keystone.server.flask.application [None req-671c181c-e662-406a-80a9-9a75ecfca8b2 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 25 02:23:27.029001 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 246/502] 10.222.0.117 () {56 vars in 1134 bytes} [Tue Jan 25 02:23:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:23:27.030081 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671c181c-e662-406a-80a9-9a75ecfca8b2 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:27.042645 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671c181c-e662-406a-80a9-9a75ecfca8b2 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:27.049861 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 257/503] 10.222.0.117 () {56 vars in 1163 bytes} [Tue Jan 25 02:23:26 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 374 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:27.050606 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c41c6a6-be24-4b4e-9a32-ae0ee09b6199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:27.051620 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c41c6a6-be24-4b4e-9a32-ae0ee09b6199 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:27.052085 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c41c6a6-be24-4b4e-9a32-ae0ee09b6199 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:27.052522 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c41c6a6-be24-4b4e-9a32-ae0ee09b6199 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:27.055117 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9f02e9-1822-40a4-ab48-b860b856b5b2 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:27.066208 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9f02e9-1822-40a4-ab48-b860b856b5b2 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:27.067027 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c41c6a6-be24-4b4e-9a32-ae0ee09b6199 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:27.069865 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c41c6a6-be24-4b4e-9a32-ae0ee09b6199 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:27.071158 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec022f0-9741-4873-970c-abc280c77716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:27.071959 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec022f0-9741-4873-970c-abc280c77716 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:27.072396 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec022f0-9741-4873-970c-abc280c77716 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:27.072695 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec022f0-9741-4873-970c-abc280c77716 admin admin] PATH_INFO: `/v3/domains` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:27.074575 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec022f0-9741-4873-970c-abc280c77716 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:27.075251 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec022f0-9741-4873-970c-abc280c77716 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:27.077374 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec022f0-9741-4873-970c-abc280c77716 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:27.087758 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: WARNING keystone.server.flask.application [None req-3c41c6a6-be24-4b4e-9a32-ae0ee09b6199 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 25 02:23:27.094149 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 247/504] 10.222.0.117 () {56 vars in 1137 bytes} [Tue Jan 25 02:23:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:23:27.094394 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 258/505] 10.222.0.117 () {56 vars in 1135 bytes} [Tue Jan 25 02:23:27 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:27.095643 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec022f0-9741-4873-970c-abc280c77716 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:27.095863 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c41c6a6-be24-4b4e-9a32-ae0ee09b6199 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:27.106235 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec022f0-9741-4873-970c-abc280c77716 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:27.108291 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c41c6a6-be24-4b4e-9a32-ae0ee09b6199 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:27.110966 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7a1f41-d20b-4881-9eda-b40bd4ae17fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:27.111960 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7a1f41-d20b-4881-9eda-b40bd4ae17fc admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:27.112315 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7a1f41-d20b-4881-9eda-b40bd4ae17fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:27.112651 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7a1f41-d20b-4881-9eda-b40bd4ae17fc admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:27.114352 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea0ce0d-b1fd-4db3-95e0-367b3561f9b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:27.115422 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea0ce0d-b1fd-4db3-95e0-367b3561f9b4 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:27.116474 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea0ce0d-b1fd-4db3-95e0-367b3561f9b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:27.116948 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea0ce0d-b1fd-4db3-95e0-367b3561f9b4 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:27.123143 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7a1f41-d20b-4881-9eda-b40bd4ae17fc admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:27.125454 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7a1f41-d20b-4881-9eda-b40bd4ae17fc admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:27.127196 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea0ce0d-b1fd-4db3-95e0-367b3561f9b4 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:27.129332 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea0ce0d-b1fd-4db3-95e0-367b3561f9b4 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:27.144659 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: WARNING keystone.server.flask.application [None req-ce7a1f41-d20b-4881-9eda-b40bd4ae17fc admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jan 25 02:23:27.145011 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 248/506] 10.222.0.117 () {58 vars in 1329 bytes} [Tue Jan 25 02:23:27 2022] GET /identity/v3/auth/tokens => generated 915 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 25 02:23:27.145877 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea0ce0d-b1fd-4db3-95e0-367b3561f9b4 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:27.147049 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 259/507] 10.222.0.117 () {56 vars in 1125 bytes} [Tue Jan 25 02:23:27 2022] GET /identity/v3/users/cinder => generated 84 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:23:27.148098 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7a1f41-d20b-4881-9eda-b40bd4ae17fc admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:27.160024 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7a1f41-d20b-4881-9eda-b40bd4ae17fc admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:27.160576 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea0ce0d-b1fd-4db3-95e0-367b3561f9b4 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:27.165131 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02e8a85-5881-42c8-835b-08311abd6537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:27.165777 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02e8a85-5881-42c8-835b-08311abd6537 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:27.166058 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02e8a85-5881-42c8-835b-08311abd6537 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:27.166394 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02e8a85-5881-42c8-835b-08311abd6537 admin admin] PATH_INFO: `/v3/projects` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:27.166498 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63620c74-e694-42ad-a3a2-2ef7f9f292fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:27.167226 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02e8a85-5881-42c8-835b-08311abd6537 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:27.168191 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02e8a85-5881-42c8-835b-08311abd6537 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:27.168695 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63620c74-e694-42ad-a3a2-2ef7f9f292fe admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:27.169174 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63620c74-e694-42ad-a3a2-2ef7f9f292fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:27.169291 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: WARNING py.warnings [None req-f02e8a85-5881-42c8-835b-08311abd6537 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 25 02:23:27.169291 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: warnings.warn(msg) Jan 25 02:23:27.169291 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: Jan 25 02:23:27.169885 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63620c74-e694-42ad-a3a2-2ef7f9f292fe admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:27.170444 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02e8a85-5881-42c8-835b-08311abd6537 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:27.182677 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63620c74-e694-42ad-a3a2-2ef7f9f292fe admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:27.185511 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63620c74-e694-42ad-a3a2-2ef7f9f292fe admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:27.189768 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 249/508] 10.222.0.117 () {56 vars in 1174 bytes} [Tue Jan 25 02:23:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:27.191801 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02e8a85-5881-42c8-835b-08311abd6537 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:27.204968 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02e8a85-5881-42c8-835b-08311abd6537 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:27.209807 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc50c2a1-a086-4611-bebe-8869367aaf1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:27.210683 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc50c2a1-a086-4611-bebe-8869367aaf1b admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:27.211071 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: WARNING keystone.server.flask.application [None req-63620c74-e694-42ad-a3a2-2ef7f9f292fe admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 25 02:23:27.211289 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc50c2a1-a086-4611-bebe-8869367aaf1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:27.211724 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc50c2a1-a086-4611-bebe-8869367aaf1b admin admin] PATH_INFO: `/v3/users` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:27.212610 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 260/509] 10.222.0.117 () {56 vars in 1134 bytes} [Tue Jan 25 02:23:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:23:27.212919 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc50c2a1-a086-4611-bebe-8869367aaf1b admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:27.213367 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc50c2a1-a086-4611-bebe-8869367aaf1b admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:27.213679 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63620c74-e694-42ad-a3a2-2ef7f9f292fe admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:27.216475 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc50c2a1-a086-4611-bebe-8869367aaf1b admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:27.226085 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63620c74-e694-42ad-a3a2-2ef7f9f292fe admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:27.232161 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e5d9c4-deae-4613-9384-704e28fee84e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:27.232989 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e5d9c4-deae-4613-9384-704e28fee84e admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:27.233374 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e5d9c4-deae-4613-9384-704e28fee84e admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:27.233749 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e5d9c4-deae-4613-9384-704e28fee84e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:27.235382 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e5d9c4-deae-4613-9384-704e28fee84e admin admin] RBAC: Adding query filter params (role.id=8e4691cb5a4b4439b9712d27ef133c20, scope.project.id=61a6fe9d4c914755bb0a64c392bd16aa, user.id=d9ad6269900346458050063c12cac299) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:27.235855 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e5d9c4-deae-4613-9384-704e28fee84e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:27.238353 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e5d9c4-deae-4613-9384-704e28fee84e admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:27.243271 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 250/510] 10.222.0.117 () {56 vars in 1163 bytes} [Tue Jan 25 02:23:27 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 374 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:27.244662 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc50c2a1-a086-4611-bebe-8869367aaf1b admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:27.244987 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 261/511] 10.222.0.117 () {56 vars in 1400 bytes} [Tue Jan 25 02:23:27 2022] GET /identity/v3/role_assignments?user.id=d9ad6269900346458050063c12cac299&scope.project.id=61a6fe9d4c914755bb0a64c392bd16aa&role.id=8e4691cb5a4b4439b9712d27ef133c20 => generated 260 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:27.247079 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e5d9c4-deae-4613-9384-704e28fee84e admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:27.255553 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc50c2a1-a086-4611-bebe-8869367aaf1b admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:27.259180 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e5d9c4-deae-4613-9384-704e28fee84e admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:27.263109 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab60051-c634-495f-bab1-579a0b321da0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:27.264053 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab60051-c634-495f-bab1-579a0b321da0 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:27.264504 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab60051-c634-495f-bab1-579a0b321da0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:27.265199 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab60051-c634-495f-bab1-579a0b321da0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:27.265930 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9455ec-8d29-4a4d-b1a6-72bbd424699c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:27.266298 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab60051-c634-495f-bab1-579a0b321da0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:27.266762 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab60051-c634-495f-bab1-579a0b321da0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:27.266865 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9455ec-8d29-4a4d-b1a6-72bbd424699c admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:27.267254 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9455ec-8d29-4a4d-b1a6-72bbd424699c admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:27.267670 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9455ec-8d29-4a4d-b1a6-72bbd424699c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:27.269121 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab60051-c634-495f-bab1-579a0b321da0 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:27.279808 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9455ec-8d29-4a4d-b1a6-72bbd424699c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:27.282142 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9455ec-8d29-4a4d-b1a6-72bbd424699c admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:27.283314 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 251/512] 10.222.0.117 () {56 vars in 1135 bytes} [Tue Jan 25 02:23:27 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:27.285092 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4795f1-9586-421c-a26d-402d8c71966b None None] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:27.285600 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4795f1-9586-421c-a26d-402d8c71966b None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:27.286073 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4795f1-9586-421c-a26d-402d8c71966b None None] PATH_INFO: `/` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:27.288510 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 252/513] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:23:27 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:23:27.289530 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4795f1-9586-421c-a26d-402d8c71966b None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:27.294076 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 262/514] 10.222.0.117 () {58 vars in 1329 bytes} [Tue Jan 25 02:23:27 2022] GET /identity/v3/auth/tokens => generated 915 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 25 02:23:27.295511 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f8963d-b3f3-42a3-ab41-1b27cdee6732 None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:27.295843 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f8963d-b3f3-42a3-ab41-1b27cdee6732 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:27.296123 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f8963d-b3f3-42a3-ab41-1b27cdee6732 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:27.308757 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4795f1-9586-421c-a26d-402d8c71966b None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:27.313601 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d017f888-9518-4148-9bb2-f8d027f094ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:27.314398 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d017f888-9518-4148-9bb2-f8d027f094ca admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:27.314677 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d017f888-9518-4148-9bb2-f8d027f094ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:27.314949 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d017f888-9518-4148-9bb2-f8d027f094ca admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:27.317517 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-24f8963d-b3f3-42a3-ab41-1b27cdee6732 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:23:27.319191 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-24f8963d-b3f3-42a3-ab41-1b27cdee6732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:23:27.323039 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d017f888-9518-4148-9bb2-f8d027f094ca admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:27.326671 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d017f888-9518-4148-9bb2-f8d027f094ca admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:27.328687 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 263/515] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:23:27 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 25 02:23:27.329570 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f8963d-b3f3-42a3-ab41-1b27cdee6732 None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:27.340555 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f8963d-b3f3-42a3-ab41-1b27cdee6732 None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:27.354306 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502b768e-7041-4093-b898-17f585489a9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:27.356183 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502b768e-7041-4093-b898-17f585489a9f admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:27.356524 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502b768e-7041-4093-b898-17f585489a9f admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:27.356800 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502b768e-7041-4093-b898-17f585489a9f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:27.363320 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: WARNING keystone.server.flask.application [None req-d017f888-9518-4148-9bb2-f8d027f094ca admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 25 02:23:27.364928 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 253/516] 10.222.0.117 () {56 vars in 1137 bytes} [Tue Jan 25 02:23:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:23:27.366277 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d017f888-9518-4148-9bb2-f8d027f094ca admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:27.376218 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502b768e-7041-4093-b898-17f585489a9f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:27.377676 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d017f888-9518-4148-9bb2-f8d027f094ca admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:27.379024 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502b768e-7041-4093-b898-17f585489a9f admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:27.383126 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bc2516-6850-46f3-90fe-d3b468dfaeaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:27.383984 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bc2516-6850-46f3-90fe-d3b468dfaeaa admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:27.384270 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bc2516-6850-46f3-90fe-d3b468dfaeaa admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:27.384546 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bc2516-6850-46f3-90fe-d3b468dfaeaa admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:27.400182 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: WARNING keystone.server.flask.application [None req-502b768e-7041-4093-b898-17f585489a9f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 25 02:23:27.411534 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bc2516-6850-46f3-90fe-d3b468dfaeaa admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 25 02:23:27.412044 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 264/517] 10.222.0.117 () {56 vars in 1134 bytes} [Tue Jan 25 02:23:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:23:27.413263 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: WARNING keystone.server.flask.application [None req-75bc2516-6850-46f3-90fe-d3b468dfaeaa admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 25 02:23:27.414441 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502b768e-7041-4093-b898-17f585489a9f admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:27.416090 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 254/518] 10.222.0.117 () {56 vars in 1128 bytes} [Tue Jan 25 02:23:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:23:27.416883 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bc2516-6850-46f3-90fe-d3b468dfaeaa admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:27.433991 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bc2516-6850-46f3-90fe-d3b468dfaeaa admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:27.438436 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e723e93-a63c-4c75-abdf-e29df2a9ec95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:27.439098 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e723e93-a63c-4c75-abdf-e29df2a9ec95 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:27.439382 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e723e93-a63c-4c75-abdf-e29df2a9ec95 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:27.439655 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e723e93-a63c-4c75-abdf-e29df2a9ec95 admin admin] PATH_INFO: `/v3/domains` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:27.440437 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e723e93-a63c-4c75-abdf-e29df2a9ec95 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:27.440742 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e723e93-a63c-4c75-abdf-e29df2a9ec95 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:27.441752 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502b768e-7041-4093-b898-17f585489a9f admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:27.442382 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e723e93-a63c-4c75-abdf-e29df2a9ec95 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:27.451737 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e11ef4-2f8e-4a79-9122-04d1c09e780d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:27.452790 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e11ef4-2f8e-4a79-9122-04d1c09e780d admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:27.452790 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e11ef4-2f8e-4a79-9122-04d1c09e780d admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:27.453035 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e11ef4-2f8e-4a79-9122-04d1c09e780d admin admin] PATH_INFO: `/v3/projects` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:27.453933 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e11ef4-2f8e-4a79-9122-04d1c09e780d admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:27.454241 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e11ef4-2f8e-4a79-9122-04d1c09e780d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:27.455335 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: WARNING py.warnings [None req-82e11ef4-2f8e-4a79-9122-04d1c09e780d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 25 02:23:27.455335 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: warnings.warn(msg) Jan 25 02:23:27.455335 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: Jan 25 02:23:27.456587 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e11ef4-2f8e-4a79-9122-04d1c09e780d admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:27.457215 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 255/519] 10.222.0.117 () {56 vars in 1135 bytes} [Tue Jan 25 02:23:27 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:27.458072 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e723e93-a63c-4c75-abdf-e29df2a9ec95 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:27.469569 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e723e93-a63c-4c75-abdf-e29df2a9ec95 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:27.474506 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d081f0f1-733b-4958-b8a3-6e57b6c5da67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:27.475300 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d081f0f1-733b-4958-b8a3-6e57b6c5da67 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:27.475474 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d081f0f1-733b-4958-b8a3-6e57b6c5da67 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:27.475790 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d081f0f1-733b-4958-b8a3-6e57b6c5da67 admin admin] PATH_INFO: `/v3/roles` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:27.476581 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d081f0f1-733b-4958-b8a3-6e57b6c5da67 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:27.476890 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d081f0f1-733b-4958-b8a3-6e57b6c5da67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:27.478384 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 265/520] 10.222.0.117 () {56 vars in 1174 bytes} [Tue Jan 25 02:23:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:27.478568 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d081f0f1-733b-4958-b8a3-6e57b6c5da67 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:27.480328 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e11ef4-2f8e-4a79-9122-04d1c09e780d admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:27.488620 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 256/521] 10.222.0.117 () {56 vars in 1129 bytes} [Tue Jan 25 02:23:27 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:27.489493 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d081f0f1-733b-4958-b8a3-6e57b6c5da67 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:27.491375 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e11ef4-2f8e-4a79-9122-04d1c09e780d admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:27.498295 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4611a36-8ae0-4636-9b78-b30537dfe3ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:27.500055 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4611a36-8ae0-4636-9b78-b30537dfe3ad admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:27.500622 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4611a36-8ae0-4636-9b78-b30537dfe3ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:27.501073 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4611a36-8ae0-4636-9b78-b30537dfe3ad admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:27.501656 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d081f0f1-733b-4958-b8a3-6e57b6c5da67 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:27.506676 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1922e63d-6051-48cb-8ae0-7711f28dab7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:27.507429 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1922e63d-6051-48cb-8ae0-7711f28dab7b admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:27.507848 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1922e63d-6051-48cb-8ae0-7711f28dab7b admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:27.508172 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1922e63d-6051-48cb-8ae0-7711f28dab7b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:27.509087 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1922e63d-6051-48cb-8ae0-7711f28dab7b admin admin] RBAC: Adding query filter params (role.id=8e4691cb5a4b4439b9712d27ef133c20, scope.project.id=61a6fe9d4c914755bb0a64c392bd16aa, user.id=db3663416137459d9da4a71032505b0b) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:27.509455 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1922e63d-6051-48cb-8ae0-7711f28dab7b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:27.511881 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4611a36-8ae0-4636-9b78-b30537dfe3ad admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:27.512019 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1922e63d-6051-48cb-8ae0-7711f28dab7b admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:27.514443 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4611a36-8ae0-4636-9b78-b30537dfe3ad admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:27.518398 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 257/522] 10.222.0.117 () {56 vars in 1400 bytes} [Tue Jan 25 02:23:27 2022] GET /identity/v3/role_assignments?user.id=db3663416137459d9da4a71032505b0b&scope.project.id=61a6fe9d4c914755bb0a64c392bd16aa&role.id=8e4691cb5a4b4439b9712d27ef133c20 => generated 260 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:27.519063 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1922e63d-6051-48cb-8ae0-7711f28dab7b admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:27.530202 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1922e63d-6051-48cb-8ae0-7711f28dab7b admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:27.531817 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: WARNING keystone.server.flask.application [None req-a4611a36-8ae0-4636-9b78-b30537dfe3ad admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 25 02:23:27.533553 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 266/523] 10.222.0.117 () {56 vars in 1137 bytes} [Tue Jan 25 02:23:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:23:27.535144 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb40f22-a9ae-4e02-ab79-1f48b52c57d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:27.539846 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb40f22-a9ae-4e02-ab79-1f48b52c57d6 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:27.539846 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb40f22-a9ae-4e02-ab79-1f48b52c57d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:27.539846 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb40f22-a9ae-4e02-ab79-1f48b52c57d6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:27.543868 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4611a36-8ae0-4636-9b78-b30537dfe3ad admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:27.552864 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb40f22-a9ae-4e02-ab79-1f48b52c57d6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:27.555176 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb40f22-a9ae-4e02-ab79-1f48b52c57d6 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:27.569313 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4611a36-8ae0-4636-9b78-b30537dfe3ad admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:27.579843 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccbd4a2-547c-41a9-9b6d-ccff6761ea6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:27.582459 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccbd4a2-547c-41a9-9b6d-ccff6761ea6b admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:27.582998 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccbd4a2-547c-41a9-9b6d-ccff6761ea6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:27.583469 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccbd4a2-547c-41a9-9b6d-ccff6761ea6b admin admin] PATH_INFO: `/v3/projects` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:27.584548 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccbd4a2-547c-41a9-9b6d-ccff6761ea6b admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:27.596298 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccbd4a2-547c-41a9-9b6d-ccff6761ea6b admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:27.596910 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: WARNING keystone.server.flask.application [None req-ebb40f22-a9ae-4e02-ab79-1f48b52c57d6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 25 02:23:27.598299 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccbd4a2-547c-41a9-9b6d-ccff6761ea6b admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:27.599016 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 258/524] 10.222.0.117 () {56 vars in 1134 bytes} [Tue Jan 25 02:23:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:23:27.617276 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb40f22-a9ae-4e02-ab79-1f48b52c57d6 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:27.622988 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 267/525] 10.222.0.117 () {56 vars in 1174 bytes} [Tue Jan 25 02:23:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:27.624557 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccbd4a2-547c-41a9-9b6d-ccff6761ea6b admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:27.634769 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccbd4a2-547c-41a9-9b6d-ccff6761ea6b admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:27.642494 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb40f22-a9ae-4e02-ab79-1f48b52c57d6 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:27.645056 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2583c2-751a-42d6-9875-26aa3c04762d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:27.645819 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2583c2-751a-42d6-9875-26aa3c04762d admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:27.646331 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2583c2-751a-42d6-9875-26aa3c04762d admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:27.646677 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2583c2-751a-42d6-9875-26aa3c04762d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:27.647614 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2583c2-751a-42d6-9875-26aa3c04762d admin admin] RBAC: Adding query filter params (role.id=8e4691cb5a4b4439b9712d27ef133c20, scope.project.id=61a6fe9d4c914755bb0a64c392bd16aa, user.id=1cc5249aea09430080e232cf17757f86) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:27.648518 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2583c2-751a-42d6-9875-26aa3c04762d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:27.650861 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2583c2-751a-42d6-9875-26aa3c04762d admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:27.658207 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9506d76-1e37-4f7e-83fc-620c8f4972a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:27.658899 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9506d76-1e37-4f7e-83fc-620c8f4972a3 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:27.659179 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9506d76-1e37-4f7e-83fc-620c8f4972a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:27.659454 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9506d76-1e37-4f7e-83fc-620c8f4972a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:27.660260 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9506d76-1e37-4f7e-83fc-620c8f4972a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:27.660547 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9506d76-1e37-4f7e-83fc-620c8f4972a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:27.662156 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9506d76-1e37-4f7e-83fc-620c8f4972a3 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:27.666910 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 268/526] 10.222.0.117 () {56 vars in 1400 bytes} [Tue Jan 25 02:23:27 2022] GET /identity/v3/role_assignments?user.id=1cc5249aea09430080e232cf17757f86&scope.project.id=61a6fe9d4c914755bb0a64c392bd16aa&role.id=8e4691cb5a4b4439b9712d27ef133c20 => generated 260 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 02:23:27.690432 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 259/527] 10.222.0.117 () {56 vars in 1135 bytes} [Tue Jan 25 02:23:27 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:27.695970 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2583c2-751a-42d6-9875-26aa3c04762d admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:27.706647 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2583c2-751a-42d6-9875-26aa3c04762d admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:27.716976 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4a6db0-efd4-4e4b-bb55-e8228a8bf566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:27.717787 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4a6db0-efd4-4e4b-bb55-e8228a8bf566 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:27.718070 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4a6db0-efd4-4e4b-bb55-e8228a8bf566 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:27.718467 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4a6db0-efd4-4e4b-bb55-e8228a8bf566 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:27.732115 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4a6db0-efd4-4e4b-bb55-e8228a8bf566 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:27.734178 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4a6db0-efd4-4e4b-bb55-e8228a8bf566 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:27.750336 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: WARNING keystone.server.flask.application [None req-1c4a6db0-efd4-4e4b-bb55-e8228a8bf566 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jan 25 02:23:27.756025 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 269/528] 10.222.0.117 () {56 vars in 1128 bytes} [Tue Jan 25 02:23:27 2022] GET /identity/v3/users/neutron => generated 85 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:23:27.757682 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9506d76-1e37-4f7e-83fc-620c8f4972a3 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:27.766182 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e65a48-2aad-4df1-9e52-547204c81150 None None] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:27.766441 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e65a48-2aad-4df1-9e52-547204c81150 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:27.766712 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e65a48-2aad-4df1-9e52-547204c81150 None None] PATH_INFO: `/` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:27.768542 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 270/529] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:23:27 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:23:27.776085 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfc6933-5b8e-4999-b441-227bdc1513e5 None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:27.776518 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfc6933-5b8e-4999-b441-227bdc1513e5 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:27.777023 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfc6933-5b8e-4999-b441-227bdc1513e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:27.777279 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9506d76-1e37-4f7e-83fc-620c8f4972a3 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:27.782422 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766e394e-3f00-41ad-9bc4-03b6039615df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:27.783213 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766e394e-3f00-41ad-9bc4-03b6039615df admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:27.783546 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766e394e-3f00-41ad-9bc4-03b6039615df admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:27.783925 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766e394e-3f00-41ad-9bc4-03b6039615df admin admin] PATH_INFO: `/v3/users` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:27.784850 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766e394e-3f00-41ad-9bc4-03b6039615df admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:27.785223 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766e394e-3f00-41ad-9bc4-03b6039615df admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:27.787166 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766e394e-3f00-41ad-9bc4-03b6039615df admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:27.806291 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-ebfc6933-5b8e-4999-b441-227bdc1513e5 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:23:27.807740 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 260/530] 10.222.0.117 () {56 vars in 1165 bytes} [Tue Jan 25 02:23:27 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 376 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:27.817657 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-ebfc6933-5b8e-4999-b441-227bdc1513e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:23:27.819161 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766e394e-3f00-41ad-9bc4-03b6039615df admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:27.821778 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 271/531] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:23:27 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 384 bytes (3 switches on core 0) Jan 25 02:23:27.836903 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766e394e-3f00-41ad-9bc4-03b6039615df admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:27.846492 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5384ed1-d76f-4e19-a8b8-ca0f81c069d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:27.847529 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5384ed1-d76f-4e19-a8b8-ca0f81c069d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:27.848054 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5384ed1-d76f-4e19-a8b8-ca0f81c069d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:27.848531 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5384ed1-d76f-4e19-a8b8-ca0f81c069d0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:27.850326 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfc6933-5b8e-4999-b441-227bdc1513e5 None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:27.860910 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfc6933-5b8e-4999-b441-227bdc1513e5 None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:27.863595 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5384ed1-d76f-4e19-a8b8-ca0f81c069d0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:27.865691 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5384ed1-d76f-4e19-a8b8-ca0f81c069d0 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:27.866425 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8809ea-20a6-4e8f-a0e2-c40e586012ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:27.867223 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8809ea-20a6-4e8f-a0e2-c40e586012ee admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:27.867555 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8809ea-20a6-4e8f-a0e2-c40e586012ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:27.867862 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8809ea-20a6-4e8f-a0e2-c40e586012ee admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:27.882010 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 261/532] 10.222.0.117 () {58 vars in 1329 bytes} [Tue Jan 25 02:23:27 2022] GET /identity/v3/auth/tokens => generated 915 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 25 02:23:27.887434 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8809ea-20a6-4e8f-a0e2-c40e586012ee admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:27.889423 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8809ea-20a6-4e8f-a0e2-c40e586012ee admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:27.898727 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5384ed1-d76f-4e19-a8b8-ca0f81c069d0 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:27.911903 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: WARNING keystone.server.flask.application [None req-6c8809ea-20a6-4e8f-a0e2-c40e586012ee admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 25 02:23:27.913051 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5384ed1-d76f-4e19-a8b8-ca0f81c069d0 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:27.918515 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 272/533] 10.222.0.117 () {56 vars in 1134 bytes} [Tue Jan 25 02:23:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:23:27.920380 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8809ea-20a6-4e8f-a0e2-c40e586012ee admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:27.931432 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8809ea-20a6-4e8f-a0e2-c40e586012ee admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:27.933659 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaab192-a7bb-4ad0-863f-93778afbf02a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:27.934792 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaab192-a7bb-4ad0-863f-93778afbf02a admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:27.935305 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaab192-a7bb-4ad0-863f-93778afbf02a admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:27.935681 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaab192-a7bb-4ad0-863f-93778afbf02a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:27.937044 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879fdd5f-6e1c-4bfc-999c-5383065673cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:27.937962 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879fdd5f-6e1c-4bfc-999c-5383065673cd admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:27.938374 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879fdd5f-6e1c-4bfc-999c-5383065673cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:27.938866 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879fdd5f-6e1c-4bfc-999c-5383065673cd admin admin] PATH_INFO: `/v3/domains` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:27.939770 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879fdd5f-6e1c-4bfc-999c-5383065673cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:27.940284 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879fdd5f-6e1c-4bfc-999c-5383065673cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:27.942479 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879fdd5f-6e1c-4bfc-999c-5383065673cd admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:27.956886 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfaab192-a7bb-4ad0-863f-93778afbf02a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:27.962451 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfaab192-a7bb-4ad0-863f-93778afbf02a admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:27.962721 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 273/534] 10.222.0.117 () {56 vars in 1135 bytes} [Tue Jan 25 02:23:27 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:27.964753 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879fdd5f-6e1c-4bfc-999c-5383065673cd admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:27.976758 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879fdd5f-6e1c-4bfc-999c-5383065673cd admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:27.983143 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4e057f-3e3d-4efc-ae8d-d6d0e3ba5cd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:27.984296 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4e057f-3e3d-4efc-ae8d-d6d0e3ba5cd1 admin admin] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:27.984731 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4e057f-3e3d-4efc-ae8d-d6d0e3ba5cd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:27.985203 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4e057f-3e3d-4efc-ae8d-d6d0e3ba5cd1 admin admin] PATH_INFO: `/v3/users` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:27.986078 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4e057f-3e3d-4efc-ae8d-d6d0e3ba5cd1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:27.988254 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4e057f-3e3d-4efc-ae8d-d6d0e3ba5cd1 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:27.991525 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: WARNING keystone.server.flask.application [None req-dfaab192-a7bb-4ad0-863f-93778afbf02a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 25 02:23:28.005682 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 262/535] 10.222.0.117 () {56 vars in 1134 bytes} [Tue Jan 25 02:23:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 103 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 25 02:23:28.008316 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaab192-a7bb-4ad0-863f-93778afbf02a admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:28.027621 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 274/536] 10.222.0.117 () {60 vars in 1158 bytes} [Tue Jan 25 02:23:27 2022] POST /identity/v3/users => generated 248 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 25 02:23:28.034070 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaab192-a7bb-4ad0-863f-93778afbf02a admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:28.039172 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f76c497-4cf9-4486-b891-1108799f878d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:28.040167 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f76c497-4cf9-4486-b891-1108799f878d admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:28.040638 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f76c497-4cf9-4486-b891-1108799f878d admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:28.041081 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f76c497-4cf9-4486-b891-1108799f878d admin admin] PATH_INFO: `/v3/domains` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:28.042031 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f76c497-4cf9-4486-b891-1108799f878d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:28.043389 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f76c497-4cf9-4486-b891-1108799f878d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:28.045322 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f76c497-4cf9-4486-b891-1108799f878d admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:28.077019 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 263/537] 10.222.0.117 () {56 vars in 1135 bytes} [Tue Jan 25 02:23:28 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:28.082881 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4e057f-3e3d-4efc-ae8d-d6d0e3ba5cd1 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:28.095935 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4e057f-3e3d-4efc-ae8d-d6d0e3ba5cd1 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:28.109458 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1940b8c-86bf-4249-aca4-9ffc1d68ab5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:28.110563 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1940b8c-86bf-4249-aca4-9ffc1d68ab5a admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:28.111052 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1940b8c-86bf-4249-aca4-9ffc1d68ab5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:28.111476 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1940b8c-86bf-4249-aca4-9ffc1d68ab5a admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:28.120931 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1940b8c-86bf-4249-aca4-9ffc1d68ab5a admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:28.123579 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1940b8c-86bf-4249-aca4-9ffc1d68ab5a admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:28.139398 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: WARNING keystone.server.flask.application [None req-a1940b8c-86bf-4249-aca4-9ffc1d68ab5a admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 25 02:23:28.140924 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 275/538] 10.222.0.117 () {56 vars in 1137 bytes} [Tue Jan 25 02:23:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:23:28.147163 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f76c497-4cf9-4486-b891-1108799f878d admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:28.159440 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f76c497-4cf9-4486-b891-1108799f878d admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:28.171733 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b78ee2-fb67-4023-af43-3cb5abdb8d83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:28.172699 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b78ee2-fb67-4023-af43-3cb5abdb8d83 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:28.173118 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b78ee2-fb67-4023-af43-3cb5abdb8d83 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:28.173686 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b78ee2-fb67-4023-af43-3cb5abdb8d83 admin admin] PATH_INFO: `/v3/projects` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:28.174633 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b78ee2-fb67-4023-af43-3cb5abdb8d83 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:28.175124 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b78ee2-fb67-4023-af43-3cb5abdb8d83 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:28.177216 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b78ee2-fb67-4023-af43-3cb5abdb8d83 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:28.196008 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 264/539] 10.222.0.117 () {56 vars in 1174 bytes} [Tue Jan 25 02:23:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:28.202855 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1940b8c-86bf-4249-aca4-9ffc1d68ab5a admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:28.213450 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1940b8c-86bf-4249-aca4-9ffc1d68ab5a admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:28.219536 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9f686a-365b-4372-b733-b79d2f10b0eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:28.220710 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9f686a-365b-4372-b733-b79d2f10b0eb admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:28.221175 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9f686a-365b-4372-b733-b79d2f10b0eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:28.221603 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9f686a-365b-4372-b733-b79d2f10b0eb admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:28.222687 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9f686a-365b-4372-b733-b79d2f10b0eb admin admin] RBAC: Adding query filter params (role.id=8e4691cb5a4b4439b9712d27ef133c20, scope.project.id=61a6fe9d4c914755bb0a64c392bd16aa, user.id=9ca4071c5f8f4a31b5edb81fa66a43a9) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:28.223161 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9f686a-365b-4372-b733-b79d2f10b0eb admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:28.225267 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9f686a-365b-4372-b733-b79d2f10b0eb admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:28.232702 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 276/540] 10.222.0.117 () {56 vars in 1400 bytes} [Tue Jan 25 02:23:28 2022] GET /identity/v3/role_assignments?user.id=9ca4071c5f8f4a31b5edb81fa66a43a9&scope.project.id=61a6fe9d4c914755bb0a64c392bd16aa&role.id=8e4691cb5a4b4439b9712d27ef133c20 => generated 260 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:29.921196 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4bc22c-6e1b-4364-a3c9-8efb3500e7f0 None None] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:29.922188 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4bc22c-6e1b-4364-a3c9-8efb3500e7f0 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:29.922662 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4bc22c-6e1b-4364-a3c9-8efb3500e7f0 None None] PATH_INFO: `/` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:29.924925 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 265/541] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:23:29 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:23:29.930531 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5d3f4c-ba0a-4a6f-88ef-c6c4a74b1bb5 None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:29.931313 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5d3f4c-ba0a-4a6f-88ef-c6c4a74b1bb5 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:29.931819 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5d3f4c-ba0a-4a6f-88ef-c6c4a74b1bb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:29.955513 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-ac5d3f4c-ba0a-4a6f-88ef-c6c4a74b1bb5 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:23:29.956978 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-ac5d3f4c-ba0a-4a6f-88ef-c6c4a74b1bb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:23:29.973899 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 277/542] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:23:29 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 25 02:23:30.012617 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4bc22c-6e1b-4364-a3c9-8efb3500e7f0 None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:30.028125 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4bc22c-6e1b-4364-a3c9-8efb3500e7f0 None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:30.033898 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e43c4a-763c-46cb-b453-caf5dc08491f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:30.034725 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e43c4a-763c-46cb-b453-caf5dc08491f admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:30.035007 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e43c4a-763c-46cb-b453-caf5dc08491f admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:30.035283 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e43c4a-763c-46cb-b453-caf5dc08491f admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:30.050705 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e43c4a-763c-46cb-b453-caf5dc08491f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 25 02:23:30.058271 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: WARNING keystone.server.flask.application [None req-b8e43c4a-763c-46cb-b453-caf5dc08491f admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 25 02:23:30.059907 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 266/543] 10.222.0.117 () {56 vars in 1128 bytes} [Tue Jan 25 02:23:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:23:30.065312 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5d3f4c-ba0a-4a6f-88ef-c6c4a74b1bb5 None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:30.075505 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5d3f4c-ba0a-4a6f-88ef-c6c4a74b1bb5 None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:30.087683 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1311759-3d96-482f-8337-f9dd1ac3aa73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:30.088537 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1311759-3d96-482f-8337-f9dd1ac3aa73 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:30.089011 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1311759-3d96-482f-8337-f9dd1ac3aa73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:30.089613 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1311759-3d96-482f-8337-f9dd1ac3aa73 admin admin] PATH_INFO: `/v3/roles` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:30.090673 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1311759-3d96-482f-8337-f9dd1ac3aa73 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:30.091120 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1311759-3d96-482f-8337-f9dd1ac3aa73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:30.092922 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1311759-3d96-482f-8337-f9dd1ac3aa73 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:30.112767 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 278/544] 10.222.0.117 () {56 vars in 1129 bytes} [Tue Jan 25 02:23:30 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:30.118354 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e43c4a-763c-46cb-b453-caf5dc08491f admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:30.133742 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e43c4a-763c-46cb-b453-caf5dc08491f admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:30.143920 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf62e0c-e08f-4884-8ea1-41d63ab72d5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:30.144717 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf62e0c-e08f-4884-8ea1-41d63ab72d5a admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:30.145000 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf62e0c-e08f-4884-8ea1-41d63ab72d5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:30.145279 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf62e0c-e08f-4884-8ea1-41d63ab72d5a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:30.167351 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf62e0c-e08f-4884-8ea1-41d63ab72d5a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:30.169237 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf62e0c-e08f-4884-8ea1-41d63ab72d5a admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:30.197980 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: WARNING keystone.server.flask.application [None req-7bf62e0c-e08f-4884-8ea1-41d63ab72d5a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 25 02:23:30.204276 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 267/545] 10.222.0.117 () {56 vars in 1134 bytes} [Tue Jan 25 02:23:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 86 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:23:30.205370 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1311759-3d96-482f-8337-f9dd1ac3aa73 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:30.221967 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1311759-3d96-482f-8337-f9dd1ac3aa73 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:30.237237 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d69931e-8d87-4784-a048-8ff20e9986ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:30.238102 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d69931e-8d87-4784-a048-8ff20e9986ec admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:30.238549 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d69931e-8d87-4784-a048-8ff20e9986ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:30.238960 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d69931e-8d87-4784-a048-8ff20e9986ec admin admin] PATH_INFO: `/v3/domains` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:30.239857 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d69931e-8d87-4784-a048-8ff20e9986ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:30.240297 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d69931e-8d87-4784-a048-8ff20e9986ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:30.242045 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d69931e-8d87-4784-a048-8ff20e9986ec admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:30.262318 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 279/546] 10.222.0.117 () {56 vars in 1135 bytes} [Tue Jan 25 02:23:30 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 02:23:30.267932 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf62e0c-e08f-4884-8ea1-41d63ab72d5a admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:30.268616 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c195efe9-cf3f-4bee-9670-cf58df6751a8 None None] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:30.269040 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c195efe9-cf3f-4bee-9670-cf58df6751a8 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:30.269544 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c195efe9-cf3f-4bee-9670-cf58df6751a8 None None] PATH_INFO: `/` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:30.271370 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 280/547] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:23:30 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:23:30.278546 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983b5380-115a-4d96-9c0d-eab14d9e762d None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:30.279001 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983b5380-115a-4d96-9c0d-eab14d9e762d None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:30.280448 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983b5380-115a-4d96-9c0d-eab14d9e762d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:30.284476 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf62e0c-e08f-4884-8ea1-41d63ab72d5a admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:30.299908 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9621e0-a399-4561-9990-1f439f629097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:30.300893 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9621e0-a399-4561-9990-1f439f629097 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:30.301312 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9621e0-a399-4561-9990-1f439f629097 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:30.301740 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9621e0-a399-4561-9990-1f439f629097 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:30.314876 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-983b5380-115a-4d96-9c0d-eab14d9e762d None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:23:30.316570 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-983b5380-115a-4d96-9c0d-eab14d9e762d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:23:30.317434 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9621e0-a399-4561-9990-1f439f629097 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:30.319660 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9621e0-a399-4561-9990-1f439f629097 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:30.343732 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: WARNING keystone.server.flask.application [None req-8d9621e0-a399-4561-9990-1f439f629097 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jan 25 02:23:30.343732 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 268/549] 10.222.0.117 () {56 vars in 1119 bytes} [Tue Jan 25 02:23:30 2022] GET /identity/v3/users/nova => generated 82 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:23:30.344007 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 281/549] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:23:30 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 25 02:23:30.348519 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9621e0-a399-4561-9990-1f439f629097 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:30.361976 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9621e0-a399-4561-9990-1f439f629097 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:30.365620 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983b5380-115a-4d96-9c0d-eab14d9e762d None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:30.375128 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16ef4ba-7295-4731-93fb-d7a8ad921ebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:30.375940 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16ef4ba-7295-4731-93fb-d7a8ad921ebd admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:30.376053 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983b5380-115a-4d96-9c0d-eab14d9e762d None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:30.376395 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16ef4ba-7295-4731-93fb-d7a8ad921ebd admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:30.376766 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16ef4ba-7295-4731-93fb-d7a8ad921ebd admin admin] PATH_INFO: `/v3/users` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:30.377723 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16ef4ba-7295-4731-93fb-d7a8ad921ebd admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:30.378133 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16ef4ba-7295-4731-93fb-d7a8ad921ebd admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:30.380179 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16ef4ba-7295-4731-93fb-d7a8ad921ebd admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:30.396923 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46badcf9-919d-4f76-88ce-ff04b2bcd0f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:30.397738 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46badcf9-919d-4f76-88ce-ff04b2bcd0f9 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:30.398012 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46badcf9-919d-4f76-88ce-ff04b2bcd0f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:30.398278 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46badcf9-919d-4f76-88ce-ff04b2bcd0f9 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:30.403890 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 269/550] 10.222.0.117 () {56 vars in 1159 bytes} [Tue Jan 25 02:23:30 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 370 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:30.406751 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16ef4ba-7295-4731-93fb-d7a8ad921ebd admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:30.419127 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46badcf9-919d-4f76-88ce-ff04b2bcd0f9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 25 02:23:30.420050 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16ef4ba-7295-4731-93fb-d7a8ad921ebd admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:30.424765 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6380bea-de53-4f9b-a801-f1bb12438eaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:30.425549 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6380bea-de53-4f9b-a801-f1bb12438eaf admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:30.425878 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6380bea-de53-4f9b-a801-f1bb12438eaf admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:30.426158 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6380bea-de53-4f9b-a801-f1bb12438eaf admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:30.427238 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: WARNING keystone.server.flask.application [None req-46badcf9-919d-4f76-88ce-ff04b2bcd0f9 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 25 02:23:30.429411 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 282/551] 10.222.0.117 () {56 vars in 1128 bytes} [Tue Jan 25 02:23:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:23:30.430753 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94162999-6e6b-4101-85cf-51d39a0dcc0a None None] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:30.431136 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94162999-6e6b-4101-85cf-51d39a0dcc0a None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:30.431527 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94162999-6e6b-4101-85cf-51d39a0dcc0a None None] PATH_INFO: `/` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:30.433399 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 283/552] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:23:30 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:23:30.438695 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94162999-6e6b-4101-85cf-51d39a0dcc0a None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:30.442992 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6380bea-de53-4f9b-a801-f1bb12438eaf admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:30.445099 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6380bea-de53-4f9b-a801-f1bb12438eaf admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:30.453815 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94162999-6e6b-4101-85cf-51d39a0dcc0a None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:30.458647 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4fff31-009b-4173-b07d-fa41211f2317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:30.459581 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4fff31-009b-4173-b07d-fa41211f2317 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:30.460019 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4fff31-009b-4173-b07d-fa41211f2317 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:30.460430 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4fff31-009b-4173-b07d-fa41211f2317 admin admin] PATH_INFO: `/v3/roles` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:30.461400 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4fff31-009b-4173-b07d-fa41211f2317 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:30.461869 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4fff31-009b-4173-b07d-fa41211f2317 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:30.463724 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4fff31-009b-4173-b07d-fa41211f2317 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:30.465593 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: WARNING keystone.server.flask.application [None req-a6380bea-de53-4f9b-a801-f1bb12438eaf admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 25 02:23:30.467099 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 270/553] 10.222.0.117 () {56 vars in 1134 bytes} [Tue Jan 25 02:23:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:23:30.471772 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde12684-a8f0-4185-af2e-ab16276040e6 None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:30.471772 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde12684-a8f0-4185-af2e-ab16276040e6 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:30.471772 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde12684-a8f0-4185-af2e-ab16276040e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:30.479710 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 284/554] 10.222.0.117 () {56 vars in 1129 bytes} [Tue Jan 25 02:23:30 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:30.480753 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4fff31-009b-4173-b07d-fa41211f2317 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:30.489641 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-fde12684-a8f0-4185-af2e-ab16276040e6 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:23:30.490947 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-fde12684-a8f0-4185-af2e-ab16276040e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:23:30.498031 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4fff31-009b-4173-b07d-fa41211f2317 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:30.500067 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 271/555] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:23:30 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 25 02:23:30.500948 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde12684-a8f0-4185-af2e-ab16276040e6 None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:30.516505 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d9f3d2-85b2-4257-8fb8-eef5ee87a61a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:30.517398 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d9f3d2-85b2-4257-8fb8-eef5ee87a61a admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:30.517804 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d9f3d2-85b2-4257-8fb8-eef5ee87a61a admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:30.518212 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d9f3d2-85b2-4257-8fb8-eef5ee87a61a admin admin] PATH_INFO: `/v3/domains` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:30.519116 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d9f3d2-85b2-4257-8fb8-eef5ee87a61a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:30.519909 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d9f3d2-85b2-4257-8fb8-eef5ee87a61a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:30.522516 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d9f3d2-85b2-4257-8fb8-eef5ee87a61a admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:30.526438 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde12684-a8f0-4185-af2e-ab16276040e6 None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:30.536133 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8641d868-b226-489e-9528-223d6ca23598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:30.537200 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8641d868-b226-489e-9528-223d6ca23598 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:30.537620 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8641d868-b226-489e-9528-223d6ca23598 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:30.538030 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8641d868-b226-489e-9528-223d6ca23598 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:30.538632 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 285/556] 10.222.0.117 () {56 vars in 1135 bytes} [Tue Jan 25 02:23:30 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:30.539584 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d9f3d2-85b2-4257-8fb8-eef5ee87a61a admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:30.550511 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d9f3d2-85b2-4257-8fb8-eef5ee87a61a admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:30.552208 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8641d868-b226-489e-9528-223d6ca23598 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:30.554682 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8641d868-b226-489e-9528-223d6ca23598 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:30.555504 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f967c058-81da-483f-aae1-4e1aab1da8bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:30.556464 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f967c058-81da-483f-aae1-4e1aab1da8bc admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:30.556941 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f967c058-81da-483f-aae1-4e1aab1da8bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:30.557314 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f967c058-81da-483f-aae1-4e1aab1da8bc admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:30.569482 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f967c058-81da-483f-aae1-4e1aab1da8bc admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 25 02:23:30.577223 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: WARNING keystone.server.flask.application [None req-f967c058-81da-483f-aae1-4e1aab1da8bc admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 25 02:23:30.577352 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: WARNING keystone.server.flask.application [None req-8641d868-b226-489e-9528-223d6ca23598 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 25 02:23:30.578664 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 272/557] 10.222.0.117 () {56 vars in 1134 bytes} [Tue Jan 25 02:23:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:23:30.583111 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 286/558] 10.222.0.117 () {56 vars in 1128 bytes} [Tue Jan 25 02:23:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:23:30.584291 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8641d868-b226-489e-9528-223d6ca23598 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:30.584434 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f967c058-81da-483f-aae1-4e1aab1da8bc admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:30.597020 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f967c058-81da-483f-aae1-4e1aab1da8bc admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:30.597316 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8641d868-b226-489e-9528-223d6ca23598 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:30.601891 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67a2938-39e9-454d-a820-982921f7b057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:30.602647 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce84848-e9cf-414e-88dd-539bb72ef42a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:30.602787 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67a2938-39e9-454d-a820-982921f7b057 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:30.603169 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67a2938-39e9-454d-a820-982921f7b057 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:30.603578 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67a2938-39e9-454d-a820-982921f7b057 admin admin] PATH_INFO: `/v3/domains` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:30.603989 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce84848-e9cf-414e-88dd-539bb72ef42a admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:30.604417 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce84848-e9cf-414e-88dd-539bb72ef42a admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:30.604857 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce84848-e9cf-414e-88dd-539bb72ef42a admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:30.605015 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67a2938-39e9-454d-a820-982921f7b057 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:30.605435 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67a2938-39e9-454d-a820-982921f7b057 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:30.607528 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67a2938-39e9-454d-a820-982921f7b057 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:30.615444 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce84848-e9cf-414e-88dd-539bb72ef42a admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:30.618617 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce84848-e9cf-414e-88dd-539bb72ef42a admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:30.620304 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 287/559] 10.222.0.117 () {56 vars in 1135 bytes} [Tue Jan 25 02:23:30 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 02:23:30.621627 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67a2938-39e9-454d-a820-982921f7b057 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:30.631449 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67a2938-39e9-454d-a820-982921f7b057 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:30.635061 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: WARNING keystone.server.flask.application [None req-4ce84848-e9cf-414e-88dd-539bb72ef42a admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 25 02:23:30.637119 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8be9ae-9d9d-4016-8838-cc3665730033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:30.637625 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 273/560] 10.222.0.117 () {56 vars in 1137 bytes} [Tue Jan 25 02:23:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:23:30.638022 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8be9ae-9d9d-4016-8838-cc3665730033 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:30.638406 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8be9ae-9d9d-4016-8838-cc3665730033 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:30.638824 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8be9ae-9d9d-4016-8838-cc3665730033 admin admin] PATH_INFO: `/v3/roles` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:30.639115 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce84848-e9cf-414e-88dd-539bb72ef42a admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:30.639888 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8be9ae-9d9d-4016-8838-cc3665730033 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:30.640296 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8be9ae-9d9d-4016-8838-cc3665730033 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:30.642125 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8be9ae-9d9d-4016-8838-cc3665730033 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:30.652328 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce84848-e9cf-414e-88dd-539bb72ef42a admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:30.655159 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 288/561] 10.222.0.117 () {56 vars in 1129 bytes} [Tue Jan 25 02:23:30 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:30.656319 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8be9ae-9d9d-4016-8838-cc3665730033 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:30.661841 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b345b492-8992-4971-b9a9-36ca1dcb905a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:30.662743 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b345b492-8992-4971-b9a9-36ca1dcb905a admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:30.663141 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b345b492-8992-4971-b9a9-36ca1dcb905a admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:30.663923 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b345b492-8992-4971-b9a9-36ca1dcb905a admin admin] PATH_INFO: `/v3/users/glance` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:30.669406 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8be9ae-9d9d-4016-8838-cc3665730033 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:30.672549 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b345b492-8992-4971-b9a9-36ca1dcb905a admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:30.674404 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be484d6f-3925-4183-98b8-274c0c27fa48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:30.674889 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b345b492-8992-4971-b9a9-36ca1dcb905a admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:30.675457 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be484d6f-3925-4183-98b8-274c0c27fa48 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:30.676050 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be484d6f-3925-4183-98b8-274c0c27fa48 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:30.676462 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be484d6f-3925-4183-98b8-274c0c27fa48 admin admin] PATH_INFO: `/v3/projects` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:30.677597 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be484d6f-3925-4183-98b8-274c0c27fa48 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:30.678065 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be484d6f-3925-4183-98b8-274c0c27fa48 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:30.680613 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be484d6f-3925-4183-98b8-274c0c27fa48 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:30.691116 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: WARNING keystone.server.flask.application [None req-b345b492-8992-4971-b9a9-36ca1dcb905a admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jan 25 02:23:30.692881 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 274/562] 10.222.0.117 () {56 vars in 1125 bytes} [Tue Jan 25 02:23:30 2022] GET /identity/v3/users/glance => generated 84 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:23:30.693893 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b345b492-8992-4971-b9a9-36ca1dcb905a admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:30.696329 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 289/563] 10.222.0.117 () {56 vars in 1174 bytes} [Tue Jan 25 02:23:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:30.702697 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be484d6f-3925-4183-98b8-274c0c27fa48 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:30.705306 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b345b492-8992-4971-b9a9-36ca1dcb905a admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:30.710773 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65216856-3d87-4375-8ddd-ba5c722fefaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:30.711320 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65216856-3d87-4375-8ddd-ba5c722fefaf admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:30.711674 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65216856-3d87-4375-8ddd-ba5c722fefaf admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:30.712056 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65216856-3d87-4375-8ddd-ba5c722fefaf admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:30.716726 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be484d6f-3925-4183-98b8-274c0c27fa48 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:30.722040 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244915cb-7fff-471b-b9ed-4c4a1f366396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:30.723287 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244915cb-7fff-471b-b9ed-4c4a1f366396 admin admin] REQUEST_METHOD: `PUT` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:30.723764 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244915cb-7fff-471b-b9ed-4c4a1f366396 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:30.724211 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244915cb-7fff-471b-b9ed-4c4a1f366396 admin admin] PATH_INFO: `/v3/projects/61a6fe9d4c914755bb0a64c392bd16aa/users/d9ad6269900346458050063c12cac299/roles/8e4691cb5a4b4439b9712d27ef133c20` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:30.726960 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65216856-3d87-4375-8ddd-ba5c722fefaf admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:30.729068 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65216856-3d87-4375-8ddd-ba5c722fefaf admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:30.742507 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244915cb-7fff-471b-b9ed-4c4a1f366396 admin admin] RBAC: Authorizing `identity:create_grant(project_id=61a6fe9d4c914755bb0a64c392bd16aa, user_id=d9ad6269900346458050063c12cac299, role_id=8e4691cb5a4b4439b9712d27ef133c20)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:30.746223 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244915cb-7fff-471b-b9ed-4c4a1f366396 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:30.748120 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: WARNING keystone.server.flask.application [None req-65216856-3d87-4375-8ddd-ba5c722fefaf admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 25 02:23:30.749343 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 275/564] 10.222.0.117 () {56 vars in 1134 bytes} [Tue Jan 25 02:23:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:23:30.750112 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65216856-3d87-4375-8ddd-ba5c722fefaf admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:30.765464 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 290/565] 10.222.0.117 () {58 vars in 1465 bytes} [Tue Jan 25 02:23:30 2022] PUT /identity/v3/projects/61a6fe9d4c914755bb0a64c392bd16aa/users/d9ad6269900346458050063c12cac299/roles/8e4691cb5a4b4439b9712d27ef133c20 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:23:30.766342 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244915cb-7fff-471b-b9ed-4c4a1f366396 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:30.769458 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65216856-3d87-4375-8ddd-ba5c722fefaf admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:30.846052 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244915cb-7fff-471b-b9ed-4c4a1f366396 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:30.852335 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31accd3b-0507-4c86-bcac-2d40ebb91b52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:30.853472 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31accd3b-0507-4c86-bcac-2d40ebb91b52 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:30.855523 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31accd3b-0507-4c86-bcac-2d40ebb91b52 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:30.856289 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31accd3b-0507-4c86-bcac-2d40ebb91b52 admin admin] PATH_INFO: `/v3/domains` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:30.857362 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31accd3b-0507-4c86-bcac-2d40ebb91b52 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:30.857948 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31accd3b-0507-4c86-bcac-2d40ebb91b52 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:30.860353 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31accd3b-0507-4c86-bcac-2d40ebb91b52 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:30.879716 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 291/566] 10.222.0.117 () {56 vars in 1135 bytes} [Tue Jan 25 02:23:30 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:30.883032 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31accd3b-0507-4c86-bcac-2d40ebb91b52 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:30.895558 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31accd3b-0507-4c86-bcac-2d40ebb91b52 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:30.902476 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527ac40c-5eb1-44ec-8ec6-a7f8684b9557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:30.903828 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527ac40c-5eb1-44ec-8ec6-a7f8684b9557 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:30.904472 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527ac40c-5eb1-44ec-8ec6-a7f8684b9557 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:30.905032 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527ac40c-5eb1-44ec-8ec6-a7f8684b9557 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:30.915258 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527ac40c-5eb1-44ec-8ec6-a7f8684b9557 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:30.918894 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527ac40c-5eb1-44ec-8ec6-a7f8684b9557 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:30.936445 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: WARNING keystone.server.flask.application [None req-527ac40c-5eb1-44ec-8ec6-a7f8684b9557 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jan 25 02:23:30.938653 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 292/567] 10.222.0.117 () {56 vars in 1125 bytes} [Tue Jan 25 02:23:30 2022] GET /identity/v3/users/cinder => generated 84 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 25 02:23:30.947984 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527ac40c-5eb1-44ec-8ec6-a7f8684b9557 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:30.948418 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f356f15c-ed11-40fd-acb4-b90f19fd44b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:30.949444 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f356f15c-ed11-40fd-acb4-b90f19fd44b2 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:30.949726 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f356f15c-ed11-40fd-acb4-b90f19fd44b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:30.949999 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f356f15c-ed11-40fd-acb4-b90f19fd44b2 admin admin] PATH_INFO: `/v3/users` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:30.950864 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f356f15c-ed11-40fd-acb4-b90f19fd44b2 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:30.951168 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f356f15c-ed11-40fd-acb4-b90f19fd44b2 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:30.953097 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f356f15c-ed11-40fd-acb4-b90f19fd44b2 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:30.960154 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527ac40c-5eb1-44ec-8ec6-a7f8684b9557 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:30.967306 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3388f84-d700-4226-bb88-4124956a9a87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:30.968107 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3388f84-d700-4226-bb88-4124956a9a87 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:30.968559 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3388f84-d700-4226-bb88-4124956a9a87 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:30.968841 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3388f84-d700-4226-bb88-4124956a9a87 admin admin] PATH_INFO: `/v3/users` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:30.969730 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3388f84-d700-4226-bb88-4124956a9a87 admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:30.970038 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3388f84-d700-4226-bb88-4124956a9a87 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:30.972236 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3388f84-d700-4226-bb88-4124956a9a87 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:30.977196 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 276/568] 10.222.0.117 () {56 vars in 1163 bytes} [Tue Jan 25 02:23:30 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 374 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:30.983610 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f356f15c-ed11-40fd-acb4-b90f19fd44b2 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:30.994383 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f356f15c-ed11-40fd-acb4-b90f19fd44b2 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:30.997447 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 293/569] 10.222.0.117 () {56 vars in 1163 bytes} [Tue Jan 25 02:23:30 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 374 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:31.003343 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3388f84-d700-4226-bb88-4124956a9a87 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:31.004632 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21f5c18-c316-46a3-8bac-10a7e287248a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:31.005442 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21f5c18-c316-46a3-8bac-10a7e287248a admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:31.005718 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21f5c18-c316-46a3-8bac-10a7e287248a admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:31.005989 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21f5c18-c316-46a3-8bac-10a7e287248a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:31.015706 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3388f84-d700-4226-bb88-4124956a9a87 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:31.018921 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21f5c18-c316-46a3-8bac-10a7e287248a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:31.020970 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21f5c18-c316-46a3-8bac-10a7e287248a admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:31.021253 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3d4b81-230d-4315-9e83-c871137fd8a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:31.022269 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3d4b81-230d-4315-9e83-c871137fd8a6 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:31.022550 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3d4b81-230d-4315-9e83-c871137fd8a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:31.023058 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3d4b81-230d-4315-9e83-c871137fd8a6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:31.035307 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3d4b81-230d-4315-9e83-c871137fd8a6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:31.037184 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3d4b81-230d-4315-9e83-c871137fd8a6 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:31.039917 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: WARNING keystone.server.flask.application [None req-c21f5c18-c316-46a3-8bac-10a7e287248a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 25 02:23:31.046342 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 277/570] 10.222.0.117 () {56 vars in 1134 bytes} [Tue Jan 25 02:23:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 25 02:23:31.047555 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21f5c18-c316-46a3-8bac-10a7e287248a admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:31.054201 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: WARNING keystone.server.flask.application [None req-0a3d4b81-230d-4315-9e83-c871137fd8a6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 25 02:23:31.055572 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 294/571] 10.222.0.117 () {56 vars in 1134 bytes} [Tue Jan 25 02:23:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 25 02:23:31.058424 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21f5c18-c316-46a3-8bac-10a7e287248a admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:31.061538 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3d4b81-230d-4315-9e83-c871137fd8a6 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:31.063640 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d628203d-e3bd-4552-90e4-4d5d27b4c343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:31.064366 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d628203d-e3bd-4552-90e4-4d5d27b4c343 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:31.064681 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d628203d-e3bd-4552-90e4-4d5d27b4c343 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:31.064960 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d628203d-e3bd-4552-90e4-4d5d27b4c343 admin admin] PATH_INFO: `/v3/domains` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:31.065703 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d628203d-e3bd-4552-90e4-4d5d27b4c343 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:31.066058 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d628203d-e3bd-4552-90e4-4d5d27b4c343 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:31.067719 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d628203d-e3bd-4552-90e4-4d5d27b4c343 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:31.071458 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3d4b81-230d-4315-9e83-c871137fd8a6 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:31.077056 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801b46cb-371d-41d4-a131-40200434fb35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:31.077706 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801b46cb-371d-41d4-a131-40200434fb35 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:31.077987 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801b46cb-371d-41d4-a131-40200434fb35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:31.078260 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801b46cb-371d-41d4-a131-40200434fb35 admin admin] PATH_INFO: `/v3/domains` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:31.079001 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801b46cb-371d-41d4-a131-40200434fb35 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:31.079302 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801b46cb-371d-41d4-a131-40200434fb35 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:31.081023 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801b46cb-371d-41d4-a131-40200434fb35 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:31.085875 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 278/572] 10.222.0.117 () {56 vars in 1135 bytes} [Tue Jan 25 02:23:31 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:31.087165 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d628203d-e3bd-4552-90e4-4d5d27b4c343 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:31.093331 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 295/573] 10.222.0.117 () {56 vars in 1135 bytes} [Tue Jan 25 02:23:31 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:31.098315 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d628203d-e3bd-4552-90e4-4d5d27b4c343 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:31.098788 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801b46cb-371d-41d4-a131-40200434fb35 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:31.102961 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27d2b60-880b-4ccd-b2c7-6e753d1080c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:31.103821 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27d2b60-880b-4ccd-b2c7-6e753d1080c4 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:31.104100 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27d2b60-880b-4ccd-b2c7-6e753d1080c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:31.104370 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27d2b60-880b-4ccd-b2c7-6e753d1080c4 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:31.109704 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801b46cb-371d-41d4-a131-40200434fb35 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:31.114805 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6f6f4a-4b7b-41c2-8061-72047dcaa338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:31.115064 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27d2b60-880b-4ccd-b2c7-6e753d1080c4 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:31.115684 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6f6f4a-4b7b-41c2-8061-72047dcaa338 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:31.116002 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6f6f4a-4b7b-41c2-8061-72047dcaa338 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:31.116329 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6f6f4a-4b7b-41c2-8061-72047dcaa338 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:31.117042 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27d2b60-880b-4ccd-b2c7-6e753d1080c4 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:31.125495 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6f6f4a-4b7b-41c2-8061-72047dcaa338 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:31.127593 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6f6f4a-4b7b-41c2-8061-72047dcaa338 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:31.132574 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: WARNING keystone.server.flask.application [None req-f27d2b60-880b-4ccd-b2c7-6e753d1080c4 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 25 02:23:31.138707 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 279/574] 10.222.0.117 () {56 vars in 1137 bytes} [Tue Jan 25 02:23:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:23:31.140062 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad1e915-51a4-4796-b27c-18da83968283 None None] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:31.140345 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad1e915-51a4-4796-b27c-18da83968283 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:31.140619 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad1e915-51a4-4796-b27c-18da83968283 None None] PATH_INFO: `/` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:31.142031 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: WARNING keystone.server.flask.application [None req-2a6f6f4a-4b7b-41c2-8061-72047dcaa338 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 25 02:23:31.142290 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 280/575] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:23:31 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:23:31.143383 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad1e915-51a4-4796-b27c-18da83968283 None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:31.144038 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 296/576] 10.222.0.117 () {56 vars in 1137 bytes} [Tue Jan 25 02:23:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:23:31.148662 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5791c35e-3cdb-46c3-a195-7210247f4bf1 None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:31.148949 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5791c35e-3cdb-46c3-a195-7210247f4bf1 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:31.149223 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5791c35e-3cdb-46c3-a195-7210247f4bf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:31.164177 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad1e915-51a4-4796-b27c-18da83968283 None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:31.170202 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39dd304-aa07-445a-8974-6d41fa3d460f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:31.170904 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39dd304-aa07-445a-8974-6d41fa3d460f admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:31.171273 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39dd304-aa07-445a-8974-6d41fa3d460f admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:31.171551 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39dd304-aa07-445a-8974-6d41fa3d460f admin admin] PATH_INFO: `/v3/projects` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:31.172470 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39dd304-aa07-445a-8974-6d41fa3d460f admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:31.172768 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39dd304-aa07-445a-8974-6d41fa3d460f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:31.174746 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39dd304-aa07-445a-8974-6d41fa3d460f admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:31.177100 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-5791c35e-3cdb-46c3-a195-7210247f4bf1 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:23:31.178878 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-5791c35e-3cdb-46c3-a195-7210247f4bf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:23:31.188647 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 281/577] 10.222.0.117 () {56 vars in 1174 bytes} [Tue Jan 25 02:23:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 02:23:31.189678 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 297/578] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:23:31 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 25 02:23:31.194019 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39dd304-aa07-445a-8974-6d41fa3d460f admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:31.195539 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5791c35e-3cdb-46c3-a195-7210247f4bf1 None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:31.206743 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39dd304-aa07-445a-8974-6d41fa3d460f admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:31.211268 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daa5f75-233f-4e8a-b41c-cc6fe758578d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:31.211526 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5791c35e-3cdb-46c3-a195-7210247f4bf1 None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:31.212126 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daa5f75-233f-4e8a-b41c-cc6fe758578d admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:31.212517 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daa5f75-233f-4e8a-b41c-cc6fe758578d admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:31.212887 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daa5f75-233f-4e8a-b41c-cc6fe758578d admin admin] PATH_INFO: `/v3/projects` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:31.214046 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daa5f75-233f-4e8a-b41c-cc6fe758578d admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:31.214695 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daa5f75-233f-4e8a-b41c-cc6fe758578d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:31.218816 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daa5f75-233f-4e8a-b41c-cc6fe758578d admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:31.227799 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50c53e4-ec61-47bc-90c4-cadd024395a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:31.229190 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50c53e4-ec61-47bc-90c4-cadd024395a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:31.230225 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50c53e4-ec61-47bc-90c4-cadd024395a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:31.230699 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50c53e4-ec61-47bc-90c4-cadd024395a5 admin admin] PATH_INFO: `/v3/projects/61a6fe9d4c914755bb0a64c392bd16aa/users/db3663416137459d9da4a71032505b0b/roles/8e4691cb5a4b4439b9712d27ef133c20` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:31.232209 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 282/579] 10.222.0.117 () {56 vars in 1174 bytes} [Tue Jan 25 02:23:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:31.233197 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daa5f75-233f-4e8a-b41c-cc6fe758578d admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:31.243330 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daa5f75-233f-4e8a-b41c-cc6fe758578d admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:31.249177 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbda24e-80e9-4532-808c-ec2c26420e4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:31.249903 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50c53e4-ec61-47bc-90c4-cadd024395a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=61a6fe9d4c914755bb0a64c392bd16aa, user_id=db3663416137459d9da4a71032505b0b, role_id=8e4691cb5a4b4439b9712d27ef133c20)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:31.250258 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbda24e-80e9-4532-808c-ec2c26420e4f admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:31.250632 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbda24e-80e9-4532-808c-ec2c26420e4f admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:31.251046 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbda24e-80e9-4532-808c-ec2c26420e4f admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:31.253597 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50c53e4-ec61-47bc-90c4-cadd024395a5 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:31.263869 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbda24e-80e9-4532-808c-ec2c26420e4f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 25 02:23:31.270690 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 298/580] 10.222.0.117 () {58 vars in 1465 bytes} [Tue Jan 25 02:23:31 2022] PUT /identity/v3/projects/61a6fe9d4c914755bb0a64c392bd16aa/users/db3663416137459d9da4a71032505b0b/roles/8e4691cb5a4b4439b9712d27ef133c20 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:23:31.271838 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50c53e4-ec61-47bc-90c4-cadd024395a5 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:31.277441 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: WARNING keystone.server.flask.application [None req-5cbda24e-80e9-4532-808c-ec2c26420e4f admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 25 02:23:31.281645 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 283/581] 10.222.0.117 () {56 vars in 1128 bytes} [Tue Jan 25 02:23:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:23:31.287805 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbda24e-80e9-4532-808c-ec2c26420e4f admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:31.310088 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbda24e-80e9-4532-808c-ec2c26420e4f admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:31.373046 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddee6f3-4b66-44fa-8c56-56036c65ac70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:31.374187 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddee6f3-4b66-44fa-8c56-56036c65ac70 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:31.374187 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddee6f3-4b66-44fa-8c56-56036c65ac70 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:31.374425 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddee6f3-4b66-44fa-8c56-56036c65ac70 admin admin] PATH_INFO: `/v3/roles` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:31.375110 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddee6f3-4b66-44fa-8c56-56036c65ac70 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:31.375424 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddee6f3-4b66-44fa-8c56-56036c65ac70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:31.377100 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddee6f3-4b66-44fa-8c56-56036c65ac70 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:31.378747 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50c53e4-ec61-47bc-90c4-cadd024395a5 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:31.384946 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e83301-8857-40de-861b-bdd536eb540a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:31.386109 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e83301-8857-40de-861b-bdd536eb540a admin admin] REQUEST_METHOD: `PUT` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:31.386536 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e83301-8857-40de-861b-bdd536eb540a admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:31.386998 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e83301-8857-40de-861b-bdd536eb540a admin admin] PATH_INFO: `/v3/projects/61a6fe9d4c914755bb0a64c392bd16aa/users/1cc5249aea09430080e232cf17757f86/roles/8e4691cb5a4b4439b9712d27ef133c20` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:31.391537 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 284/582] 10.222.0.117 () {56 vars in 1129 bytes} [Tue Jan 25 02:23:31 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 02:23:31.392861 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857e5ca6-e7f0-4ead-bbc3-d52850b31158 None None] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:31.393154 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857e5ca6-e7f0-4ead-bbc3-d52850b31158 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:31.393429 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857e5ca6-e7f0-4ead-bbc3-d52850b31158 None None] PATH_INFO: `/` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:31.395424 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 285/583] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:23:31 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:23:31.400435 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857e5ca6-e7f0-4ead-bbc3-d52850b31158 None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:31.406110 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e83301-8857-40de-861b-bdd536eb540a admin admin] RBAC: Authorizing `identity:create_grant(project_id=61a6fe9d4c914755bb0a64c392bd16aa, user_id=1cc5249aea09430080e232cf17757f86, role_id=8e4691cb5a4b4439b9712d27ef133c20)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:31.409556 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e83301-8857-40de-861b-bdd536eb540a admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:31.415330 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857e5ca6-e7f0-4ead-bbc3-d52850b31158 None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:31.421579 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ad234c-8e3d-4c52-94e0-926edd24cfa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:31.422675 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ad234c-8e3d-4c52-94e0-926edd24cfa2 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:31.422959 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ad234c-8e3d-4c52-94e0-926edd24cfa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:31.423273 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ad234c-8e3d-4c52-94e0-926edd24cfa2 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:31.429780 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 299/584] 10.222.0.117 () {58 vars in 1465 bytes} [Tue Jan 25 02:23:31 2022] PUT /identity/v3/projects/61a6fe9d4c914755bb0a64c392bd16aa/users/1cc5249aea09430080e232cf17757f86/roles/8e4691cb5a4b4439b9712d27ef133c20 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:23:31.432303 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04648ba1-887e-4c04-a648-46b6513b5047 None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:31.433649 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04648ba1-887e-4c04-a648-46b6513b5047 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:31.434153 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04648ba1-887e-4c04-a648-46b6513b5047 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:31.436910 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ad234c-8e3d-4c52-94e0-926edd24cfa2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:31.438830 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ad234c-8e3d-4c52-94e0-926edd24cfa2 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:31.459744 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-04648ba1-887e-4c04-a648-46b6513b5047 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:23:31.461339 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-04648ba1-887e-4c04-a648-46b6513b5047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:23:31.462902 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: WARNING keystone.server.flask.application [None req-a5ad234c-8e3d-4c52-94e0-926edd24cfa2 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 25 02:23:31.465043 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 286/585] 10.222.0.117 () {56 vars in 1134 bytes} [Tue Jan 25 02:23:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:23:31.470967 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ad234c-8e3d-4c52-94e0-926edd24cfa2 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:31.483526 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ad234c-8e3d-4c52-94e0-926edd24cfa2 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:31.534790 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 300/586] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:23:31 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 25 02:23:31.554121 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384dbde6-a34d-4ef5-945b-6bf37dda95e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:31.555126 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384dbde6-a34d-4ef5-945b-6bf37dda95e9 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:31.555583 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384dbde6-a34d-4ef5-945b-6bf37dda95e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:31.556125 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384dbde6-a34d-4ef5-945b-6bf37dda95e9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:31.557120 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384dbde6-a34d-4ef5-945b-6bf37dda95e9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:31.557599 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384dbde6-a34d-4ef5-945b-6bf37dda95e9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:31.560130 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04648ba1-887e-4c04-a648-46b6513b5047 None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:31.560707 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384dbde6-a34d-4ef5-945b-6bf37dda95e9 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:31.569566 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04648ba1-887e-4c04-a648-46b6513b5047 None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:31.575254 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c9626c-71d8-467c-bb0f-0d3d9762617c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:31.576145 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c9626c-71d8-467c-bb0f-0d3d9762617c admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:31.576512 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c9626c-71d8-467c-bb0f-0d3d9762617c admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:31.576698 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c9626c-71d8-467c-bb0f-0d3d9762617c admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:31.577095 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 287/587] 10.222.0.117 () {56 vars in 1135 bytes} [Tue Jan 25 02:23:31 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 02:23:31.584782 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384dbde6-a34d-4ef5-945b-6bf37dda95e9 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:31.593540 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c9626c-71d8-467c-bb0f-0d3d9762617c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 25 02:23:31.597219 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384dbde6-a34d-4ef5-945b-6bf37dda95e9 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:31.601211 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: WARNING keystone.server.flask.application [None req-44c9626c-71d8-467c-bb0f-0d3d9762617c admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 25 02:23:31.602298 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b95c21-51a6-496c-91bd-c9487e1acb0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:31.602813 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 301/588] 10.222.0.117 () {56 vars in 1128 bytes} [Tue Jan 25 02:23:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:23:31.603507 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b95c21-51a6-496c-91bd-c9487e1acb0e admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:31.603987 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b95c21-51a6-496c-91bd-c9487e1acb0e admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:31.604433 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b95c21-51a6-496c-91bd-c9487e1acb0e admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:31.609853 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c9626c-71d8-467c-bb0f-0d3d9762617c admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:31.614434 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b95c21-51a6-496c-91bd-c9487e1acb0e admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:31.617601 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b95c21-51a6-496c-91bd-c9487e1acb0e admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:31.621297 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c9626c-71d8-467c-bb0f-0d3d9762617c admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:31.627503 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5eb561-56c4-4d57-83ff-36cbd6329383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:31.628278 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5eb561-56c4-4d57-83ff-36cbd6329383 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:31.628572 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5eb561-56c4-4d57-83ff-36cbd6329383 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:31.628850 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5eb561-56c4-4d57-83ff-36cbd6329383 admin admin] PATH_INFO: `/v3/roles` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:31.629683 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5eb561-56c4-4d57-83ff-36cbd6329383 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:31.629989 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5eb561-56c4-4d57-83ff-36cbd6329383 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:31.631767 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5eb561-56c4-4d57-83ff-36cbd6329383 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:31.637320 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: WARNING keystone.server.flask.application [None req-c5b95c21-51a6-496c-91bd-c9487e1acb0e admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jan 25 02:23:31.639778 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 288/589] 10.222.0.117 () {56 vars in 1128 bytes} [Tue Jan 25 02:23:31 2022] GET /identity/v3/users/neutron => generated 85 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:23:31.645428 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b95c21-51a6-496c-91bd-c9487e1acb0e admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:31.647233 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 302/590] 10.222.0.117 () {56 vars in 1129 bytes} [Tue Jan 25 02:23:31 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:31.659514 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5eb561-56c4-4d57-83ff-36cbd6329383 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:31.660760 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b95c21-51a6-496c-91bd-c9487e1acb0e admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:31.670530 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99180874-ef4f-400b-b5e2-524ad37cb6d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:31.671270 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99180874-ef4f-400b-b5e2-524ad37cb6d6 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:31.671568 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99180874-ef4f-400b-b5e2-524ad37cb6d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:31.671867 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99180874-ef4f-400b-b5e2-524ad37cb6d6 admin admin] PATH_INFO: `/v3/users` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:31.672747 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99180874-ef4f-400b-b5e2-524ad37cb6d6 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:31.673068 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99180874-ef4f-400b-b5e2-524ad37cb6d6 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:31.674950 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99180874-ef4f-400b-b5e2-524ad37cb6d6 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:31.685602 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5eb561-56c4-4d57-83ff-36cbd6329383 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:31.699120 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c1c1c8-4d9a-43e3-bf4c-6aba775eac90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:31.700519 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c1c1c8-4d9a-43e3-bf4c-6aba775eac90 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:31.701009 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c1c1c8-4d9a-43e3-bf4c-6aba775eac90 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:31.701498 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c1c1c8-4d9a-43e3-bf4c-6aba775eac90 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:31.709737 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 289/591] 10.222.0.117 () {56 vars in 1165 bytes} [Tue Jan 25 02:23:31 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 376 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 02:23:31.713714 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c1c1c8-4d9a-43e3-bf4c-6aba775eac90 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:31.716418 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c1c1c8-4d9a-43e3-bf4c-6aba775eac90 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:31.716760 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99180874-ef4f-400b-b5e2-524ad37cb6d6 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:31.728755 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99180874-ef4f-400b-b5e2-524ad37cb6d6 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:31.733986 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bf7b6f-6727-42a9-a1a9-936ac1f4c08e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:31.734779 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bf7b6f-6727-42a9-a1a9-936ac1f4c08e admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:31.735063 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bf7b6f-6727-42a9-a1a9-936ac1f4c08e admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:31.735343 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bf7b6f-6727-42a9-a1a9-936ac1f4c08e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:31.739610 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: WARNING keystone.server.flask.application [None req-46c1c1c8-4d9a-43e3-bf4c-6aba775eac90 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 25 02:23:31.741377 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 303/592] 10.222.0.117 () {56 vars in 1134 bytes} [Tue Jan 25 02:23:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 82 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:23:31.747888 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c1c1c8-4d9a-43e3-bf4c-6aba775eac90 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:31.749347 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bf7b6f-6727-42a9-a1a9-936ac1f4c08e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:31.751680 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bf7b6f-6727-42a9-a1a9-936ac1f4c08e admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:31.761783 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c1c1c8-4d9a-43e3-bf4c-6aba775eac90 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:31.766775 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0083cb2c-c30c-4e2d-a64e-0e0c271788aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:31.767644 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0083cb2c-c30c-4e2d-a64e-0e0c271788aa admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:31.768101 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0083cb2c-c30c-4e2d-a64e-0e0c271788aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:31.768469 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0083cb2c-c30c-4e2d-a64e-0e0c271788aa admin admin] PATH_INFO: `/v3/domains` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:31.769429 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0083cb2c-c30c-4e2d-a64e-0e0c271788aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:31.769830 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0083cb2c-c30c-4e2d-a64e-0e0c271788aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:31.771650 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0083cb2c-c30c-4e2d-a64e-0e0c271788aa admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:31.774464 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: WARNING keystone.server.flask.application [None req-b4bf7b6f-6727-42a9-a1a9-936ac1f4c08e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 25 02:23:31.776169 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 290/593] 10.222.0.117 () {56 vars in 1134 bytes} [Tue Jan 25 02:23:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:23:31.782505 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bf7b6f-6727-42a9-a1a9-936ac1f4c08e admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:31.785382 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 304/594] 10.222.0.117 () {56 vars in 1135 bytes} [Tue Jan 25 02:23:31 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:31.793700 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0083cb2c-c30c-4e2d-a64e-0e0c271788aa admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:31.793957 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bf7b6f-6727-42a9-a1a9-936ac1f4c08e admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:31.798848 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0b13e7-44ef-4d7c-8a8a-1684ad81e7f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:31.799733 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0b13e7-44ef-4d7c-8a8a-1684ad81e7f0 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:31.800239 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0b13e7-44ef-4d7c-8a8a-1684ad81e7f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:31.800676 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0b13e7-44ef-4d7c-8a8a-1684ad81e7f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:31.801576 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0b13e7-44ef-4d7c-8a8a-1684ad81e7f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:31.802012 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0b13e7-44ef-4d7c-8a8a-1684ad81e7f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:31.803788 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0b13e7-44ef-4d7c-8a8a-1684ad81e7f0 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:31.806232 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0083cb2c-c30c-4e2d-a64e-0e0c271788aa admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:31.813125 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2b6e7f-206e-4fca-8dde-e6e375992db3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:31.814113 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2b6e7f-206e-4fca-8dde-e6e375992db3 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:31.814525 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2b6e7f-206e-4fca-8dde-e6e375992db3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:31.815408 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2b6e7f-206e-4fca-8dde-e6e375992db3 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:31.821093 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 291/595] 10.222.0.117 () {56 vars in 1135 bytes} [Tue Jan 25 02:23:31 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 02:23:31.827013 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2b6e7f-206e-4fca-8dde-e6e375992db3 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:31.828622 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0b13e7-44ef-4d7c-8a8a-1684ad81e7f0 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:31.830763 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2b6e7f-206e-4fca-8dde-e6e375992db3 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:31.846879 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0b13e7-44ef-4d7c-8a8a-1684ad81e7f0 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:31.850650 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: WARNING keystone.server.flask.application [None req-3f2b6e7f-206e-4fca-8dde-e6e375992db3 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jan 25 02:23:31.853456 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 305/596] 10.222.0.117 () {56 vars in 1122 bytes} [Tue Jan 25 02:23:31 2022] GET /identity/v3/users/swift => generated 83 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 25 02:23:31.854200 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f03a06-b070-4d47-a6ea-e5c25c60423b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:31.856152 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f03a06-b070-4d47-a6ea-e5c25c60423b admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:31.856573 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f03a06-b070-4d47-a6ea-e5c25c60423b admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:31.858000 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f03a06-b070-4d47-a6ea-e5c25c60423b admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:31.861583 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2b6e7f-206e-4fca-8dde-e6e375992db3 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:31.868480 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f03a06-b070-4d47-a6ea-e5c25c60423b admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:31.870662 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f03a06-b070-4d47-a6ea-e5c25c60423b admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:31.872398 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2b6e7f-206e-4fca-8dde-e6e375992db3 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:31.877554 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3671599b-0db9-47a0-a0e7-97328753d123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:31.878814 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3671599b-0db9-47a0-a0e7-97328753d123 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:31.879434 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3671599b-0db9-47a0-a0e7-97328753d123 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:31.879902 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3671599b-0db9-47a0-a0e7-97328753d123 admin admin] PATH_INFO: `/v3/users` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:31.880858 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3671599b-0db9-47a0-a0e7-97328753d123 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:31.881312 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3671599b-0db9-47a0-a0e7-97328753d123 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:31.883370 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3671599b-0db9-47a0-a0e7-97328753d123 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:31.888275 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: WARNING keystone.server.flask.application [None req-e8f03a06-b070-4d47-a6ea-e5c25c60423b admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 25 02:23:31.889760 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 292/597] 10.222.0.117 () {56 vars in 1137 bytes} [Tue Jan 25 02:23:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:23:31.898370 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f03a06-b070-4d47-a6ea-e5c25c60423b admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:31.906690 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 306/598] 10.222.0.117 () {56 vars in 1161 bytes} [Tue Jan 25 02:23:31 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 372 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 02:23:31.913139 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3671599b-0db9-47a0-a0e7-97328753d123 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:31.915906 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f03a06-b070-4d47-a6ea-e5c25c60423b admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:31.928457 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2183069-d221-4a60-8fda-fcf291c0428b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:31.929375 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2183069-d221-4a60-8fda-fcf291c0428b admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:31.929747 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2183069-d221-4a60-8fda-fcf291c0428b admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:31.930201 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2183069-d221-4a60-8fda-fcf291c0428b admin admin] PATH_INFO: `/v3/projects` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:31.931110 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2183069-d221-4a60-8fda-fcf291c0428b admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:31.931770 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2183069-d221-4a60-8fda-fcf291c0428b admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:31.935836 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2183069-d221-4a60-8fda-fcf291c0428b admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:31.937129 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3671599b-0db9-47a0-a0e7-97328753d123 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:31.947385 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a389fc7d-5fec-46af-86df-5a96817d1889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:31.949131 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a389fc7d-5fec-46af-86df-5a96817d1889 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:31.949762 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a389fc7d-5fec-46af-86df-5a96817d1889 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:31.950741 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a389fc7d-5fec-46af-86df-5a96817d1889 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:31.971292 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a389fc7d-5fec-46af-86df-5a96817d1889 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:31.971823 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 293/599] 10.222.0.117 () {56 vars in 1174 bytes} [Tue Jan 25 02:23:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:31.973436 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a389fc7d-5fec-46af-86df-5a96817d1889 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:31.975807 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2183069-d221-4a60-8fda-fcf291c0428b admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:31.984835 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 307/600] 10.222.0.117 () {58 vars in 1329 bytes} [Tue Jan 25 02:23:31 2022] GET /identity/v3/auth/tokens => generated 915 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 25 02:23:31.990522 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a389fc7d-5fec-46af-86df-5a96817d1889 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:32.001266 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2183069-d221-4a60-8fda-fcf291c0428b admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:32.001455 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a389fc7d-5fec-46af-86df-5a96817d1889 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:32.006250 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b01d0b-8f1b-40a5-b21b-07fb81f4fd52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:32.007145 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b01d0b-8f1b-40a5-b21b-07fb81f4fd52 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:32.007529 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b01d0b-8f1b-40a5-b21b-07fb81f4fd52 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:32.007952 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b01d0b-8f1b-40a5-b21b-07fb81f4fd52 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:32.017366 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6825ff96-37b8-45b2-936a-b861ca85e6ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:32.019019 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6825ff96-37b8-45b2-936a-b861ca85e6ed admin admin] REQUEST_METHOD: `PUT` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:32.019413 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6825ff96-37b8-45b2-936a-b861ca85e6ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:32.019876 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6825ff96-37b8-45b2-936a-b861ca85e6ed admin admin] PATH_INFO: `/v3/projects/61a6fe9d4c914755bb0a64c392bd16aa/users/9ca4071c5f8f4a31b5edb81fa66a43a9/roles/8e4691cb5a4b4439b9712d27ef133c20` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:32.020430 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b01d0b-8f1b-40a5-b21b-07fb81f4fd52 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:32.022450 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b01d0b-8f1b-40a5-b21b-07fb81f4fd52 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:32.042989 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: WARNING keystone.server.flask.application [None req-c9b01d0b-8f1b-40a5-b21b-07fb81f4fd52 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 25 02:23:32.044984 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 308/601] 10.222.0.117 () {56 vars in 1134 bytes} [Tue Jan 25 02:23:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:23:32.053988 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b01d0b-8f1b-40a5-b21b-07fb81f4fd52 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:32.059585 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6825ff96-37b8-45b2-936a-b861ca85e6ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=61a6fe9d4c914755bb0a64c392bd16aa, user_id=9ca4071c5f8f4a31b5edb81fa66a43a9, role_id=8e4691cb5a4b4439b9712d27ef133c20)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:32.062263 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6825ff96-37b8-45b2-936a-b861ca85e6ed admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:32.070974 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b01d0b-8f1b-40a5-b21b-07fb81f4fd52 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:32.085969 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f05fc52-e973-4c9c-b353-236849eb6f95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:32.087316 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f05fc52-e973-4c9c-b353-236849eb6f95 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:32.087887 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 294/602] 10.222.0.117 () {58 vars in 1465 bytes} [Tue Jan 25 02:23:31 2022] PUT /identity/v3/projects/61a6fe9d4c914755bb0a64c392bd16aa/users/9ca4071c5f8f4a31b5edb81fa66a43a9/roles/8e4691cb5a4b4439b9712d27ef133c20 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 25 02:23:32.088299 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f05fc52-e973-4c9c-b353-236849eb6f95 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:32.088624 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f05fc52-e973-4c9c-b353-236849eb6f95 admin admin] PATH_INFO: `/v3/domains` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:32.089644 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f05fc52-e973-4c9c-b353-236849eb6f95 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:32.090229 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f05fc52-e973-4c9c-b353-236849eb6f95 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:32.092021 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f05fc52-e973-4c9c-b353-236849eb6f95 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:32.114416 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 309/603] 10.222.0.117 () {56 vars in 1135 bytes} [Tue Jan 25 02:23:32 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 02:23:32.121449 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6825ff96-37b8-45b2-936a-b861ca85e6ed admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:32.237791 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6825ff96-37b8-45b2-936a-b861ca85e6ed admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:32.242697 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c50409-1e0e-437a-a93f-8211793fdf62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:32.243766 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c50409-1e0e-437a-a93f-8211793fdf62 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:32.244119 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c50409-1e0e-437a-a93f-8211793fdf62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:32.244461 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c50409-1e0e-437a-a93f-8211793fdf62 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:32.253850 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c50409-1e0e-437a-a93f-8211793fdf62 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:32.259828 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c50409-1e0e-437a-a93f-8211793fdf62 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:32.275457 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: WARNING keystone.server.flask.application [None req-09c50409-1e0e-437a-a93f-8211793fdf62 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 25 02:23:32.277490 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 295/604] 10.222.0.117 () {56 vars in 1137 bytes} [Tue Jan 25 02:23:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:23:32.285569 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f05fc52-e973-4c9c-b353-236849eb6f95 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:32.303461 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f05fc52-e973-4c9c-b353-236849eb6f95 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:32.316373 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e9146c-bf38-4348-9a29-7a7a41deabd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:32.317818 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e9146c-bf38-4348-9a29-7a7a41deabd7 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:32.318478 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e9146c-bf38-4348-9a29-7a7a41deabd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:32.318947 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e9146c-bf38-4348-9a29-7a7a41deabd7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:32.320046 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e9146c-bf38-4348-9a29-7a7a41deabd7 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:32.320513 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e9146c-bf38-4348-9a29-7a7a41deabd7 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:32.322691 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e9146c-bf38-4348-9a29-7a7a41deabd7 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:32.345510 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 310/605] 10.222.0.117 () {56 vars in 1174 bytes} [Tue Jan 25 02:23:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:32.351118 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c50409-1e0e-437a-a93f-8211793fdf62 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:32.369681 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c50409-1e0e-437a-a93f-8211793fdf62 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:32.381231 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fae3a9f-b8e0-4649-bb67-064661d150b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:32.382109 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fae3a9f-b8e0-4649-bb67-064661d150b1 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:32.382495 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fae3a9f-b8e0-4649-bb67-064661d150b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:32.382858 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fae3a9f-b8e0-4649-bb67-064661d150b1 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:32.383830 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fae3a9f-b8e0-4649-bb67-064661d150b1 admin admin] RBAC: Adding query filter params (role.id=8e4691cb5a4b4439b9712d27ef133c20, scope.project.id=61a6fe9d4c914755bb0a64c392bd16aa, user.id=100f12ee56754f1c859106bf3e473df6) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:32.384232 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fae3a9f-b8e0-4649-bb67-064661d150b1 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:32.386934 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fae3a9f-b8e0-4649-bb67-064661d150b1 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:32.405377 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 296/606] 10.222.0.117 () {56 vars in 1400 bytes} [Tue Jan 25 02:23:32 2022] GET /identity/v3/role_assignments?user.id=100f12ee56754f1c859106bf3e473df6&scope.project.id=61a6fe9d4c914755bb0a64c392bd16aa&role.id=8e4691cb5a4b4439b9712d27ef133c20 => generated 260 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:33.523150 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d0b848-7fc3-408b-919f-c1e3e6245abc None None] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:33.523678 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d0b848-7fc3-408b-919f-c1e3e6245abc None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:33.523678 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d0b848-7fc3-408b-919f-c1e3e6245abc None None] PATH_INFO: `/` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:33.525866 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 311/607] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:23:33 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:23:33.532022 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c075c2-c0bd-4f54-bfc6-af339f615273 None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:33.532436 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c075c2-c0bd-4f54-bfc6-af339f615273 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:33.532576 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c075c2-c0bd-4f54-bfc6-af339f615273 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:33.553893 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-b2c075c2-c0bd-4f54-bfc6-af339f615273 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:23:33.555086 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-b2c075c2-c0bd-4f54-bfc6-af339f615273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:23:33.570196 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 297/608] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:23:33 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 25 02:23:33.610660 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d0b848-7fc3-408b-919f-c1e3e6245abc None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:33.632442 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d0b848-7fc3-408b-919f-c1e3e6245abc None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:33.637850 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fbe659-103e-44e4-a7bf-3ad40a1e5bfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:33.638652 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fbe659-103e-44e4-a7bf-3ad40a1e5bfd admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:33.638931 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fbe659-103e-44e4-a7bf-3ad40a1e5bfd admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:33.639202 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fbe659-103e-44e4-a7bf-3ad40a1e5bfd admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:33.658686 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fbe659-103e-44e4-a7bf-3ad40a1e5bfd admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 25 02:23:33.665622 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: WARNING keystone.server.flask.application [None req-75fbe659-103e-44e4-a7bf-3ad40a1e5bfd admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 25 02:23:33.667086 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 312/609] 10.222.0.117 () {56 vars in 1128 bytes} [Tue Jan 25 02:23:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:23:33.672590 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c075c2-c0bd-4f54-bfc6-af339f615273 None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:33.684763 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c075c2-c0bd-4f54-bfc6-af339f615273 None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:33.689291 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a74b31-f872-4432-8f5b-7fd3a29c60d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:33.689959 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a74b31-f872-4432-8f5b-7fd3a29c60d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:33.690238 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a74b31-f872-4432-8f5b-7fd3a29c60d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:33.690511 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a74b31-f872-4432-8f5b-7fd3a29c60d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:33.691270 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a74b31-f872-4432-8f5b-7fd3a29c60d0 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:33.691570 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a74b31-f872-4432-8f5b-7fd3a29c60d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:33.693199 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a74b31-f872-4432-8f5b-7fd3a29c60d0 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:33.702399 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 298/610] 10.222.0.117 () {56 vars in 1129 bytes} [Tue Jan 25 02:23:33 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:33.707747 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fbe659-103e-44e4-a7bf-3ad40a1e5bfd admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:33.718460 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fbe659-103e-44e4-a7bf-3ad40a1e5bfd admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:33.723390 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c26c52-2ea7-413f-9658-0498471cef54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:33.724220 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c26c52-2ea7-413f-9658-0498471cef54 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:33.724797 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c26c52-2ea7-413f-9658-0498471cef54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:33.725084 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c26c52-2ea7-413f-9658-0498471cef54 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:33.736321 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c26c52-2ea7-413f-9658-0498471cef54 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:33.738182 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c26c52-2ea7-413f-9658-0498471cef54 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:33.755630 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: WARNING keystone.server.flask.application [None req-42c26c52-2ea7-413f-9658-0498471cef54 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 25 02:23:33.757147 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 313/611] 10.222.0.117 () {56 vars in 1134 bytes} [Tue Jan 25 02:23:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 25 02:23:33.762869 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a74b31-f872-4432-8f5b-7fd3a29c60d0 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:33.773696 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a74b31-f872-4432-8f5b-7fd3a29c60d0 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:33.780336 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85240d6-84e2-4335-a3d6-25a9843b655f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:33.780989 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85240d6-84e2-4335-a3d6-25a9843b655f admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:33.781271 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85240d6-84e2-4335-a3d6-25a9843b655f admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:33.781545 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85240d6-84e2-4335-a3d6-25a9843b655f admin admin] PATH_INFO: `/v3/domains` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:33.782340 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85240d6-84e2-4335-a3d6-25a9843b655f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:33.782642 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85240d6-84e2-4335-a3d6-25a9843b655f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:33.788417 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85240d6-84e2-4335-a3d6-25a9843b655f admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:33.801758 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 299/612] 10.222.0.117 () {56 vars in 1135 bytes} [Tue Jan 25 02:23:33 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 02:23:33.807461 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c26c52-2ea7-413f-9658-0498471cef54 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:33.818718 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c26c52-2ea7-413f-9658-0498471cef54 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:33.823432 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9119b4d-b658-4fbb-a52a-b9079076ab43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:33.824353 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9119b4d-b658-4fbb-a52a-b9079076ab43 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:33.824831 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9119b4d-b658-4fbb-a52a-b9079076ab43 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:33.825120 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9119b4d-b658-4fbb-a52a-b9079076ab43 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:33.833920 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9119b4d-b658-4fbb-a52a-b9079076ab43 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:33.836107 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9119b4d-b658-4fbb-a52a-b9079076ab43 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:33.851072 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: WARNING keystone.server.flask.application [None req-f9119b4d-b658-4fbb-a52a-b9079076ab43 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jan 25 02:23:33.852670 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 314/613] 10.222.0.117 () {56 vars in 1119 bytes} [Tue Jan 25 02:23:33 2022] GET /identity/v3/users/nova => generated 82 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:23:33.858976 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85240d6-84e2-4335-a3d6-25a9843b655f admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:33.869072 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85240d6-84e2-4335-a3d6-25a9843b655f admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:33.880992 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e050d4e-e65d-4bba-be15-02532d078a3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:33.881896 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e050d4e-e65d-4bba-be15-02532d078a3a admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:33.882360 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e050d4e-e65d-4bba-be15-02532d078a3a admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:33.882782 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e050d4e-e65d-4bba-be15-02532d078a3a admin admin] PATH_INFO: `/v3/users` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:33.887774 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e050d4e-e65d-4bba-be15-02532d078a3a admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:33.888303 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e050d4e-e65d-4bba-be15-02532d078a3a admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:33.890327 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e050d4e-e65d-4bba-be15-02532d078a3a admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:33.920119 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 300/614] 10.222.0.117 () {56 vars in 1159 bytes} [Tue Jan 25 02:23:33 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 370 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:33.925777 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9119b4d-b658-4fbb-a52a-b9079076ab43 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:33.939577 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9119b4d-b658-4fbb-a52a-b9079076ab43 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:33.947594 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83a5ec3-fd53-43d1-991e-f88ed0f5e0eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:33.948954 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83a5ec3-fd53-43d1-991e-f88ed0f5e0eb admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:33.949430 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83a5ec3-fd53-43d1-991e-f88ed0f5e0eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:33.949675 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83a5ec3-fd53-43d1-991e-f88ed0f5e0eb admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:33.964480 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83a5ec3-fd53-43d1-991e-f88ed0f5e0eb admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:33.966604 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83a5ec3-fd53-43d1-991e-f88ed0f5e0eb admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:33.981816 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 315/615] 10.222.0.117 () {58 vars in 1329 bytes} [Tue Jan 25 02:23:33 2022] GET /identity/v3/auth/tokens => generated 915 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 25 02:23:33.987534 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e050d4e-e65d-4bba-be15-02532d078a3a admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:34.003760 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e050d4e-e65d-4bba-be15-02532d078a3a admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:34.013797 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c110d24a-35c8-4fc1-a9f7-9683f3a7565b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:34.014608 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c110d24a-35c8-4fc1-a9f7-9683f3a7565b admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:34.014897 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c110d24a-35c8-4fc1-a9f7-9683f3a7565b admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:34.015176 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c110d24a-35c8-4fc1-a9f7-9683f3a7565b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:34.035470 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c110d24a-35c8-4fc1-a9f7-9683f3a7565b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:34.037273 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c110d24a-35c8-4fc1-a9f7-9683f3a7565b admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:34.067404 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: WARNING keystone.server.flask.application [None req-c110d24a-35c8-4fc1-a9f7-9683f3a7565b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 25 02:23:34.068898 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 301/616] 10.222.0.117 () {56 vars in 1134 bytes} [Tue Jan 25 02:23:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 82 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:23:34.075449 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83a5ec3-fd53-43d1-991e-f88ed0f5e0eb admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:34.085837 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83a5ec3-fd53-43d1-991e-f88ed0f5e0eb admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:34.091375 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f67e9f6-7e23-425d-af10-b189b37278c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:34.092308 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f67e9f6-7e23-425d-af10-b189b37278c3 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:34.092754 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f67e9f6-7e23-425d-af10-b189b37278c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:34.093191 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f67e9f6-7e23-425d-af10-b189b37278c3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:34.094138 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f67e9f6-7e23-425d-af10-b189b37278c3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:34.094587 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f67e9f6-7e23-425d-af10-b189b37278c3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:34.096761 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f67e9f6-7e23-425d-af10-b189b37278c3 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:34.121606 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 316/617] 10.222.0.117 () {56 vars in 1135 bytes} [Tue Jan 25 02:23:34 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:34.127728 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c110d24a-35c8-4fc1-a9f7-9683f3a7565b admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:34.141575 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c110d24a-35c8-4fc1-a9f7-9683f3a7565b admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:34.152814 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ec4e42-dfdf-414f-be9a-41812963e996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:34.153814 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ec4e42-dfdf-414f-be9a-41812963e996 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:34.154101 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ec4e42-dfdf-414f-be9a-41812963e996 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:34.154387 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ec4e42-dfdf-414f-be9a-41812963e996 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:34.163312 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ec4e42-dfdf-414f-be9a-41812963e996 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:34.169834 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ec4e42-dfdf-414f-be9a-41812963e996 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:34.200216 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: WARNING keystone.server.flask.application [None req-16ec4e42-dfdf-414f-be9a-41812963e996 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 25 02:23:34.201824 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 302/618] 10.222.0.117 () {56 vars in 1137 bytes} [Tue Jan 25 02:23:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:23:34.207688 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f67e9f6-7e23-425d-af10-b189b37278c3 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:34.231408 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f67e9f6-7e23-425d-af10-b189b37278c3 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:34.240002 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c010898e-4eee-4e09-bc4d-c8672039a13f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:34.240947 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c010898e-4eee-4e09-bc4d-c8672039a13f admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:34.241366 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c010898e-4eee-4e09-bc4d-c8672039a13f admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:34.241777 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c010898e-4eee-4e09-bc4d-c8672039a13f admin admin] PATH_INFO: `/v3/projects` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:34.243030 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c010898e-4eee-4e09-bc4d-c8672039a13f admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:34.243498 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c010898e-4eee-4e09-bc4d-c8672039a13f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:34.247079 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c010898e-4eee-4e09-bc4d-c8672039a13f admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:34.274372 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 317/619] 10.222.0.117 () {56 vars in 1174 bytes} [Tue Jan 25 02:23:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:34.280992 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ec4e42-dfdf-414f-be9a-41812963e996 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:34.291730 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ec4e42-dfdf-414f-be9a-41812963e996 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:34.293399 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afb0171-67d7-483e-a84c-a7c1069b2a30 None None] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:34.293696 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afb0171-67d7-483e-a84c-a7c1069b2a30 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:34.293979 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afb0171-67d7-483e-a84c-a7c1069b2a30 None None] PATH_INFO: `/` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:34.295897 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 318/620] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:23:34 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jan 25 02:23:34.301020 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b06164f-50fc-4739-9119-30343076d027 None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:34.301290 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b06164f-50fc-4739-9119-30343076d027 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:34.301571 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b06164f-50fc-4739-9119-30343076d027 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:34.309931 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bc36d0-6686-46e6-bb0f-1b97d31050c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:34.311581 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bc36d0-6686-46e6-bb0f-1b97d31050c7 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:34.312005 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bc36d0-6686-46e6-bb0f-1b97d31050c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:34.312385 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bc36d0-6686-46e6-bb0f-1b97d31050c7 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:34.313338 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bc36d0-6686-46e6-bb0f-1b97d31050c7 admin admin] RBAC: Adding query filter params (role.id=8e4691cb5a4b4439b9712d27ef133c20, scope.project.id=61a6fe9d4c914755bb0a64c392bd16aa, user.id=d9ad6269900346458050063c12cac299) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:34.313755 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bc36d0-6686-46e6-bb0f-1b97d31050c7 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:34.318305 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bc36d0-6686-46e6-bb0f-1b97d31050c7 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:34.325880 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 303/621] 10.222.0.117 () {56 vars in 1400 bytes} [Tue Jan 25 02:23:34 2022] GET /identity/v3/role_assignments?user.id=d9ad6269900346458050063c12cac299&scope.project.id=61a6fe9d4c914755bb0a64c392bd16aa&role.id=8e4691cb5a4b4439b9712d27ef133c20 => generated 610 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:34.337019 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-0b06164f-50fc-4739-9119-30343076d027 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:23:34.338432 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-0b06164f-50fc-4739-9119-30343076d027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:23:34.353276 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 319/622] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:23:34 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 25 02:23:34.392933 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bc36d0-6686-46e6-bb0f-1b97d31050c7 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:34.403323 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bc36d0-6686-46e6-bb0f-1b97d31050c7 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:34.412807 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11faf83a-f601-4b05-af48-f85afd7adec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:34.413858 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11faf83a-f601-4b05-af48-f85afd7adec3 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:34.414262 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11faf83a-f601-4b05-af48-f85afd7adec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:34.414641 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11faf83a-f601-4b05-af48-f85afd7adec3 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:34.438686 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11faf83a-f601-4b05-af48-f85afd7adec3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 25 02:23:34.446029 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: WARNING keystone.server.flask.application [None req-11faf83a-f601-4b05-af48-f85afd7adec3 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 25 02:23:34.447440 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 304/623] 10.222.0.117 () {56 vars in 1128 bytes} [Tue Jan 25 02:23:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:23:34.453589 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b06164f-50fc-4739-9119-30343076d027 None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:34.463105 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b06164f-50fc-4739-9119-30343076d027 None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:34.469067 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cd88ac-a968-4e30-b660-704ec9b45125 None None] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:34.469351 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cd88ac-a968-4e30-b660-704ec9b45125 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:34.469623 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cd88ac-a968-4e30-b660-704ec9b45125 None None] PATH_INFO: `/` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:34.471864 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2372ec3-65ac-46ec-8cfd-88051efcff10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:34.472546 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2372ec3-65ac-46ec-8cfd-88051efcff10 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:34.472836 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2372ec3-65ac-46ec-8cfd-88051efcff10 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:34.473116 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2372ec3-65ac-46ec-8cfd-88051efcff10 admin admin] PATH_INFO: `/v3/roles` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:34.473897 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2372ec3-65ac-46ec-8cfd-88051efcff10 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:34.474206 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2372ec3-65ac-46ec-8cfd-88051efcff10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:34.475714 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 305/624] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:23:34 2022] GET /identity => generated 271 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jan 25 02:23:34.475901 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2372ec3-65ac-46ec-8cfd-88051efcff10 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:34.477037 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6757c8-0e2e-4399-b223-6ef38c64f6c9 None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:34.477328 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6757c8-0e2e-4399-b223-6ef38c64f6c9 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:34.477609 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6757c8-0e2e-4399-b223-6ef38c64f6c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:34.491413 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 320/625] 10.222.0.117 () {56 vars in 1129 bytes} [Tue Jan 25 02:23:34 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:34.502724 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2372ec3-65ac-46ec-8cfd-88051efcff10 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:34.502913 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-4e6757c8-0e2e-4399-b223-6ef38c64f6c9 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:23:34.504111 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-4e6757c8-0e2e-4399-b223-6ef38c64f6c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:23:34.513396 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 306/626] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:23:34 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 25 02:23:34.527046 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2372ec3-65ac-46ec-8cfd-88051efcff10 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:34.538328 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22b92c2-4bc8-4e0e-b2a9-ca28dee4cba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:34.539574 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22b92c2-4bc8-4e0e-b2a9-ca28dee4cba7 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:34.539821 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6757c8-0e2e-4399-b223-6ef38c64f6c9 None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:34.540505 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22b92c2-4bc8-4e0e-b2a9-ca28dee4cba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:34.540977 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22b92c2-4bc8-4e0e-b2a9-ca28dee4cba7 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:34.550761 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6757c8-0e2e-4399-b223-6ef38c64f6c9 None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:34.558184 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22b92c2-4bc8-4e0e-b2a9-ca28dee4cba7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:34.558790 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f1edb0-7188-4b77-ab24-477f825290ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:34.559816 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f1edb0-7188-4b77-ab24-477f825290ca admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:34.560216 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f1edb0-7188-4b77-ab24-477f825290ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:34.560640 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f1edb0-7188-4b77-ab24-477f825290ca admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:34.561097 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22b92c2-4bc8-4e0e-b2a9-ca28dee4cba7 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:34.577499 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f1edb0-7188-4b77-ab24-477f825290ca admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 25 02:23:34.584946 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: WARNING keystone.server.flask.application [None req-b5f1edb0-7188-4b77-ab24-477f825290ca admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 25 02:23:34.586560 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 307/627] 10.222.0.117 () {56 vars in 1128 bytes} [Tue Jan 25 02:23:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:23:34.586786 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: WARNING keystone.server.flask.application [None req-f22b92c2-4bc8-4e0e-b2a9-ca28dee4cba7 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 25 02:23:34.588378 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 321/628] 10.222.0.117 () {56 vars in 1134 bytes} [Tue Jan 25 02:23:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 86 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 25 02:23:34.598634 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f1edb0-7188-4b77-ab24-477f825290ca admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:34.602659 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22b92c2-4bc8-4e0e-b2a9-ca28dee4cba7 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:34.609485 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f1edb0-7188-4b77-ab24-477f825290ca admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:34.619896 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22b92c2-4bc8-4e0e-b2a9-ca28dee4cba7 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:34.623552 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f0dc1b-7242-465d-8c72-ed712c2fde82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:34.624348 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f0dc1b-7242-465d-8c72-ed712c2fde82 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:34.624711 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f0dc1b-7242-465d-8c72-ed712c2fde82 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:34.624992 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f0dc1b-7242-465d-8c72-ed712c2fde82 admin admin] PATH_INFO: `/v3/roles` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:34.626002 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f0dc1b-7242-465d-8c72-ed712c2fde82 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:34.626328 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f0dc1b-7242-465d-8c72-ed712c2fde82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:34.626437 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc0d01d-53c4-43a2-a3c7-a2be9572ef4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:34.627255 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc0d01d-53c4-43a2-a3c7-a2be9572ef4c admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:34.627683 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc0d01d-53c4-43a2-a3c7-a2be9572ef4c admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:34.627948 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f0dc1b-7242-465d-8c72-ed712c2fde82 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:34.628160 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc0d01d-53c4-43a2-a3c7-a2be9572ef4c admin admin] PATH_INFO: `/v3/domains` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:34.629063 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc0d01d-53c4-43a2-a3c7-a2be9572ef4c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:34.629460 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc0d01d-53c4-43a2-a3c7-a2be9572ef4c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:34.631207 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc0d01d-53c4-43a2-a3c7-a2be9572ef4c admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:34.645244 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 322/629] 10.222.0.117 () {56 vars in 1135 bytes} [Tue Jan 25 02:23:34 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 02:23:34.645938 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 308/630] 10.222.0.117 () {56 vars in 1129 bytes} [Tue Jan 25 02:23:34 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:34.650754 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc0d01d-53c4-43a2-a3c7-a2be9572ef4c admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:34.651617 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f0dc1b-7242-465d-8c72-ed712c2fde82 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:34.662276 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc0d01d-53c4-43a2-a3c7-a2be9572ef4c admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:34.665796 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f0dc1b-7242-465d-8c72-ed712c2fde82 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:34.668811 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a21907-30c9-489e-8a79-3017c68f1b95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:34.669821 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a21907-30c9-489e-8a79-3017c68f1b95 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:34.670189 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a21907-30c9-489e-8a79-3017c68f1b95 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:34.670478 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8551aa-7089-4840-90c2-88b0331e0a0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:34.670593 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a21907-30c9-489e-8a79-3017c68f1b95 admin admin] PATH_INFO: `/v3/users/glance` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:34.671266 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8551aa-7089-4840-90c2-88b0331e0a0c admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:34.671545 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8551aa-7089-4840-90c2-88b0331e0a0c admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:34.677829 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8551aa-7089-4840-90c2-88b0331e0a0c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:34.686087 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a21907-30c9-489e-8a79-3017c68f1b95 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:34.688159 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a21907-30c9-489e-8a79-3017c68f1b95 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:34.689665 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8551aa-7089-4840-90c2-88b0331e0a0c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:34.692264 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8551aa-7089-4840-90c2-88b0331e0a0c admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:34.703390 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: WARNING keystone.server.flask.application [None req-58a21907-30c9-489e-8a79-3017c68f1b95 admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jan 25 02:23:34.705853 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 323/631] 10.222.0.117 () {56 vars in 1125 bytes} [Tue Jan 25 02:23:34 2022] GET /identity/v3/users/glance => generated 84 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:23:34.711192 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: WARNING keystone.server.flask.application [None req-4d8551aa-7089-4840-90c2-88b0331e0a0c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 25 02:23:34.712415 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 309/632] 10.222.0.117 () {56 vars in 1134 bytes} [Tue Jan 25 02:23:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 25 02:23:34.713525 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a21907-30c9-489e-8a79-3017c68f1b95 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:34.725881 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8551aa-7089-4840-90c2-88b0331e0a0c admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:34.735126 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a21907-30c9-489e-8a79-3017c68f1b95 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:34.740897 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ccbd4e-6272-4753-8edd-98774682a650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:34.741569 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ccbd4e-6272-4753-8edd-98774682a650 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:34.741848 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ccbd4e-6272-4753-8edd-98774682a650 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:34.742115 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ccbd4e-6272-4753-8edd-98774682a650 admin admin] PATH_INFO: `/v3/users` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:34.743005 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ccbd4e-6272-4753-8edd-98774682a650 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:34.743286 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8551aa-7089-4840-90c2-88b0331e0a0c admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:34.743388 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ccbd4e-6272-4753-8edd-98774682a650 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:34.745900 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ccbd4e-6272-4753-8edd-98774682a650 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:34.751114 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d851d2f-5c92-456c-bb79-44a6d0e5bc77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:34.752100 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d851d2f-5c92-456c-bb79-44a6d0e5bc77 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:34.752596 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d851d2f-5c92-456c-bb79-44a6d0e5bc77 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:34.753081 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d851d2f-5c92-456c-bb79-44a6d0e5bc77 admin admin] PATH_INFO: `/v3/domains` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:34.754011 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d851d2f-5c92-456c-bb79-44a6d0e5bc77 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:34.754508 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d851d2f-5c92-456c-bb79-44a6d0e5bc77 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:34.756822 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d851d2f-5c92-456c-bb79-44a6d0e5bc77 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:34.767865 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 324/633] 10.222.0.117 () {56 vars in 1163 bytes} [Tue Jan 25 02:23:34 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 374 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:34.772107 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 310/634] 10.222.0.117 () {56 vars in 1135 bytes} [Tue Jan 25 02:23:34 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 02:23:34.773890 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ccbd4e-6272-4753-8edd-98774682a650 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:34.780410 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d851d2f-5c92-456c-bb79-44a6d0e5bc77 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:34.787178 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ccbd4e-6272-4753-8edd-98774682a650 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:34.791883 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d851d2f-5c92-456c-bb79-44a6d0e5bc77 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:34.793253 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745f384e-f634-402b-a694-15b9f9376b29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:34.794466 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745f384e-f634-402b-a694-15b9f9376b29 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:34.795059 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745f384e-f634-402b-a694-15b9f9376b29 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:34.795587 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745f384e-f634-402b-a694-15b9f9376b29 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:34.797283 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2b7db1-9f0f-40ab-a8cb-210ee93a2d9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:34.798071 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2b7db1-9f0f-40ab-a8cb-210ee93a2d9a admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:34.798354 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2b7db1-9f0f-40ab-a8cb-210ee93a2d9a admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:34.798638 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2b7db1-9f0f-40ab-a8cb-210ee93a2d9a admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:34.806319 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745f384e-f634-402b-a694-15b9f9376b29 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:34.806827 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2b7db1-9f0f-40ab-a8cb-210ee93a2d9a admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:34.809908 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745f384e-f634-402b-a694-15b9f9376b29 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:34.810306 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2b7db1-9f0f-40ab-a8cb-210ee93a2d9a admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:34.820465 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 325/635] 10.222.0.117 () {58 vars in 1329 bytes} [Tue Jan 25 02:23:34 2022] GET /identity/v3/auth/tokens => generated 915 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 25 02:23:34.825819 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: WARNING keystone.server.flask.application [None req-bd2b7db1-9f0f-40ab-a8cb-210ee93a2d9a admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jan 25 02:23:34.826269 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745f384e-f634-402b-a694-15b9f9376b29 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:34.827264 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 311/636] 10.222.0.117 () {56 vars in 1125 bytes} [Tue Jan 25 02:23:34 2022] GET /identity/v3/users/cinder => generated 84 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 25 02:23:34.832748 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2b7db1-9f0f-40ab-a8cb-210ee93a2d9a admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:34.836600 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745f384e-f634-402b-a694-15b9f9376b29 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:34.842545 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07856bbf-44e5-4d2e-9643-732e8e3ce141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:34.842991 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2b7db1-9f0f-40ab-a8cb-210ee93a2d9a admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:34.843886 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07856bbf-44e5-4d2e-9643-732e8e3ce141 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:34.844361 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07856bbf-44e5-4d2e-9643-732e8e3ce141 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:34.844976 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07856bbf-44e5-4d2e-9643-732e8e3ce141 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:34.847946 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eda5eb6-4535-4dff-8e35-4c1ef4b12017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:34.848602 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eda5eb6-4535-4dff-8e35-4c1ef4b12017 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:34.848884 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eda5eb6-4535-4dff-8e35-4c1ef4b12017 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:34.849154 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eda5eb6-4535-4dff-8e35-4c1ef4b12017 admin admin] PATH_INFO: `/v3/users` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:34.850004 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eda5eb6-4535-4dff-8e35-4c1ef4b12017 admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:34.850305 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eda5eb6-4535-4dff-8e35-4c1ef4b12017 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:34.852191 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eda5eb6-4535-4dff-8e35-4c1ef4b12017 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:34.859844 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07856bbf-44e5-4d2e-9643-732e8e3ce141 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:34.862036 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07856bbf-44e5-4d2e-9643-732e8e3ce141 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:34.872352 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 312/637] 10.222.0.117 () {56 vars in 1163 bytes} [Tue Jan 25 02:23:34 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 374 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 02:23:34.878109 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eda5eb6-4535-4dff-8e35-4c1ef4b12017 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:34.882311 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: WARNING keystone.server.flask.application [None req-07856bbf-44e5-4d2e-9643-732e8e3ce141 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 25 02:23:34.884077 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 326/638] 10.222.0.117 () {56 vars in 1134 bytes} [Tue Jan 25 02:23:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 25 02:23:34.890689 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eda5eb6-4535-4dff-8e35-4c1ef4b12017 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:34.891861 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07856bbf-44e5-4d2e-9643-732e8e3ce141 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:34.900835 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6938ef5e-1175-44e8-9485-eb215f80755d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:34.902071 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6938ef5e-1175-44e8-9485-eb215f80755d admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:34.902557 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6938ef5e-1175-44e8-9485-eb215f80755d admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:34.902840 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6938ef5e-1175-44e8-9485-eb215f80755d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:34.910003 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07856bbf-44e5-4d2e-9643-732e8e3ce141 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:34.921149 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6938ef5e-1175-44e8-9485-eb215f80755d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:34.921915 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ca3de4-6406-470a-8654-15e38d66e079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:34.924759 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ca3de4-6406-470a-8654-15e38d66e079 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:34.925244 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ca3de4-6406-470a-8654-15e38d66e079 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:34.925780 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ca3de4-6406-470a-8654-15e38d66e079 admin admin] PATH_INFO: `/v3/domains` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:34.926274 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6938ef5e-1175-44e8-9485-eb215f80755d admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:34.927117 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ca3de4-6406-470a-8654-15e38d66e079 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:34.928410 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ca3de4-6406-470a-8654-15e38d66e079 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:34.934077 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ca3de4-6406-470a-8654-15e38d66e079 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:34.951825 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 313/639] 10.222.0.117 () {58 vars in 1329 bytes} [Tue Jan 25 02:23:34 2022] GET /identity/v3/auth/tokens => generated 915 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jan 25 02:23:34.960570 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6938ef5e-1175-44e8-9485-eb215f80755d admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:34.965746 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 327/640] 10.222.0.117 () {56 vars in 1135 bytes} [Tue Jan 25 02:23:34 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:34.966930 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ca3de4-6406-470a-8654-15e38d66e079 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:34.977822 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6938ef5e-1175-44e8-9485-eb215f80755d admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:34.983524 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ca3de4-6406-470a-8654-15e38d66e079 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:34.988751 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3d9c9f-487d-4d63-b688-c8c648b3297c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:34.989877 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3d9c9f-487d-4d63-b688-c8c648b3297c admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:34.990355 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3d9c9f-487d-4d63-b688-c8c648b3297c admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:34.990821 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3d9c9f-487d-4d63-b688-c8c648b3297c admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:34.997506 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6919c222-8aac-4247-9712-d4cc4717cd1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:34.998304 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6919c222-8aac-4247-9712-d4cc4717cd1a admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:34.998591 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6919c222-8aac-4247-9712-d4cc4717cd1a admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:34.998868 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6919c222-8aac-4247-9712-d4cc4717cd1a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:35.000446 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3d9c9f-487d-4d63-b688-c8c648b3297c admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:35.002823 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3d9c9f-487d-4d63-b688-c8c648b3297c admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:35.018101 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: WARNING keystone.server.flask.application [None req-ad3d9c9f-487d-4d63-b688-c8c648b3297c admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 25 02:23:35.019783 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 328/641] 10.222.0.117 () {56 vars in 1137 bytes} [Tue Jan 25 02:23:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:23:35.021799 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6919c222-8aac-4247-9712-d4cc4717cd1a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:35.023681 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6919c222-8aac-4247-9712-d4cc4717cd1a admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:35.032494 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3d9c9f-487d-4d63-b688-c8c648b3297c admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:35.056653 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3d9c9f-487d-4d63-b688-c8c648b3297c admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:35.062700 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: WARNING keystone.server.flask.application [None req-6919c222-8aac-4247-9712-d4cc4717cd1a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 25 02:23:35.067421 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da61b4e0-c577-46c7-81c6-5e93ccb96f1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:35.067977 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 314/642] 10.222.0.117 () {56 vars in 1134 bytes} [Tue Jan 25 02:23:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 108 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 25 02:23:35.068828 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da61b4e0-c577-46c7-81c6-5e93ccb96f1f admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:35.069305 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da61b4e0-c577-46c7-81c6-5e93ccb96f1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:35.069766 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da61b4e0-c577-46c7-81c6-5e93ccb96f1f admin admin] PATH_INFO: `/v3/projects` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:35.070736 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da61b4e0-c577-46c7-81c6-5e93ccb96f1f admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:35.071192 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da61b4e0-c577-46c7-81c6-5e93ccb96f1f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:35.072825 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6919c222-8aac-4247-9712-d4cc4717cd1a admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:35.079110 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da61b4e0-c577-46c7-81c6-5e93ccb96f1f admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:35.093915 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6919c222-8aac-4247-9712-d4cc4717cd1a admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:35.103604 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc84caa-8701-4eee-8ccc-dd724b4e0068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:35.104992 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc84caa-8701-4eee-8ccc-dd724b4e0068 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:35.105628 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 329/643] 10.222.0.117 () {56 vars in 1174 bytes} [Tue Jan 25 02:23:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:35.106075 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc84caa-8701-4eee-8ccc-dd724b4e0068 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:35.106537 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc84caa-8701-4eee-8ccc-dd724b4e0068 admin admin] PATH_INFO: `/v3/domains` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:35.107415 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc84caa-8701-4eee-8ccc-dd724b4e0068 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:35.112001 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc84caa-8701-4eee-8ccc-dd724b4e0068 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:35.113894 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc84caa-8701-4eee-8ccc-dd724b4e0068 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:35.125684 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da61b4e0-c577-46c7-81c6-5e93ccb96f1f admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:35.140169 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da61b4e0-c577-46c7-81c6-5e93ccb96f1f admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:35.142504 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 315/644] 10.222.0.117 () {56 vars in 1135 bytes} [Tue Jan 25 02:23:35 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:35.144516 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc84caa-8701-4eee-8ccc-dd724b4e0068 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:35.147767 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b627810a-06ef-48a6-b3db-9607c163ab1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:35.149187 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b627810a-06ef-48a6-b3db-9607c163ab1c admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:35.150165 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b627810a-06ef-48a6-b3db-9607c163ab1c admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:35.152227 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b627810a-06ef-48a6-b3db-9607c163ab1c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:35.155194 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b627810a-06ef-48a6-b3db-9607c163ab1c admin admin] RBAC: Adding query filter params (role.id=8e4691cb5a4b4439b9712d27ef133c20, scope.project.id=61a6fe9d4c914755bb0a64c392bd16aa, user.id=db3663416137459d9da4a71032505b0b) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:35.155882 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b627810a-06ef-48a6-b3db-9607c163ab1c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:35.158531 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b627810a-06ef-48a6-b3db-9607c163ab1c admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:35.166882 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc84caa-8701-4eee-8ccc-dd724b4e0068 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:35.175749 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 330/645] 10.222.0.117 () {56 vars in 1400 bytes} [Tue Jan 25 02:23:35 2022] GET /identity/v3/role_assignments?user.id=db3663416137459d9da4a71032505b0b&scope.project.id=61a6fe9d4c914755bb0a64c392bd16aa&role.id=8e4691cb5a4b4439b9712d27ef133c20 => generated 610 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:35.176149 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266d2e01-a4f1-4a97-8fe7-de74532e51af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:35.176982 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266d2e01-a4f1-4a97-8fe7-de74532e51af admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:35.177266 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266d2e01-a4f1-4a97-8fe7-de74532e51af admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:35.177542 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266d2e01-a4f1-4a97-8fe7-de74532e51af admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:35.194159 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266d2e01-a4f1-4a97-8fe7-de74532e51af admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:35.196303 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266d2e01-a4f1-4a97-8fe7-de74532e51af admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:35.217977 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: WARNING keystone.server.flask.application [None req-266d2e01-a4f1-4a97-8fe7-de74532e51af admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 25 02:23:35.219409 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 316/646] 10.222.0.117 () {56 vars in 1137 bytes} [Tue Jan 25 02:23:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:23:35.225649 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b627810a-06ef-48a6-b3db-9607c163ab1c admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:35.236152 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b627810a-06ef-48a6-b3db-9607c163ab1c admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:35.240839 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0866ce7f-70ee-4700-b86b-dab54f42e2ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:35.241522 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0866ce7f-70ee-4700-b86b-dab54f42e2ce admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:35.241806 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0866ce7f-70ee-4700-b86b-dab54f42e2ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:35.242083 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0866ce7f-70ee-4700-b86b-dab54f42e2ce admin admin] PATH_INFO: `/v3/projects` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:35.242898 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0866ce7f-70ee-4700-b86b-dab54f42e2ce admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:35.243204 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0866ce7f-70ee-4700-b86b-dab54f42e2ce admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:35.245697 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0866ce7f-70ee-4700-b86b-dab54f42e2ce admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:35.260067 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 331/647] 10.222.0.117 () {56 vars in 1174 bytes} [Tue Jan 25 02:23:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:35.266750 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266d2e01-a4f1-4a97-8fe7-de74532e51af admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:35.279947 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266d2e01-a4f1-4a97-8fe7-de74532e51af admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:35.284617 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b8e5d7-2776-4a6f-944f-101e9c3e4987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:35.285257 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b8e5d7-2776-4a6f-944f-101e9c3e4987 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:35.285541 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b8e5d7-2776-4a6f-944f-101e9c3e4987 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:35.285819 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b8e5d7-2776-4a6f-944f-101e9c3e4987 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:35.286674 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b8e5d7-2776-4a6f-944f-101e9c3e4987 admin admin] RBAC: Adding query filter params (role.id=8e4691cb5a4b4439b9712d27ef133c20, scope.project.id=61a6fe9d4c914755bb0a64c392bd16aa, user.id=1cc5249aea09430080e232cf17757f86) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:35.286982 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b8e5d7-2776-4a6f-944f-101e9c3e4987 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:35.288885 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b8e5d7-2776-4a6f-944f-101e9c3e4987 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:35.300866 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 317/648] 10.222.0.117 () {56 vars in 1400 bytes} [Tue Jan 25 02:23:35 2022] GET /identity/v3/role_assignments?user.id=1cc5249aea09430080e232cf17757f86&scope.project.id=61a6fe9d4c914755bb0a64c392bd16aa&role.id=8e4691cb5a4b4439b9712d27ef133c20 => generated 610 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:35.316588 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ea27f8-bdaa-4896-ae99-7365c590c7c9 None None] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:35.316877 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ea27f8-bdaa-4896-ae99-7365c590c7c9 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:35.317065 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ea27f8-bdaa-4896-ae99-7365c590c7c9 None None] PATH_INFO: `/` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:35.318859 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 332/649] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:23:35 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:23:35.325689 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609fcfd0-527c-4938-bbb8-02abe8cb3d89 None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:35.325972 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609fcfd0-527c-4938-bbb8-02abe8cb3d89 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:35.326252 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609fcfd0-527c-4938-bbb8-02abe8cb3d89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:35.357104 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-609fcfd0-527c-4938-bbb8-02abe8cb3d89 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:23:35.358339 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-609fcfd0-527c-4938-bbb8-02abe8cb3d89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:23:35.371110 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 318/650] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:23:35 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 25 02:23:35.395843 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ea27f8-bdaa-4896-ae99-7365c590c7c9 None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:35.410905 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ea27f8-bdaa-4896-ae99-7365c590c7c9 None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:35.417862 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20bbd71-cc7b-48b3-92c3-85f7870f68bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:35.419477 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20bbd71-cc7b-48b3-92c3-85f7870f68bd admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:35.420014 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20bbd71-cc7b-48b3-92c3-85f7870f68bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:35.420489 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20bbd71-cc7b-48b3-92c3-85f7870f68bd admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:35.434493 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20bbd71-cc7b-48b3-92c3-85f7870f68bd admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 25 02:23:35.441828 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: WARNING keystone.server.flask.application [None req-d20bbd71-cc7b-48b3-92c3-85f7870f68bd admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 25 02:23:35.447810 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 333/651] 10.222.0.117 () {56 vars in 1128 bytes} [Tue Jan 25 02:23:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:23:35.450533 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609fcfd0-527c-4938-bbb8-02abe8cb3d89 None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:35.460087 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609fcfd0-527c-4938-bbb8-02abe8cb3d89 None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:35.465986 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3788e3-986b-4985-acad-7e9c2b8378c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:35.467018 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3788e3-986b-4985-acad-7e9c2b8378c7 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:35.467528 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3788e3-986b-4985-acad-7e9c2b8378c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:35.468049 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3788e3-986b-4985-acad-7e9c2b8378c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:35.469029 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3788e3-986b-4985-acad-7e9c2b8378c7 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:35.469537 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3788e3-986b-4985-acad-7e9c2b8378c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:35.471633 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3788e3-986b-4985-acad-7e9c2b8378c7 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:35.486571 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 319/652] 10.222.0.117 () {56 vars in 1129 bytes} [Tue Jan 25 02:23:35 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:35.488345 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20bbd71-cc7b-48b3-92c3-85f7870f68bd admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:35.500469 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20bbd71-cc7b-48b3-92c3-85f7870f68bd admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:35.506569 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb5aa13-fdad-4dec-9c9e-cc87a3c11325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:35.507785 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb5aa13-fdad-4dec-9c9e-cc87a3c11325 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:35.508297 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb5aa13-fdad-4dec-9c9e-cc87a3c11325 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:35.508795 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb5aa13-fdad-4dec-9c9e-cc87a3c11325 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:35.525793 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb5aa13-fdad-4dec-9c9e-cc87a3c11325 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:35.527823 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb5aa13-fdad-4dec-9c9e-cc87a3c11325 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:35.553498 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: WARNING keystone.server.flask.application [None req-0cb5aa13-fdad-4dec-9c9e-cc87a3c11325 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 25 02:23:35.555455 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 334/653] 10.222.0.117 () {56 vars in 1134 bytes} [Tue Jan 25 02:23:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:23:35.560837 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de35a7ff-e34c-4fee-9836-e92e579a7004 None None] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:35.561726 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb5aa13-fdad-4dec-9c9e-cc87a3c11325 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:35.561920 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de35a7ff-e34c-4fee-9836-e92e579a7004 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:35.562383 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de35a7ff-e34c-4fee-9836-e92e579a7004 None None] PATH_INFO: `/` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:35.564674 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 320/654] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:23:35 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:23:35.571865 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62918c1-d6d9-47b8-a45d-a4509926e9dc None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:35.571995 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62918c1-d6d9-47b8-a45d-a4509926e9dc None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:35.572252 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62918c1-d6d9-47b8-a45d-a4509926e9dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:35.572898 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb5aa13-fdad-4dec-9c9e-cc87a3c11325 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:35.582538 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57251642-d4ae-47b2-accd-b550247eadb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:35.583459 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57251642-d4ae-47b2-accd-b550247eadb2 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:35.585483 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57251642-d4ae-47b2-accd-b550247eadb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:35.585483 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57251642-d4ae-47b2-accd-b550247eadb2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:35.585483 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57251642-d4ae-47b2-accd-b550247eadb2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:35.585740 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57251642-d4ae-47b2-accd-b550247eadb2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:35.590236 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57251642-d4ae-47b2-accd-b550247eadb2 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:35.598640 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-e62918c1-d6d9-47b8-a45d-a4509926e9dc None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:23:35.601034 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-e62918c1-d6d9-47b8-a45d-a4509926e9dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:23:35.608537 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 335/655] 10.222.0.117 () {56 vars in 1135 bytes} [Tue Jan 25 02:23:35 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:35.613775 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 321/656] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:23:35 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 25 02:23:35.614832 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57251642-d4ae-47b2-accd-b550247eadb2 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:35.628112 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57251642-d4ae-47b2-accd-b550247eadb2 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:35.635212 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af31b323-e1c3-438b-8383-737a2573783d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:35.636878 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af31b323-e1c3-438b-8383-737a2573783d admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:35.637462 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af31b323-e1c3-438b-8383-737a2573783d admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:35.637836 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af31b323-e1c3-438b-8383-737a2573783d admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:35.641868 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62918c1-d6d9-47b8-a45d-a4509926e9dc None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:35.646131 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af31b323-e1c3-438b-8383-737a2573783d admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:35.648440 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af31b323-e1c3-438b-8383-737a2573783d admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:35.653090 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62918c1-d6d9-47b8-a45d-a4509926e9dc None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:35.658160 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40877440-06fc-4743-8998-91be5e2f40ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:35.659018 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40877440-06fc-4743-8998-91be5e2f40ab admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:35.659301 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40877440-06fc-4743-8998-91be5e2f40ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:35.659577 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40877440-06fc-4743-8998-91be5e2f40ab admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:35.664494 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: WARNING keystone.server.flask.application [None req-af31b323-e1c3-438b-8383-737a2573783d admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jan 25 02:23:35.666143 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 336/657] 10.222.0.117 () {56 vars in 1122 bytes} [Tue Jan 25 02:23:35 2022] GET /identity/v3/users/swift => generated 83 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 25 02:23:35.673137 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af31b323-e1c3-438b-8383-737a2573783d admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:35.676170 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40877440-06fc-4743-8998-91be5e2f40ab admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 25 02:23:35.684808 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: WARNING keystone.server.flask.application [None req-40877440-06fc-4743-8998-91be5e2f40ab admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 25 02:23:35.686163 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 322/658] 10.222.0.117 () {56 vars in 1128 bytes} [Tue Jan 25 02:23:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 25 02:23:35.693145 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af31b323-e1c3-438b-8383-737a2573783d admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:35.694329 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40877440-06fc-4743-8998-91be5e2f40ab admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:35.697962 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1f6152-f8de-424d-ae56-a97be88f8fbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:35.699216 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1f6152-f8de-424d-ae56-a97be88f8fbd admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:35.699495 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1f6152-f8de-424d-ae56-a97be88f8fbd admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:35.699800 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1f6152-f8de-424d-ae56-a97be88f8fbd admin admin] PATH_INFO: `/v3/users` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:35.700755 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1f6152-f8de-424d-ae56-a97be88f8fbd admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:35.701063 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1f6152-f8de-424d-ae56-a97be88f8fbd admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:35.703052 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1f6152-f8de-424d-ae56-a97be88f8fbd admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:35.718281 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40877440-06fc-4743-8998-91be5e2f40ab admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:35.722328 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e2b664-7f5e-4873-83eb-9e326e84da81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:35.725137 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e2b664-7f5e-4873-83eb-9e326e84da81 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:35.726367 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e2b664-7f5e-4873-83eb-9e326e84da81 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:35.726654 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e2b664-7f5e-4873-83eb-9e326e84da81 admin admin] PATH_INFO: `/v3/roles` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:35.727439 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e2b664-7f5e-4873-83eb-9e326e84da81 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:35.730163 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e2b664-7f5e-4873-83eb-9e326e84da81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:35.731940 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e2b664-7f5e-4873-83eb-9e326e84da81 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:35.738114 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 337/659] 10.222.0.117 () {56 vars in 1161 bytes} [Tue Jan 25 02:23:35 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 372 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:35.747779 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1f6152-f8de-424d-ae56-a97be88f8fbd admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:35.755808 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 323/660] 10.222.0.117 () {56 vars in 1129 bytes} [Tue Jan 25 02:23:35 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:35.764077 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e2b664-7f5e-4873-83eb-9e326e84da81 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:35.770313 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1f6152-f8de-424d-ae56-a97be88f8fbd admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:35.778629 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3c96ac-b0a4-4adf-91f2-7c540741cf4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:35.781101 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3c96ac-b0a4-4adf-91f2-7c540741cf4f admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:35.781387 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3c96ac-b0a4-4adf-91f2-7c540741cf4f admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:35.781665 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3c96ac-b0a4-4adf-91f2-7c540741cf4f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:35.782812 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e2b664-7f5e-4873-83eb-9e326e84da81 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:35.792025 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c2d640-724f-4ebd-bf16-355db72025d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:35.795151 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c2d640-724f-4ebd-bf16-355db72025d8 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:35.795493 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c2d640-724f-4ebd-bf16-355db72025d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:35.795796 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c2d640-724f-4ebd-bf16-355db72025d8 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:35.800583 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3c96ac-b0a4-4adf-91f2-7c540741cf4f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:35.802682 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3c96ac-b0a4-4adf-91f2-7c540741cf4f admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:35.812139 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c2d640-724f-4ebd-bf16-355db72025d8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:35.816863 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c2d640-724f-4ebd-bf16-355db72025d8 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:35.837555 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: WARNING keystone.server.flask.application [None req-ff3c96ac-b0a4-4adf-91f2-7c540741cf4f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 25 02:23:35.846347 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 338/661] 10.222.0.117 () {56 vars in 1134 bytes} [Tue Jan 25 02:23:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 99 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 25 02:23:35.847244 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3c96ac-b0a4-4adf-91f2-7c540741cf4f admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:35.852311 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: WARNING keystone.server.flask.application [None req-f4c2d640-724f-4ebd-bf16-355db72025d8 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 25 02:23:35.853656 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 324/662] 10.222.0.117 () {56 vars in 1134 bytes} [Tue Jan 25 02:23:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 90 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 25 02:23:35.859534 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c2d640-724f-4ebd-bf16-355db72025d8 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:35.868737 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3c96ac-b0a4-4adf-91f2-7c540741cf4f admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:35.877655 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58abd374-6edc-41f3-b3bc-c1861c69c045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:35.878304 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58abd374-6edc-41f3-b3bc-c1861c69c045 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:35.878670 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c2d640-724f-4ebd-bf16-355db72025d8 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:35.879519 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58abd374-6edc-41f3-b3bc-c1861c69c045 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:35.879861 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58abd374-6edc-41f3-b3bc-c1861c69c045 admin admin] PATH_INFO: `/v3/domains` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:35.880600 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58abd374-6edc-41f3-b3bc-c1861c69c045 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:35.882146 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58abd374-6edc-41f3-b3bc-c1861c69c045 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:35.885345 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58abd374-6edc-41f3-b3bc-c1861c69c045 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:35.889407 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2c76e4-0c2b-4930-83db-25211127654e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:35.890997 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2c76e4-0c2b-4930-83db-25211127654e admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:35.891277 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2c76e4-0c2b-4930-83db-25211127654e admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:35.891592 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2c76e4-0c2b-4930-83db-25211127654e admin admin] PATH_INFO: `/v3/domains` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:35.892394 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2c76e4-0c2b-4930-83db-25211127654e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:35.892740 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2c76e4-0c2b-4930-83db-25211127654e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:35.896337 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2c76e4-0c2b-4930-83db-25211127654e admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:35.910922 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 339/663] 10.222.0.117 () {56 vars in 1135 bytes} [Tue Jan 25 02:23:35 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:35.915957 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58abd374-6edc-41f3-b3bc-c1861c69c045 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:35.916866 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 325/664] 10.222.0.117 () {56 vars in 1135 bytes} [Tue Jan 25 02:23:35 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 02:23:35.922463 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2c76e4-0c2b-4930-83db-25211127654e admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:35.933651 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2c76e4-0c2b-4930-83db-25211127654e admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:35.943738 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58abd374-6edc-41f3-b3bc-c1861c69c045 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:35.948025 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf7a2ab-4503-4674-87f7-94ca2b11d811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:35.949051 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7da0a4-0228-4c27-a85c-ceb13a45b922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:35.950598 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7da0a4-0228-4c27-a85c-ceb13a45b922 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:35.951305 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf7a2ab-4503-4674-87f7-94ca2b11d811 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:35.951995 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf7a2ab-4503-4674-87f7-94ca2b11d811 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:35.952241 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7da0a4-0228-4c27-a85c-ceb13a45b922 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:35.952643 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7da0a4-0228-4c27-a85c-ceb13a45b922 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:35.953058 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf7a2ab-4503-4674-87f7-94ca2b11d811 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:35.968412 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf7a2ab-4503-4674-87f7-94ca2b11d811 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:35.971440 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf7a2ab-4503-4674-87f7-94ca2b11d811 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:35.972394 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7da0a4-0228-4c27-a85c-ceb13a45b922 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:35.974579 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7da0a4-0228-4c27-a85c-ceb13a45b922 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:36.003157 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: WARNING keystone.server.flask.application [None req-6c7da0a4-0228-4c27-a85c-ceb13a45b922 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jan 25 02:23:36.004221 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: WARNING keystone.server.flask.application [None req-6bf7a2ab-4503-4674-87f7-94ca2b11d811 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 25 02:23:36.006033 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 326/665] 10.222.0.117 () {56 vars in 1128 bytes} [Tue Jan 25 02:23:35 2022] GET /identity/v3/users/neutron => generated 85 bytes in 84 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 25 02:23:36.007180 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 340/666] 10.222.0.117 () {56 vars in 1137 bytes} [Tue Jan 25 02:23:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 92 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 25 02:23:36.012841 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf7a2ab-4503-4674-87f7-94ca2b11d811 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:36.016870 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7da0a4-0228-4c27-a85c-ceb13a45b922 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:36.027012 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7da0a4-0228-4c27-a85c-ceb13a45b922 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:36.029253 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf7a2ab-4503-4674-87f7-94ca2b11d811 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:36.035368 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a828a6bd-e458-46a5-8e8a-0cf54f9b45e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:36.036047 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a828a6bd-e458-46a5-8e8a-0cf54f9b45e7 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:36.036326 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a828a6bd-e458-46a5-8e8a-0cf54f9b45e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:36.036603 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a828a6bd-e458-46a5-8e8a-0cf54f9b45e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:36.037396 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a828a6bd-e458-46a5-8e8a-0cf54f9b45e7 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:36.037699 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a828a6bd-e458-46a5-8e8a-0cf54f9b45e7 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:36.039530 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a828a6bd-e458-46a5-8e8a-0cf54f9b45e7 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:36.043023 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caefd2ef-bb30-4f0c-a5e7-bc70c83a280d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:36.043674 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caefd2ef-bb30-4f0c-a5e7-bc70c83a280d admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:36.043981 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caefd2ef-bb30-4f0c-a5e7-bc70c83a280d admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:36.044256 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caefd2ef-bb30-4f0c-a5e7-bc70c83a280d admin admin] PATH_INFO: `/v3/users` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:36.045684 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caefd2ef-bb30-4f0c-a5e7-bc70c83a280d admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:36.046188 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caefd2ef-bb30-4f0c-a5e7-bc70c83a280d admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:36.048520 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caefd2ef-bb30-4f0c-a5e7-bc70c83a280d admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:36.067747 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 341/667] 10.222.0.117 () {56 vars in 1165 bytes} [Tue Jan 25 02:23:36 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 376 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:36.070110 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 327/668] 10.222.0.117 () {56 vars in 1174 bytes} [Tue Jan 25 02:23:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 02:23:36.074221 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caefd2ef-bb30-4f0c-a5e7-bc70c83a280d admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:36.078246 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a828a6bd-e458-46a5-8e8a-0cf54f9b45e7 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:36.088132 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caefd2ef-bb30-4f0c-a5e7-bc70c83a280d admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:36.093970 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811ed9de-8a81-4268-bbb5-4484da9f4380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:36.094913 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811ed9de-8a81-4268-bbb5-4484da9f4380 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:36.095570 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811ed9de-8a81-4268-bbb5-4484da9f4380 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:36.096033 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811ed9de-8a81-4268-bbb5-4484da9f4380 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:36.101877 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a828a6bd-e458-46a5-8e8a-0cf54f9b45e7 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:36.107437 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811ed9de-8a81-4268-bbb5-4484da9f4380 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:36.110261 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811ed9de-8a81-4268-bbb5-4484da9f4380 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:36.118062 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da9f363-9378-49ac-9bbe-c46145269b0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:36.119828 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da9f363-9378-49ac-9bbe-c46145269b0c admin admin] REQUEST_METHOD: `PUT` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:36.120753 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da9f363-9378-49ac-9bbe-c46145269b0c admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:36.122632 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da9f363-9378-49ac-9bbe-c46145269b0c admin admin] PATH_INFO: `/v3/projects/61a6fe9d4c914755bb0a64c392bd16aa/users/100f12ee56754f1c859106bf3e473df6/roles/8e4691cb5a4b4439b9712d27ef133c20` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:36.127826 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 342/669] 10.222.0.117 () {58 vars in 1329 bytes} [Tue Jan 25 02:23:36 2022] GET /identity/v3/auth/tokens => generated 915 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 25 02:23:36.138277 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811ed9de-8a81-4268-bbb5-4484da9f4380 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:36.161547 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811ed9de-8a81-4268-bbb5-4484da9f4380 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:36.169705 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da9f363-9378-49ac-9bbe-c46145269b0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=61a6fe9d4c914755bb0a64c392bd16aa, user_id=100f12ee56754f1c859106bf3e473df6, role_id=8e4691cb5a4b4439b9712d27ef133c20)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:36.174546 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da9f363-9378-49ac-9bbe-c46145269b0c admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:36.177271 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b71883-58ea-42d5-b305-dee2fd591689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:36.178059 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b71883-58ea-42d5-b305-dee2fd591689 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:36.178343 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b71883-58ea-42d5-b305-dee2fd591689 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:36.178615 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b71883-58ea-42d5-b305-dee2fd591689 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:36.192952 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 328/670] 10.222.0.117 () {58 vars in 1465 bytes} [Tue Jan 25 02:23:36 2022] PUT /identity/v3/projects/61a6fe9d4c914755bb0a64c392bd16aa/users/100f12ee56754f1c859106bf3e473df6/roles/8e4691cb5a4b4439b9712d27ef133c20 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 25 02:23:36.201378 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b71883-58ea-42d5-b305-dee2fd591689 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:36.204762 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b71883-58ea-42d5-b305-dee2fd591689 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:36.227826 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: WARNING keystone.server.flask.application [None req-b0b71883-58ea-42d5-b305-dee2fd591689 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 25 02:23:36.230154 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 343/671] 10.222.0.117 () {56 vars in 1134 bytes} [Tue Jan 25 02:23:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 92 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:23:36.236125 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da9f363-9378-49ac-9bbe-c46145269b0c admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:36.307211 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da9f363-9378-49ac-9bbe-c46145269b0c admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:36.315069 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cff2e4f-405d-4ff3-a039-b90fa7c91a20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:36.316247 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cff2e4f-405d-4ff3-a039-b90fa7c91a20 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:36.316745 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cff2e4f-405d-4ff3-a039-b90fa7c91a20 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:36.317229 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cff2e4f-405d-4ff3-a039-b90fa7c91a20 admin admin] PATH_INFO: `/v3/domains` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:36.318488 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cff2e4f-405d-4ff3-a039-b90fa7c91a20 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:36.319063 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cff2e4f-405d-4ff3-a039-b90fa7c91a20 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:36.320977 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cff2e4f-405d-4ff3-a039-b90fa7c91a20 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:36.335259 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 329/672] 10.222.0.117 () {56 vars in 1135 bytes} [Tue Jan 25 02:23:36 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:36.342049 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b71883-58ea-42d5-b305-dee2fd591689 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:36.358123 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b71883-58ea-42d5-b305-dee2fd591689 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:36.365472 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21bb15c-d8ac-4af3-8b20-8df1d681a1ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:36.366758 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21bb15c-d8ac-4af3-8b20-8df1d681a1ab admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:36.367163 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21bb15c-d8ac-4af3-8b20-8df1d681a1ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:36.367508 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21bb15c-d8ac-4af3-8b20-8df1d681a1ab admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:36.378617 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21bb15c-d8ac-4af3-8b20-8df1d681a1ab admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:36.381775 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21bb15c-d8ac-4af3-8b20-8df1d681a1ab admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:36.403619 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: WARNING keystone.server.flask.application [None req-f21bb15c-d8ac-4af3-8b20-8df1d681a1ab admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 25 02:23:36.405389 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 344/673] 10.222.0.117 () {56 vars in 1137 bytes} [Tue Jan 25 02:23:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:23:36.411122 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cff2e4f-405d-4ff3-a039-b90fa7c91a20 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:36.422320 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cff2e4f-405d-4ff3-a039-b90fa7c91a20 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:36.427286 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b60b58-b0ae-47c5-b1bb-a5d2787d1339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:36.428105 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b60b58-b0ae-47c5-b1bb-a5d2787d1339 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:36.428463 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b60b58-b0ae-47c5-b1bb-a5d2787d1339 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:36.428809 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b60b58-b0ae-47c5-b1bb-a5d2787d1339 admin admin] PATH_INFO: `/v3/projects` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:36.429747 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b60b58-b0ae-47c5-b1bb-a5d2787d1339 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:36.430131 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b60b58-b0ae-47c5-b1bb-a5d2787d1339 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:36.432264 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b60b58-b0ae-47c5-b1bb-a5d2787d1339 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:36.447592 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 330/674] 10.222.0.117 () {56 vars in 1174 bytes} [Tue Jan 25 02:23:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:36.453988 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21bb15c-d8ac-4af3-8b20-8df1d681a1ab admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:36.465723 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21bb15c-d8ac-4af3-8b20-8df1d681a1ab admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:36.471048 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9733f894-27f8-45de-9d51-4cc16bb73eb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:36.471903 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9733f894-27f8-45de-9d51-4cc16bb73eb4 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:36.472255 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9733f894-27f8-45de-9d51-4cc16bb73eb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:36.472595 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9733f894-27f8-45de-9d51-4cc16bb73eb4 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:36.473563 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9733f894-27f8-45de-9d51-4cc16bb73eb4 admin admin] RBAC: Adding query filter params (role.id=8e4691cb5a4b4439b9712d27ef133c20, scope.project.id=61a6fe9d4c914755bb0a64c392bd16aa, user.id=9ca4071c5f8f4a31b5edb81fa66a43a9) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:36.473945 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9733f894-27f8-45de-9d51-4cc16bb73eb4 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:36.476034 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9733f894-27f8-45de-9d51-4cc16bb73eb4 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:36.484233 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 345/675] 10.222.0.117 () {56 vars in 1400 bytes} [Tue Jan 25 02:23:36 2022] GET /identity/v3/role_assignments?user.id=9ca4071c5f8f4a31b5edb81fa66a43a9&scope.project.id=61a6fe9d4c914755bb0a64c392bd16aa&role.id=8e4691cb5a4b4439b9712d27ef133c20 => generated 610 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:37.337503 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eebd8c-a707-453d-ae0b-a0dbaefbf992 None None] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:37.338210 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eebd8c-a707-453d-ae0b-a0dbaefbf992 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:37.338210 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eebd8c-a707-453d-ae0b-a0dbaefbf992 None None] PATH_INFO: `/` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:37.341186 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 331/676] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:23:37 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:23:37.349968 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1394803c-0ea1-4525-93a8-76c18c9c785e None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:37.350546 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1394803c-0ea1-4525-93a8-76c18c9c785e None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:37.350806 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1394803c-0ea1-4525-93a8-76c18c9c785e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:37.388829 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-1394803c-0ea1-4525-93a8-76c18c9c785e None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:23:37.390578 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-1394803c-0ea1-4525-93a8-76c18c9c785e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:23:37.406855 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 346/677] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:23:37 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 25 02:23:37.449278 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10eebd8c-a707-453d-ae0b-a0dbaefbf992 None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:37.465991 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10eebd8c-a707-453d-ae0b-a0dbaefbf992 None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:37.474622 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be27508c-5dbb-4872-8f64-ccdb4f0ac37e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:37.475416 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be27508c-5dbb-4872-8f64-ccdb4f0ac37e admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:37.475716 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be27508c-5dbb-4872-8f64-ccdb4f0ac37e admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:37.475999 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be27508c-5dbb-4872-8f64-ccdb4f0ac37e admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:37.494000 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be27508c-5dbb-4872-8f64-ccdb4f0ac37e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 25 02:23:37.502045 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: WARNING keystone.server.flask.application [None req-be27508c-5dbb-4872-8f64-ccdb4f0ac37e admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 25 02:23:37.503787 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 332/678] 10.222.0.117 () {56 vars in 1122 bytes} [Tue Jan 25 02:23:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:23:37.509333 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1394803c-0ea1-4525-93a8-76c18c9c785e None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:37.524740 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1394803c-0ea1-4525-93a8-76c18c9c785e None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:37.538273 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcf312e-c310-45f9-b4e4-b5ec0a66f292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:37.538952 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcf312e-c310-45f9-b4e4-b5ec0a66f292 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:37.539231 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcf312e-c310-45f9-b4e4-b5ec0a66f292 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:37.539502 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcf312e-c310-45f9-b4e4-b5ec0a66f292 admin admin] PATH_INFO: `/v3/roles` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:37.540303 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcf312e-c310-45f9-b4e4-b5ec0a66f292 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:37.540596 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcf312e-c310-45f9-b4e4-b5ec0a66f292 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:37.543021 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcf312e-c310-45f9-b4e4-b5ec0a66f292 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:37.555673 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 347/679] 10.222.0.117 () {56 vars in 1125 bytes} [Tue Jan 25 02:23:37 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:37.561908 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be27508c-5dbb-4872-8f64-ccdb4f0ac37e admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:37.577350 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be27508c-5dbb-4872-8f64-ccdb4f0ac37e admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:37.583927 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76329c03-7286-46ed-a17b-ae2be62aed3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:37.584722 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76329c03-7286-46ed-a17b-ae2be62aed3a admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:37.585003 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76329c03-7286-46ed-a17b-ae2be62aed3a admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:37.585277 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76329c03-7286-46ed-a17b-ae2be62aed3a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:37.605554 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76329c03-7286-46ed-a17b-ae2be62aed3a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:37.607336 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76329c03-7286-46ed-a17b-ae2be62aed3a admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:37.627098 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: WARNING keystone.server.flask.application [None req-76329c03-7286-46ed-a17b-ae2be62aed3a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 25 02:23:37.628655 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 333/680] 10.222.0.117 () {56 vars in 1134 bytes} [Tue Jan 25 02:23:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:23:37.633968 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcf312e-c310-45f9-b4e4-b5ec0a66f292 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:37.648995 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcf312e-c310-45f9-b4e4-b5ec0a66f292 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:37.658269 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c977f1-3565-41dd-a518-5796d8f09eb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:37.658938 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c977f1-3565-41dd-a518-5796d8f09eb5 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:37.659220 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c977f1-3565-41dd-a518-5796d8f09eb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:37.659493 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c977f1-3565-41dd-a518-5796d8f09eb5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:37.660278 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c977f1-3565-41dd-a518-5796d8f09eb5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:37.660583 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c977f1-3565-41dd-a518-5796d8f09eb5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:37.662196 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c977f1-3565-41dd-a518-5796d8f09eb5 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:37.681105 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 348/681] 10.222.0.117 () {56 vars in 1135 bytes} [Tue Jan 25 02:23:37 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:37.689316 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76329c03-7286-46ed-a17b-ae2be62aed3a admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:37.702744 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76329c03-7286-46ed-a17b-ae2be62aed3a admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:37.712244 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33737c58-b859-4461-89e4-d77d26592876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:37.713060 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33737c58-b859-4461-89e4-d77d26592876 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:37.713352 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33737c58-b859-4461-89e4-d77d26592876 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:37.713612 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33737c58-b859-4461-89e4-d77d26592876 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:37.732915 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33737c58-b859-4461-89e4-d77d26592876 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:37.734948 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33737c58-b859-4461-89e4-d77d26592876 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:37.752737 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: WARNING keystone.server.flask.application [None req-33737c58-b859-4461-89e4-d77d26592876 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jan 25 02:23:37.753958 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 334/682] 10.222.0.117 () {56 vars in 1119 bytes} [Tue Jan 25 02:23:37 2022] GET /identity/v3/users/nova => generated 82 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 25 02:23:37.759676 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c977f1-3565-41dd-a518-5796d8f09eb5 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:37.772737 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c977f1-3565-41dd-a518-5796d8f09eb5 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:37.781822 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b973cf4-5438-4ba2-bc65-a980700ba62f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:37.782503 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b973cf4-5438-4ba2-bc65-a980700ba62f admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:37.782783 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b973cf4-5438-4ba2-bc65-a980700ba62f admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:37.783055 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b973cf4-5438-4ba2-bc65-a980700ba62f admin admin] PATH_INFO: `/v3/users` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:37.783946 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b973cf4-5438-4ba2-bc65-a980700ba62f admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:37.784253 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b973cf4-5438-4ba2-bc65-a980700ba62f admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:37.786114 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b973cf4-5438-4ba2-bc65-a980700ba62f admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:37.813839 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 349/683] 10.222.0.117 () {56 vars in 1159 bytes} [Tue Jan 25 02:23:37 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 370 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:37.819560 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33737c58-b859-4461-89e4-d77d26592876 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:37.833244 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33737c58-b859-4461-89e4-d77d26592876 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:37.838640 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c233f4a-f519-4a82-8bb8-5a1d9ffe4758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:37.839870 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c233f4a-f519-4a82-8bb8-5a1d9ffe4758 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:37.840149 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c233f4a-f519-4a82-8bb8-5a1d9ffe4758 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:37.840479 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c233f4a-f519-4a82-8bb8-5a1d9ffe4758 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:37.851764 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c233f4a-f519-4a82-8bb8-5a1d9ffe4758 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:37.853525 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c233f4a-f519-4a82-8bb8-5a1d9ffe4758 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:37.869722 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 335/684] 10.222.0.117 () {58 vars in 1329 bytes} [Tue Jan 25 02:23:37 2022] GET /identity/v3/auth/tokens => generated 915 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jan 25 02:23:37.875436 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b973cf4-5438-4ba2-bc65-a980700ba62f admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:37.889237 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b973cf4-5438-4ba2-bc65-a980700ba62f admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:37.897695 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37baa67f-236e-4d7d-8111-e5460e3bd408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:37.898487 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37baa67f-236e-4d7d-8111-e5460e3bd408 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:37.898769 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37baa67f-236e-4d7d-8111-e5460e3bd408 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:37.899043 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37baa67f-236e-4d7d-8111-e5460e3bd408 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:37.915404 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37baa67f-236e-4d7d-8111-e5460e3bd408 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:37.917342 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37baa67f-236e-4d7d-8111-e5460e3bd408 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:37.938022 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: WARNING keystone.server.flask.application [None req-37baa67f-236e-4d7d-8111-e5460e3bd408 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 25 02:23:37.939508 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 350/685] 10.222.0.117 () {56 vars in 1134 bytes} [Tue Jan 25 02:23:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:23:37.945319 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c233f4a-f519-4a82-8bb8-5a1d9ffe4758 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:37.961314 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c233f4a-f519-4a82-8bb8-5a1d9ffe4758 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:37.970236 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f7e04c-b4ae-499c-9b0f-29c171e0ae31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:37.970920 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f7e04c-b4ae-499c-9b0f-29c171e0ae31 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:37.971200 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f7e04c-b4ae-499c-9b0f-29c171e0ae31 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:37.971476 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f7e04c-b4ae-499c-9b0f-29c171e0ae31 admin admin] PATH_INFO: `/v3/domains` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:37.972329 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f7e04c-b4ae-499c-9b0f-29c171e0ae31 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:37.972634 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f7e04c-b4ae-499c-9b0f-29c171e0ae31 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:37.974267 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f7e04c-b4ae-499c-9b0f-29c171e0ae31 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:37.992258 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 336/686] 10.222.0.117 () {56 vars in 1135 bytes} [Tue Jan 25 02:23:37 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:37.997671 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37baa67f-236e-4d7d-8111-e5460e3bd408 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:38.008898 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37baa67f-236e-4d7d-8111-e5460e3bd408 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:38.018571 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f81d4f-223c-4e03-9945-bc541bddb1f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:38.019402 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f81d4f-223c-4e03-9945-bc541bddb1f3 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:38.019683 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f81d4f-223c-4e03-9945-bc541bddb1f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:38.019986 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f81d4f-223c-4e03-9945-bc541bddb1f3 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:38.033245 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f81d4f-223c-4e03-9945-bc541bddb1f3 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:38.035286 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f81d4f-223c-4e03-9945-bc541bddb1f3 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:38.055456 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: WARNING keystone.server.flask.application [None req-55f81d4f-223c-4e03-9945-bc541bddb1f3 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 25 02:23:38.056707 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 351/687] 10.222.0.117 () {56 vars in 1137 bytes} [Tue Jan 25 02:23:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:23:38.063178 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f7e04c-b4ae-499c-9b0f-29c171e0ae31 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:38.079654 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f7e04c-b4ae-499c-9b0f-29c171e0ae31 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:38.089865 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4a5162-d7d9-4a42-ae35-b163d68004e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:38.090686 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4a5162-d7d9-4a42-ae35-b163d68004e0 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:38.090967 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4a5162-d7d9-4a42-ae35-b163d68004e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:38.091238 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4a5162-d7d9-4a42-ae35-b163d68004e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:38.092076 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4a5162-d7d9-4a42-ae35-b163d68004e0 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:38.092385 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4a5162-d7d9-4a42-ae35-b163d68004e0 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:38.094237 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4a5162-d7d9-4a42-ae35-b163d68004e0 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:38.112369 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 337/688] 10.222.0.117 () {56 vars in 1174 bytes} [Tue Jan 25 02:23:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 02:23:38.117892 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f81d4f-223c-4e03-9945-bc541bddb1f3 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:38.134162 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f81d4f-223c-4e03-9945-bc541bddb1f3 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:38.148357 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4ac90d-d036-4c8c-88dd-5196e5608e90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:38.149020 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4ac90d-d036-4c8c-88dd-5196e5608e90 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:38.149304 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4ac90d-d036-4c8c-88dd-5196e5608e90 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:38.149580 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4ac90d-d036-4c8c-88dd-5196e5608e90 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:38.150437 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4ac90d-d036-4c8c-88dd-5196e5608e90 admin admin] RBAC: Adding query filter params (role.id=d8dbc6d83d9d41d28c3feb8b3485b291, scope.project.id=61a6fe9d4c914755bb0a64c392bd16aa, user.id=d9ad6269900346458050063c12cac299) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:38.150743 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4ac90d-d036-4c8c-88dd-5196e5608e90 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:38.153205 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4ac90d-d036-4c8c-88dd-5196e5608e90 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:38.159719 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 352/689] 10.222.0.117 () {56 vars in 1400 bytes} [Tue Jan 25 02:23:38 2022] GET /identity/v3/role_assignments?user.id=d9ad6269900346458050063c12cac299&scope.project.id=61a6fe9d4c914755bb0a64c392bd16aa&role.id=d8dbc6d83d9d41d28c3feb8b3485b291 => generated 260 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:38.226956 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841d2901-2c11-41d3-834c-ac7b2e92aa67 None None] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:38.227350 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841d2901-2c11-41d3-834c-ac7b2e92aa67 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:38.227768 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841d2901-2c11-41d3-834c-ac7b2e92aa67 None None] PATH_INFO: `/` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:38.230709 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 338/690] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:23:38 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:23:38.236759 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0da7b7e-2d16-404b-8f02-1baf784e83a1 None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:38.237060 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0da7b7e-2d16-404b-8f02-1baf784e83a1 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:38.237306 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0da7b7e-2d16-404b-8f02-1baf784e83a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:38.264890 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-c0da7b7e-2d16-404b-8f02-1baf784e83a1 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:23:38.266133 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-c0da7b7e-2d16-404b-8f02-1baf784e83a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:23:38.274470 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 353/691] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:23:38 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 25 02:23:38.305482 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841d2901-2c11-41d3-834c-ac7b2e92aa67 None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:38.329954 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841d2901-2c11-41d3-834c-ac7b2e92aa67 None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:38.338291 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1686cc88-1c61-4320-83f0-89b3316aa853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:38.340131 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1686cc88-1c61-4320-83f0-89b3316aa853 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:38.340531 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1686cc88-1c61-4320-83f0-89b3316aa853 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:38.340913 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1686cc88-1c61-4320-83f0-89b3316aa853 admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:38.341966 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1686cc88-1c61-4320-83f0-89b3316aa853 admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:38.343660 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: WARNING py.warnings [None req-1686cc88-1c61-4320-83f0-89b3316aa853 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_service": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 25 02:23:38.343660 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: warnings.warn(msg) Jan 25 02:23:38.343660 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: Jan 25 02:23:38.345402 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1686cc88-1c61-4320-83f0-89b3316aa853 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:38.361754 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e75bfd9-2086-41ea-b8ac-df114f7bf503 None None] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:38.362363 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e75bfd9-2086-41ea-b8ac-df114f7bf503 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:38.362363 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e75bfd9-2086-41ea-b8ac-df114f7bf503 None None] PATH_INFO: `/` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:38.363544 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: WARNING keystone.server.flask.application [None req-1686cc88-1c61-4320-83f0-89b3316aa853 admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jan 25 02:23:38.364063 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 354/692] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:23:38 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jan 25 02:23:38.365480 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 339/693] 10.222.0.117 () {56 vars in 1155 bytes} [Tue Jan 25 02:23:38 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:23:38.369192 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e2223f-2520-4f83-b849-42a1ca9b1365 None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:38.369474 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e2223f-2520-4f83-b849-42a1ca9b1365 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:38.369748 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e2223f-2520-4f83-b849-42a1ca9b1365 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:38.371735 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1686cc88-1c61-4320-83f0-89b3316aa853 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:38.385772 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1686cc88-1c61-4320-83f0-89b3316aa853 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:38.393110 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-74e2223f-2520-4f83-b849-42a1ca9b1365 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:23:38.394552 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-74e2223f-2520-4f83-b849-42a1ca9b1365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:23:38.395587 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cc3884-40b6-4873-a3a6-9e0fa0daba96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:38.396277 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cc3884-40b6-4873-a3a6-9e0fa0daba96 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:38.396557 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cc3884-40b6-4873-a3a6-9e0fa0daba96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:38.396837 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cc3884-40b6-4873-a3a6-9e0fa0daba96 admin admin] PATH_INFO: `/v3/services` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:38.397564 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cc3884-40b6-4873-a3a6-9e0fa0daba96 admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:38.397869 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cc3884-40b6-4873-a3a6-9e0fa0daba96 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:38.398894 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: WARNING py.warnings [None req-81cc3884-40b6-4873-a3a6-9e0fa0daba96 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_services": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 25 02:23:38.398894 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: warnings.warn(msg) Jan 25 02:23:38.398894 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: Jan 25 02:23:38.399810 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cc3884-40b6-4873-a3a6-9e0fa0daba96 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:38.404391 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 355/694] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:23:38 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 25 02:23:38.411175 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 340/695] 10.222.0.117 () {56 vars in 1150 bytes} [Tue Jan 25 02:23:38 2022] GET /identity/v3/services?name=block-storage => generated 131 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 02:23:38.416601 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e2223f-2520-4f83-b849-42a1ca9b1365 None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:38.433193 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e2223f-2520-4f83-b849-42a1ca9b1365 None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:38.440556 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1932d4a2-0fbc-4c33-9f80-0510d35b67da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:38.441314 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1932d4a2-0fbc-4c33-9f80-0510d35b67da admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:38.441592 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1932d4a2-0fbc-4c33-9f80-0510d35b67da admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:38.441863 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1932d4a2-0fbc-4c33-9f80-0510d35b67da admin admin] PATH_INFO: `/v3/services` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:38.442638 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1932d4a2-0fbc-4c33-9f80-0510d35b67da admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:38.442939 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1932d4a2-0fbc-4c33-9f80-0510d35b67da admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:38.444093 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: WARNING py.warnings [None req-1932d4a2-0fbc-4c33-9f80-0510d35b67da admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_services": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 25 02:23:38.444093 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: warnings.warn(msg) Jan 25 02:23:38.444093 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: Jan 25 02:23:38.444968 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1932d4a2-0fbc-4c33-9f80-0510d35b67da admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:38.453007 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cc3884-40b6-4873-a3a6-9e0fa0daba96 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:38.457430 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 356/696] 10.222.0.117 () {56 vars in 1150 bytes} [Tue Jan 25 02:23:38 2022] GET /identity/v3/services?type=block-storage => generated 131 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:38.474220 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cc3884-40b6-4873-a3a6-9e0fa0daba96 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:38.482503 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e846cc-fab8-4ef0-82b4-aa7230110862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:38.483319 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e846cc-fab8-4ef0-82b4-aa7230110862 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:38.483601 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e846cc-fab8-4ef0-82b4-aa7230110862 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:38.483904 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e846cc-fab8-4ef0-82b4-aa7230110862 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:38.501753 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e846cc-fab8-4ef0-82b4-aa7230110862 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:38.503674 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e846cc-fab8-4ef0-82b4-aa7230110862 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:38.527602 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: WARNING keystone.server.flask.application [None req-f0e846cc-fab8-4ef0-82b4-aa7230110862 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 25 02:23:38.529111 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 341/697] 10.222.0.117 () {56 vars in 1134 bytes} [Tue Jan 25 02:23:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 25 02:23:38.535127 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1932d4a2-0fbc-4c33-9f80-0510d35b67da admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:38.550071 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1932d4a2-0fbc-4c33-9f80-0510d35b67da admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:38.565599 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a56a52-9699-4048-aaa0-78f6f5b92411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:38.566282 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a56a52-9699-4048-aaa0-78f6f5b92411 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:38.566558 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a56a52-9699-4048-aaa0-78f6f5b92411 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:38.566830 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a56a52-9699-4048-aaa0-78f6f5b92411 admin admin] PATH_INFO: `/v3/domains` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:38.567579 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a56a52-9699-4048-aaa0-78f6f5b92411 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:38.567907 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a56a52-9699-4048-aaa0-78f6f5b92411 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:38.569529 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a56a52-9699-4048-aaa0-78f6f5b92411 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:38.592676 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 357/698] 10.222.0.117 () {56 vars in 1135 bytes} [Tue Jan 25 02:23:38 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 02:23:38.597670 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e846cc-fab8-4ef0-82b4-aa7230110862 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:38.610966 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e846cc-fab8-4ef0-82b4-aa7230110862 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:38.620048 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9ee4e1-8a9e-4b4d-897d-7ba35db304e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:38.620795 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9ee4e1-8a9e-4b4d-897d-7ba35db304e8 admin admin] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:38.621118 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9ee4e1-8a9e-4b4d-897d-7ba35db304e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:38.621343 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9ee4e1-8a9e-4b4d-897d-7ba35db304e8 admin admin] PATH_INFO: `/v3/users` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:38.622149 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9ee4e1-8a9e-4b4d-897d-7ba35db304e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:38.624203 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9ee4e1-8a9e-4b4d-897d-7ba35db304e8 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:38.658957 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 342/699] 10.222.0.117 () {60 vars in 1158 bytes} [Tue Jan 25 02:23:38 2022] POST /identity/v3/users => generated 255 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 25 02:23:39.261351 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbf88bd-8d3e-4272-81ce-d6dab4934ee8 None None] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:39.261775 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbf88bd-8d3e-4272-81ce-d6dab4934ee8 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:39.262126 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbf88bd-8d3e-4272-81ce-d6dab4934ee8 None None] PATH_INFO: `/` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:39.265133 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 358/700] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:23:39 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:23:39.270819 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49c5dce-ebec-4093-b122-abc33a873f3a None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:39.271221 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49c5dce-ebec-4093-b122-abc33a873f3a None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:39.271611 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49c5dce-ebec-4093-b122-abc33a873f3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:39.302792 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-c49c5dce-ebec-4093-b122-abc33a873f3a None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:23:39.304469 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-c49c5dce-ebec-4093-b122-abc33a873f3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:23:39.317613 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 343/701] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:23:39 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 25 02:23:39.370522 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbf88bd-8d3e-4272-81ce-d6dab4934ee8 None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:39.386231 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbf88bd-8d3e-4272-81ce-d6dab4934ee8 None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:39.394951 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8427ed7d-d336-48dd-8c2c-f6fbbbda1226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:39.395773 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8427ed7d-d336-48dd-8c2c-f6fbbbda1226 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:39.396061 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8427ed7d-d336-48dd-8c2c-f6fbbbda1226 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:39.396338 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8427ed7d-d336-48dd-8c2c-f6fbbbda1226 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:39.416640 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8427ed7d-d336-48dd-8c2c-f6fbbbda1226 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 25 02:23:39.424075 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: WARNING keystone.server.flask.application [None req-8427ed7d-d336-48dd-8c2c-f6fbbbda1226 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 25 02:23:39.426313 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 359/702] 10.222.0.117 () {56 vars in 1128 bytes} [Tue Jan 25 02:23:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:23:39.431797 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49c5dce-ebec-4093-b122-abc33a873f3a None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:39.444969 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49c5dce-ebec-4093-b122-abc33a873f3a None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:39.460919 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ee21d8-1c5c-49db-979f-5f71c91b09a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:39.461599 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ee21d8-1c5c-49db-979f-5f71c91b09a8 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:39.461883 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ee21d8-1c5c-49db-979f-5f71c91b09a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:39.462156 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ee21d8-1c5c-49db-979f-5f71c91b09a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:39.462924 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ee21d8-1c5c-49db-979f-5f71c91b09a8 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:39.463228 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ee21d8-1c5c-49db-979f-5f71c91b09a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:39.465511 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ee21d8-1c5c-49db-979f-5f71c91b09a8 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:39.482963 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 344/703] 10.222.0.117 () {56 vars in 1129 bytes} [Tue Jan 25 02:23:39 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:39.488694 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8427ed7d-d336-48dd-8c2c-f6fbbbda1226 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:39.505148 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8427ed7d-d336-48dd-8c2c-f6fbbbda1226 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:39.513338 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b6e571-a15a-4eca-917a-25f5f2ea0f7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:39.514408 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b6e571-a15a-4eca-917a-25f5f2ea0f7b admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:39.514802 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b6e571-a15a-4eca-917a-25f5f2ea0f7b admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:39.515190 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b6e571-a15a-4eca-917a-25f5f2ea0f7b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:39.535513 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b6e571-a15a-4eca-917a-25f5f2ea0f7b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:39.542925 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b6e571-a15a-4eca-917a-25f5f2ea0f7b admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:39.569392 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: WARNING keystone.server.flask.application [None req-f7b6e571-a15a-4eca-917a-25f5f2ea0f7b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 25 02:23:39.571532 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 360/704] 10.222.0.117 () {56 vars in 1134 bytes} [Tue Jan 25 02:23:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 83 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:23:39.578148 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ee21d8-1c5c-49db-979f-5f71c91b09a8 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:39.596341 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ee21d8-1c5c-49db-979f-5f71c91b09a8 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:39.604976 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc47a7f-865e-4239-9863-eeef20a46a7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:39.605884 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc47a7f-865e-4239-9863-eeef20a46a7b admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:39.606277 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc47a7f-865e-4239-9863-eeef20a46a7b admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:39.606658 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc47a7f-865e-4239-9863-eeef20a46a7b admin admin] PATH_INFO: `/v3/domains` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:39.607724 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc47a7f-865e-4239-9863-eeef20a46a7b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:39.608167 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc47a7f-865e-4239-9863-eeef20a46a7b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:39.610496 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc47a7f-865e-4239-9863-eeef20a46a7b admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:39.636647 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 345/705] 10.222.0.117 () {56 vars in 1135 bytes} [Tue Jan 25 02:23:39 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:39.643149 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b6e571-a15a-4eca-917a-25f5f2ea0f7b admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:39.654949 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b6e571-a15a-4eca-917a-25f5f2ea0f7b admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:39.664307 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec8c9b3-f26d-4a6a-b7d4-698a40b69ec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:39.665132 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec8c9b3-f26d-4a6a-b7d4-698a40b69ec5 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:39.665417 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec8c9b3-f26d-4a6a-b7d4-698a40b69ec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:39.665693 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec8c9b3-f26d-4a6a-b7d4-698a40b69ec5 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:39.683602 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec8c9b3-f26d-4a6a-b7d4-698a40b69ec5 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:39.686677 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec8c9b3-f26d-4a6a-b7d4-698a40b69ec5 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:39.712900 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: WARNING keystone.server.flask.application [None req-9ec8c9b3-f26d-4a6a-b7d4-698a40b69ec5 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jan 25 02:23:39.715966 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 361/706] 10.222.0.117 () {56 vars in 1122 bytes} [Tue Jan 25 02:23:39 2022] GET /identity/v3/users/swift => generated 83 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:23:39.721530 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc47a7f-865e-4239-9863-eeef20a46a7b admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:39.736803 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc47a7f-865e-4239-9863-eeef20a46a7b admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:39.745470 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa77ada0-82a1-4f2f-b3bc-bf0078bac9fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:39.746164 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa77ada0-82a1-4f2f-b3bc-bf0078bac9fd admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:39.746510 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa77ada0-82a1-4f2f-b3bc-bf0078bac9fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:39.746827 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa77ada0-82a1-4f2f-b3bc-bf0078bac9fd admin admin] PATH_INFO: `/v3/users` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:39.747791 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa77ada0-82a1-4f2f-b3bc-bf0078bac9fd admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:39.748262 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa77ada0-82a1-4f2f-b3bc-bf0078bac9fd admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:39.751270 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa77ada0-82a1-4f2f-b3bc-bf0078bac9fd admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:39.782278 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 346/707] 10.222.0.117 () {56 vars in 1161 bytes} [Tue Jan 25 02:23:39 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 372 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:39.787978 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec8c9b3-f26d-4a6a-b7d4-698a40b69ec5 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:39.799071 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec8c9b3-f26d-4a6a-b7d4-698a40b69ec5 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:39.808565 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d08c2ee-a89e-45e1-800d-ad9815c5a259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:39.809359 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d08c2ee-a89e-45e1-800d-ad9815c5a259 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:39.809647 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d08c2ee-a89e-45e1-800d-ad9815c5a259 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:39.809928 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d08c2ee-a89e-45e1-800d-ad9815c5a259 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:39.821937 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d08c2ee-a89e-45e1-800d-ad9815c5a259 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:39.824346 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d08c2ee-a89e-45e1-800d-ad9815c5a259 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:39.833921 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 362/708] 10.222.0.117 () {58 vars in 1329 bytes} [Tue Jan 25 02:23:39 2022] GET /identity/v3/auth/tokens => generated 915 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 25 02:23:39.840966 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa77ada0-82a1-4f2f-b3bc-bf0078bac9fd admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:39.862945 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa77ada0-82a1-4f2f-b3bc-bf0078bac9fd admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:39.876588 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d44a6fb-0b1f-4891-830c-3c617796fb4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:39.877717 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d44a6fb-0b1f-4891-830c-3c617796fb4a admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:39.878112 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d44a6fb-0b1f-4891-830c-3c617796fb4a admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:39.878497 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d44a6fb-0b1f-4891-830c-3c617796fb4a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:39.896764 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d44a6fb-0b1f-4891-830c-3c617796fb4a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:39.898636 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d44a6fb-0b1f-4891-830c-3c617796fb4a admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:39.921260 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: WARNING keystone.server.flask.application [None req-7d44a6fb-0b1f-4891-830c-3c617796fb4a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 25 02:23:39.922494 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 347/709] 10.222.0.117 () {56 vars in 1134 bytes} [Tue Jan 25 02:23:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 82 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:23:39.928100 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d08c2ee-a89e-45e1-800d-ad9815c5a259 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:39.940640 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d08c2ee-a89e-45e1-800d-ad9815c5a259 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:39.953201 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351366f8-a47c-4c6c-af35-b1eaf9ba75a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:39.953857 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351366f8-a47c-4c6c-af35-b1eaf9ba75a2 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:39.954143 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351366f8-a47c-4c6c-af35-b1eaf9ba75a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:39.954420 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351366f8-a47c-4c6c-af35-b1eaf9ba75a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:39.955166 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351366f8-a47c-4c6c-af35-b1eaf9ba75a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:39.955473 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351366f8-a47c-4c6c-af35-b1eaf9ba75a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:39.957115 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351366f8-a47c-4c6c-af35-b1eaf9ba75a2 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:39.981474 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 363/710] 10.222.0.117 () {56 vars in 1135 bytes} [Tue Jan 25 02:23:39 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:39.987106 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d44a6fb-0b1f-4891-830c-3c617796fb4a admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:40.000602 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d44a6fb-0b1f-4891-830c-3c617796fb4a admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:40.007856 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0318b628-32a1-4ee3-8ee6-de39b916a941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:40.008644 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0318b628-32a1-4ee3-8ee6-de39b916a941 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:40.008925 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0318b628-32a1-4ee3-8ee6-de39b916a941 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:40.009202 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0318b628-32a1-4ee3-8ee6-de39b916a941 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:40.028982 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0318b628-32a1-4ee3-8ee6-de39b916a941 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:40.030981 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0318b628-32a1-4ee3-8ee6-de39b916a941 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:40.048598 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: WARNING keystone.server.flask.application [None req-0318b628-32a1-4ee3-8ee6-de39b916a941 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 25 02:23:40.050049 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 348/711] 10.222.0.117 () {56 vars in 1137 bytes} [Tue Jan 25 02:23:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:23:40.055537 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351366f8-a47c-4c6c-af35-b1eaf9ba75a2 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:40.068879 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351366f8-a47c-4c6c-af35-b1eaf9ba75a2 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:40.084352 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ca10be-1340-4ac9-86ea-5947a3409f16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:40.085027 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ca10be-1340-4ac9-86ea-5947a3409f16 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:40.085317 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ca10be-1340-4ac9-86ea-5947a3409f16 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:40.085597 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ca10be-1340-4ac9-86ea-5947a3409f16 admin admin] PATH_INFO: `/v3/projects` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:40.086414 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ca10be-1340-4ac9-86ea-5947a3409f16 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:40.086721 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ca10be-1340-4ac9-86ea-5947a3409f16 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:40.089153 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ca10be-1340-4ac9-86ea-5947a3409f16 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:40.102336 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be103040-6498-40ef-a2d9-171f6c8edc01 None None] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:40.102787 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be103040-6498-40ef-a2d9-171f6c8edc01 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:40.103199 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be103040-6498-40ef-a2d9-171f6c8edc01 None None] PATH_INFO: `/` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:40.105780 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 349/713] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:23:40 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:23:40.106008 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 364/713] 10.222.0.117 () {56 vars in 1174 bytes} [Tue Jan 25 02:23:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:40.111027 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098d78b6-913c-4a11-bbc9-439707087415 None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:40.111338 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098d78b6-913c-4a11-bbc9-439707087415 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:40.111613 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098d78b6-913c-4a11-bbc9-439707087415 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:40.111801 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ca10be-1340-4ac9-86ea-5947a3409f16 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:40.125194 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ca10be-1340-4ac9-86ea-5947a3409f16 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:40.140193 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1221c378-51d5-4a23-ad28-df4fad036b41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:40.141175 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1221c378-51d5-4a23-ad28-df4fad036b41 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:40.141652 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1221c378-51d5-4a23-ad28-df4fad036b41 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:40.143006 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-098d78b6-913c-4a11-bbc9-439707087415 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:23:40.143496 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1221c378-51d5-4a23-ad28-df4fad036b41 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:40.144626 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1221c378-51d5-4a23-ad28-df4fad036b41 admin admin] RBAC: Adding query filter params (role.id=8e4691cb5a4b4439b9712d27ef133c20, scope.project.id=61a6fe9d4c914755bb0a64c392bd16aa, user.id=100f12ee56754f1c859106bf3e473df6) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:40.145889 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1221c378-51d5-4a23-ad28-df4fad036b41 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:40.147997 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1221c378-51d5-4a23-ad28-df4fad036b41 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:40.148527 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-098d78b6-913c-4a11-bbc9-439707087415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:23:40.159415 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 365/714] 10.222.0.117 () {56 vars in 1400 bytes} [Tue Jan 25 02:23:40 2022] GET /identity/v3/role_assignments?user.id=100f12ee56754f1c859106bf3e473df6&scope.project.id=61a6fe9d4c914755bb0a64c392bd16aa&role.id=8e4691cb5a4b4439b9712d27ef133c20 => generated 610 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 02:23:40.165829 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 350/715] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:23:40 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 25 02:23:40.194774 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1221c378-51d5-4a23-ad28-df4fad036b41 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:40.207346 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1221c378-51d5-4a23-ad28-df4fad036b41 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:40.215030 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a52ce6-c8a0-4d46-ad98-effe0d223413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:40.216372 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a52ce6-c8a0-4d46-ad98-effe0d223413 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:40.216819 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a52ce6-c8a0-4d46-ad98-effe0d223413 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:40.217320 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a52ce6-c8a0-4d46-ad98-effe0d223413 admin admin] PATH_INFO: `/v3/services/network` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:40.218383 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a52ce6-c8a0-4d46-ad98-effe0d223413 admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:40.219487 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: WARNING py.warnings [None req-00a52ce6-c8a0-4d46-ad98-effe0d223413 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_service": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 25 02:23:40.219487 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: warnings.warn(msg) Jan 25 02:23:40.219487 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: Jan 25 02:23:40.220698 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a52ce6-c8a0-4d46-ad98-effe0d223413 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:40.240561 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: WARNING keystone.server.flask.application [None req-00a52ce6-c8a0-4d46-ad98-effe0d223413 admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jan 25 02:23:40.241897 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 366/716] 10.222.0.117 () {56 vars in 1137 bytes} [Tue Jan 25 02:23:40 2022] GET /identity/v3/services/network => generated 88 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:23:40.249935 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098d78b6-913c-4a11-bbc9-439707087415 None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:40.270911 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098d78b6-913c-4a11-bbc9-439707087415 None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:40.280207 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6d46cd-2fe6-494e-9f71-2f352677a12b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:40.280895 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6d46cd-2fe6-494e-9f71-2f352677a12b admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:40.281216 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6d46cd-2fe6-494e-9f71-2f352677a12b admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:40.281490 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6d46cd-2fe6-494e-9f71-2f352677a12b admin admin] PATH_INFO: `/v3/services` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:40.282226 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6d46cd-2fe6-494e-9f71-2f352677a12b admin admin] RBAC: Adding query filter params (name=network) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:40.282526 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6d46cd-2fe6-494e-9f71-2f352677a12b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:40.284339 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6d46cd-2fe6-494e-9f71-2f352677a12b admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:40.297451 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 351/717] 10.222.0.117 () {56 vars in 1138 bytes} [Tue Jan 25 02:23:40 2022] GET /identity/v3/services?name=network => generated 125 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:40.321726 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a52ce6-c8a0-4d46-ad98-effe0d223413 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:40.335906 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a52ce6-c8a0-4d46-ad98-effe0d223413 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:40.344212 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104c447c-7588-4b54-8a3b-d1ef4496a564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:40.345510 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104c447c-7588-4b54-8a3b-d1ef4496a564 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:40.345987 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104c447c-7588-4b54-8a3b-d1ef4496a564 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:40.346480 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104c447c-7588-4b54-8a3b-d1ef4496a564 admin admin] PATH_INFO: `/v3/services` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:40.347424 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104c447c-7588-4b54-8a3b-d1ef4496a564 admin admin] RBAC: Adding query filter params (type=network) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:40.347958 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104c447c-7588-4b54-8a3b-d1ef4496a564 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:40.349799 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104c447c-7588-4b54-8a3b-d1ef4496a564 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:40.359911 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 367/718] 10.222.0.117 () {56 vars in 1138 bytes} [Tue Jan 25 02:23:40 2022] GET /identity/v3/services?type=network => generated 125 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:41.088452 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ff6679-04ed-439e-982d-138b42538fbf None None] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:41.090131 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ff6679-04ed-439e-982d-138b42538fbf None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:41.090720 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ff6679-04ed-439e-982d-138b42538fbf None None] PATH_INFO: `/` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:41.093237 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 352/719] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:23:41 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:23:41.099865 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b88dd9d-e676-4bca-a367-22cf47636435 None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:41.100819 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b88dd9d-e676-4bca-a367-22cf47636435 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:41.101314 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b88dd9d-e676-4bca-a367-22cf47636435 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:41.124686 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-2b88dd9d-e676-4bca-a367-22cf47636435 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:23:41.126253 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-2b88dd9d-e676-4bca-a367-22cf47636435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:23:41.138873 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 368/720] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:23:41 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 25 02:23:41.163086 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ff6679-04ed-439e-982d-138b42538fbf None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:41.180788 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ff6679-04ed-439e-982d-138b42538fbf None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:41.189225 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad2c104-c963-449c-a9c5-d994c9a73561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:41.190318 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad2c104-c963-449c-a9c5-d994c9a73561 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:41.190826 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad2c104-c963-449c-a9c5-d994c9a73561 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:41.191439 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad2c104-c963-449c-a9c5-d994c9a73561 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:41.208019 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad2c104-c963-449c-a9c5-d994c9a73561 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 25 02:23:41.216121 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: WARNING keystone.server.flask.application [None req-5ad2c104-c963-449c-a9c5-d994c9a73561 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 25 02:23:41.217567 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 353/721] 10.222.0.117 () {56 vars in 1122 bytes} [Tue Jan 25 02:23:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:23:41.223722 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b88dd9d-e676-4bca-a367-22cf47636435 None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:41.236771 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b88dd9d-e676-4bca-a367-22cf47636435 None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:41.244322 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da02b07-33ba-453c-b73d-d38b980aa9b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:41.245852 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da02b07-33ba-453c-b73d-d38b980aa9b5 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:41.246515 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da02b07-33ba-453c-b73d-d38b980aa9b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:41.247000 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da02b07-33ba-453c-b73d-d38b980aa9b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:41.248023 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da02b07-33ba-453c-b73d-d38b980aa9b5 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:41.248544 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da02b07-33ba-453c-b73d-d38b980aa9b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:41.250366 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da02b07-33ba-453c-b73d-d38b980aa9b5 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:41.264442 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 369/722] 10.222.0.117 () {56 vars in 1125 bytes} [Tue Jan 25 02:23:41 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:41.265736 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebee60c-2d49-45e3-a6a2-37ba562090e6 None None] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:41.266140 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebee60c-2d49-45e3-a6a2-37ba562090e6 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:41.266528 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebee60c-2d49-45e3-a6a2-37ba562090e6 None None] PATH_INFO: `/` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:41.269888 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 354/723] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:23:41 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:23:41.270302 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da02b07-33ba-453c-b73d-d38b980aa9b5 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:41.277319 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702c4223-cad9-4094-aa53-267ed849e029 None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:41.277790 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702c4223-cad9-4094-aa53-267ed849e029 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:41.278204 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702c4223-cad9-4094-aa53-267ed849e029 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:41.283596 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da02b07-33ba-453c-b73d-d38b980aa9b5 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:41.291497 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd704be-fd64-4ddd-9370-284526eaa037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:41.292687 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd704be-fd64-4ddd-9370-284526eaa037 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:41.293209 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd704be-fd64-4ddd-9370-284526eaa037 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:41.293690 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd704be-fd64-4ddd-9370-284526eaa037 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:41.310863 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-702c4223-cad9-4094-aa53-267ed849e029 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:23:41.312512 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-702c4223-cad9-4094-aa53-267ed849e029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:23:41.324116 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd704be-fd64-4ddd-9370-284526eaa037 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:41.330350 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd704be-fd64-4ddd-9370-284526eaa037 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:41.335845 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 355/724] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:23:41 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 25 02:23:41.365863 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: WARNING keystone.server.flask.application [None req-3dd704be-fd64-4ddd-9370-284526eaa037 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 25 02:23:41.367871 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 370/725] 10.222.0.117 () {56 vars in 1134 bytes} [Tue Jan 25 02:23:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 98 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 25 02:23:41.374133 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702c4223-cad9-4094-aa53-267ed849e029 None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:41.391964 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702c4223-cad9-4094-aa53-267ed849e029 None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:41.398500 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca89cd9-f112-4e85-b477-78d5159b8f1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:41.399184 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca89cd9-f112-4e85-b477-78d5159b8f1d admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:41.399467 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca89cd9-f112-4e85-b477-78d5159b8f1d admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:41.399773 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca89cd9-f112-4e85-b477-78d5159b8f1d admin admin] PATH_INFO: `/v3/domains` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:41.400529 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca89cd9-f112-4e85-b477-78d5159b8f1d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:41.400834 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca89cd9-f112-4e85-b477-78d5159b8f1d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:41.403172 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca89cd9-f112-4e85-b477-78d5159b8f1d admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:41.426016 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 356/726] 10.222.0.117 () {56 vars in 1135 bytes} [Tue Jan 25 02:23:41 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:41.429264 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd704be-fd64-4ddd-9370-284526eaa037 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:41.438847 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca89cd9-f112-4e85-b477-78d5159b8f1d admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:41.448460 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd704be-fd64-4ddd-9370-284526eaa037 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:41.459750 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a43fb4-e001-4fc1-9f14-ebe879b70536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:41.461995 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a43fb4-e001-4fc1-9f14-ebe879b70536 admin admin] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:41.462414 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a43fb4-e001-4fc1-9f14-ebe879b70536 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:41.464372 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a43fb4-e001-4fc1-9f14-ebe879b70536 admin admin] PATH_INFO: `/v3/services` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:41.466427 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca89cd9-f112-4e85-b477-78d5159b8f1d admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:41.467508 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a43fb4-e001-4fc1-9f14-ebe879b70536 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:41.469246 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: WARNING py.warnings [None req-d2a43fb4-e001-4fc1-9f14-ebe879b70536 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 25 02:23:41.469246 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: warnings.warn(msg) Jan 25 02:23:41.469246 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: Jan 25 02:23:41.471955 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a43fb4-e001-4fc1-9f14-ebe879b70536 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:41.481541 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4153bd3b-54e4-4d9d-afa9-da6e59638020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:41.484235 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4153bd3b-54e4-4d9d-afa9-da6e59638020 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:41.484435 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4153bd3b-54e4-4d9d-afa9-da6e59638020 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:41.484809 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4153bd3b-54e4-4d9d-afa9-da6e59638020 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:41.508864 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 371/727] 10.222.0.117 () {60 vars in 1167 bytes} [Tue Jan 25 02:23:41 2022] POST /identity/v3/services => generated 252 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 02:23:41.514707 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4153bd3b-54e4-4d9d-afa9-da6e59638020 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:41.518067 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4153bd3b-54e4-4d9d-afa9-da6e59638020 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:41.555934 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: WARNING keystone.server.flask.application [None req-4153bd3b-54e4-4d9d-afa9-da6e59638020 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jan 25 02:23:41.558689 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 357/728] 10.222.0.117 () {56 vars in 1119 bytes} [Tue Jan 25 02:23:41 2022] GET /identity/v3/users/nova => generated 82 bytes in 122 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:23:41.564569 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a43fb4-e001-4fc1-9f14-ebe879b70536 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:41.631623 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a43fb4-e001-4fc1-9f14-ebe879b70536 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:41.660076 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515aa8a4-15ea-4e49-a049-a82756a59b87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:41.661027 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515aa8a4-15ea-4e49-a049-a82756a59b87 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:41.661424 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515aa8a4-15ea-4e49-a049-a82756a59b87 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:41.661804 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515aa8a4-15ea-4e49-a049-a82756a59b87 admin admin] PATH_INFO: `/v3/users` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:41.663049 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515aa8a4-15ea-4e49-a049-a82756a59b87 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:41.663485 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515aa8a4-15ea-4e49-a049-a82756a59b87 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:41.666345 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515aa8a4-15ea-4e49-a049-a82756a59b87 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:41.721676 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 372/729] 10.222.0.117 () {56 vars in 1159 bytes} [Tue Jan 25 02:23:41 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 370 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:41.727551 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4153bd3b-54e4-4d9d-afa9-da6e59638020 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:41.752699 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4153bd3b-54e4-4d9d-afa9-da6e59638020 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:41.765600 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc50e30-ea91-42e8-98be-61b02572d3d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:41.766818 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc50e30-ea91-42e8-98be-61b02572d3d2 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:41.767277 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc50e30-ea91-42e8-98be-61b02572d3d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:41.767664 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc50e30-ea91-42e8-98be-61b02572d3d2 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:41.788353 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc50e30-ea91-42e8-98be-61b02572d3d2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:41.790212 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc50e30-ea91-42e8-98be-61b02572d3d2 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:41.822724 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: WARNING keystone.server.flask.application [None req-4fc50e30-ea91-42e8-98be-61b02572d3d2 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 25 02:23:41.832226 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 358/730] 10.222.0.117 () {56 vars in 1134 bytes} [Tue Jan 25 02:23:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 105 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:23:41.834471 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515aa8a4-15ea-4e49-a049-a82756a59b87 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:41.837488 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6db783b-92aa-4355-b0b1-11179a33fbe0 None None] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:41.837769 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6db783b-92aa-4355-b0b1-11179a33fbe0 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:41.838049 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6db783b-92aa-4355-b0b1-11179a33fbe0 None None] PATH_INFO: `/` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:41.840699 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 359/731] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:23:41 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jan 25 02:23:41.851043 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5dfeb2-4679-4a29-9c27-2841e5b74403 None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:41.851348 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5dfeb2-4679-4a29-9c27-2841e5b74403 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:41.851581 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5dfeb2-4679-4a29-9c27-2841e5b74403 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:41.869037 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515aa8a4-15ea-4e49-a049-a82756a59b87 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:41.888254 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe6ae27-cf54-4d24-971d-3fefc0298daf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:41.889174 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe6ae27-cf54-4d24-971d-3fefc0298daf admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:41.889731 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe6ae27-cf54-4d24-971d-3fefc0298daf admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:41.890119 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe6ae27-cf54-4d24-971d-3fefc0298daf admin admin] PATH_INFO: `/v3/domains` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:41.891320 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe6ae27-cf54-4d24-971d-3fefc0298daf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:41.891723 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe6ae27-cf54-4d24-971d-3fefc0298daf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:41.894287 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe6ae27-cf54-4d24-971d-3fefc0298daf admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:41.904892 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-6b5dfeb2-4679-4a29-9c27-2841e5b74403 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:23:41.910726 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-6b5dfeb2-4679-4a29-9c27-2841e5b74403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:23:41.931741 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 373/732] 10.222.0.117 () {56 vars in 1135 bytes} [Tue Jan 25 02:23:41 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:41.932042 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 360/733] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:23:41 2022] POST /identity/v3/auth/tokens => generated 1019 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 25 02:23:41.943063 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe6ae27-cf54-4d24-971d-3fefc0298daf admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:41.961734 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5dfeb2-4679-4a29-9c27-2841e5b74403 None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:41.962487 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe6ae27-cf54-4d24-971d-3fefc0298daf admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:41.979061 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5dfeb2-4679-4a29-9c27-2841e5b74403 None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:41.980515 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfd514d-aa77-4f7e-b4b5-dd3d903bfb15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:41.981947 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfd514d-aa77-4f7e-b4b5-dd3d903bfb15 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:41.981947 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfd514d-aa77-4f7e-b4b5-dd3d903bfb15 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:41.981947 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfd514d-aa77-4f7e-b4b5-dd3d903bfb15 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:41.992845 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfd514d-aa77-4f7e-b4b5-dd3d903bfb15 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:41.995492 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfd514d-aa77-4f7e-b4b5-dd3d903bfb15 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:41.997724 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d430254a-ca29-494c-9179-47a99ec1686f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:41.997857 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d430254a-ca29-494c-9179-47a99ec1686f admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:41.998071 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d430254a-ca29-494c-9179-47a99ec1686f admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:41.998894 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d430254a-ca29-494c-9179-47a99ec1686f admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:42.011429 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d430254a-ca29-494c-9179-47a99ec1686f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 25 02:23:42.019570 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: WARNING keystone.server.flask.application [None req-d430254a-ca29-494c-9179-47a99ec1686f admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 25 02:23:42.025590 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 361/734] 10.222.0.117 () {56 vars in 1128 bytes} [Tue Jan 25 02:23:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:23:42.027233 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: WARNING keystone.server.flask.application [None req-9cfd514d-aa77-4f7e-b4b5-dd3d903bfb15 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 25 02:23:42.030286 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d430254a-ca29-494c-9179-47a99ec1686f admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:42.033579 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 374/735] 10.222.0.117 () {56 vars in 1137 bytes} [Tue Jan 25 02:23:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 88 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:23:42.036770 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfd514d-aa77-4f7e-b4b5-dd3d903bfb15 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:42.047327 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d430254a-ca29-494c-9179-47a99ec1686f admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:42.051049 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfd514d-aa77-4f7e-b4b5-dd3d903bfb15 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:42.052992 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60aa4403-3fa0-4ee7-a44b-e96695948a92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:42.054082 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aa4403-3fa0-4ee7-a44b-e96695948a92 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:42.054653 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aa4403-3fa0-4ee7-a44b-e96695948a92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:42.055211 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aa4403-3fa0-4ee7-a44b-e96695948a92 admin admin] PATH_INFO: `/v3/roles` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:42.056964 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60aa4403-3fa0-4ee7-a44b-e96695948a92 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:42.058149 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60aa4403-3fa0-4ee7-a44b-e96695948a92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:42.058382 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d01e195-450d-4fa8-822a-4c33463c67f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:42.059042 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d01e195-450d-4fa8-822a-4c33463c67f2 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:42.059330 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d01e195-450d-4fa8-822a-4c33463c67f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:42.059650 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d01e195-450d-4fa8-822a-4c33463c67f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:42.060502 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d01e195-450d-4fa8-822a-4c33463c67f2 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:42.060868 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d01e195-450d-4fa8-822a-4c33463c67f2 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:42.061249 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60aa4403-3fa0-4ee7-a44b-e96695948a92 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:42.062803 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d01e195-450d-4fa8-822a-4c33463c67f2 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:42.072355 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 362/736] 10.222.0.117 () {56 vars in 1129 bytes} [Tue Jan 25 02:23:42 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:42.083091 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60aa4403-3fa0-4ee7-a44b-e96695948a92 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:42.090882 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 375/737] 10.222.0.117 () {56 vars in 1174 bytes} [Tue Jan 25 02:23:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:42.092479 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d01e195-450d-4fa8-822a-4c33463c67f2 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:42.103615 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d01e195-450d-4fa8-822a-4c33463c67f2 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:42.111491 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f106085-40aa-4930-81de-d2fbdeddabfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:42.112706 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f106085-40aa-4930-81de-d2fbdeddabfb admin admin] REQUEST_METHOD: `PUT` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:42.113209 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f106085-40aa-4930-81de-d2fbdeddabfb admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:42.113426 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60aa4403-3fa0-4ee7-a44b-e96695948a92 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:42.114290 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f106085-40aa-4930-81de-d2fbdeddabfb admin admin] PATH_INFO: `/v3/projects/61a6fe9d4c914755bb0a64c392bd16aa/users/d9ad6269900346458050063c12cac299/roles/d8dbc6d83d9d41d28c3feb8b3485b291` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:42.116858 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f106085-40aa-4930-81de-d2fbdeddabfb admin admin] RBAC: Authorizing `identity:create_grant(project_id=61a6fe9d4c914755bb0a64c392bd16aa, user_id=d9ad6269900346458050063c12cac299, role_id=d8dbc6d83d9d41d28c3feb8b3485b291)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:42.121056 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f106085-40aa-4930-81de-d2fbdeddabfb admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:42.123800 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d2d938-967f-43e4-ba4f-215c5591d2c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:42.125784 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d2d938-967f-43e4-ba4f-215c5591d2c1 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:42.126064 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d2d938-967f-43e4-ba4f-215c5591d2c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:42.128283 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d2d938-967f-43e4-ba4f-215c5591d2c1 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:42.152355 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 376/738] 10.222.0.117 () {58 vars in 1465 bytes} [Tue Jan 25 02:23:42 2022] PUT /identity/v3/projects/61a6fe9d4c914755bb0a64c392bd16aa/users/d9ad6269900346458050063c12cac299/roles/d8dbc6d83d9d41d28c3feb8b3485b291 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 25 02:23:42.153884 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d2d938-967f-43e4-ba4f-215c5591d2c1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:42.156848 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d2d938-967f-43e4-ba4f-215c5591d2c1 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:42.204872 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: WARNING keystone.server.flask.application [None req-44d2d938-967f-43e4-ba4f-215c5591d2c1 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 25 02:23:42.206515 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 363/739] 10.222.0.117 () {56 vars in 1134 bytes} [Tue Jan 25 02:23:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 125 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:23:42.216835 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f106085-40aa-4930-81de-d2fbdeddabfb admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:42.330869 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f106085-40aa-4930-81de-d2fbdeddabfb admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:42.343635 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b382c8f3-2fbc-4949-a0bc-1709e29ba307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:42.347304 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b382c8f3-2fbc-4949-a0bc-1709e29ba307 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:42.347304 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b382c8f3-2fbc-4949-a0bc-1709e29ba307 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:42.347304 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b382c8f3-2fbc-4949-a0bc-1709e29ba307 admin admin] PATH_INFO: `/v3/domains` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:42.347304 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b382c8f3-2fbc-4949-a0bc-1709e29ba307 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:42.347304 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b382c8f3-2fbc-4949-a0bc-1709e29ba307 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:42.349853 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b382c8f3-2fbc-4949-a0bc-1709e29ba307 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:42.374865 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 377/740] 10.222.0.117 () {56 vars in 1135 bytes} [Tue Jan 25 02:23:42 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:42.380237 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d2d938-967f-43e4-ba4f-215c5591d2c1 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:42.392855 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d2d938-967f-43e4-ba4f-215c5591d2c1 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:42.414893 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbec542-d5f7-45b3-943e-d8574552ecf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:42.417211 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbec542-d5f7-45b3-943e-d8574552ecf9 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:42.417667 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbec542-d5f7-45b3-943e-d8574552ecf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:42.418003 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbec542-d5f7-45b3-943e-d8574552ecf9 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:42.428367 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbec542-d5f7-45b3-943e-d8574552ecf9 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:42.431543 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbec542-d5f7-45b3-943e-d8574552ecf9 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:42.456470 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: WARNING keystone.server.flask.application [None req-4cbec542-d5f7-45b3-943e-d8574552ecf9 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jan 25 02:23:42.458011 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 364/741] 10.222.0.117 () {56 vars in 1143 bytes} [Tue Jan 25 02:23:42 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 25 02:23:42.463237 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b382c8f3-2fbc-4949-a0bc-1709e29ba307 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:42.474719 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b382c8f3-2fbc-4949-a0bc-1709e29ba307 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:42.485717 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037f42e7-750e-4914-9be6-918d4fe757ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:42.486643 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037f42e7-750e-4914-9be6-918d4fe757ae admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:42.486925 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037f42e7-750e-4914-9be6-918d4fe757ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:42.487402 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037f42e7-750e-4914-9be6-918d4fe757ae admin admin] PATH_INFO: `/v3/users` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:42.488414 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037f42e7-750e-4914-9be6-918d4fe757ae admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:42.488724 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037f42e7-750e-4914-9be6-918d4fe757ae admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:42.490725 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037f42e7-750e-4914-9be6-918d4fe757ae admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:42.513952 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 378/742] 10.222.0.117 () {56 vars in 1175 bytes} [Tue Jan 25 02:23:42 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 386 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:42.520516 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbec542-d5f7-45b3-943e-d8574552ecf9 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:42.532642 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbec542-d5f7-45b3-943e-d8574552ecf9 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:42.542091 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d147e018-510b-47e9-b106-2eb288ff7115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:42.543082 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d147e018-510b-47e9-b106-2eb288ff7115 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:42.543561 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d147e018-510b-47e9-b106-2eb288ff7115 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:42.543871 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d147e018-510b-47e9-b106-2eb288ff7115 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:42.552953 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d147e018-510b-47e9-b106-2eb288ff7115 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:42.554789 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d147e018-510b-47e9-b106-2eb288ff7115 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:42.565164 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 365/743] 10.222.0.117 () {58 vars in 1329 bytes} [Tue Jan 25 02:23:42 2022] GET /identity/v3/auth/tokens => generated 1019 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:23:42.572803 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037f42e7-750e-4914-9be6-918d4fe757ae admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:42.589475 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037f42e7-750e-4914-9be6-918d4fe757ae admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:42.599807 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ceea588-74ac-4e23-8d00-5defca4213b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:42.600649 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceea588-74ac-4e23-8d00-5defca4213b1 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:42.600928 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceea588-74ac-4e23-8d00-5defca4213b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:42.601201 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceea588-74ac-4e23-8d00-5defca4213b1 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:42.613910 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ceea588-74ac-4e23-8d00-5defca4213b1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:42.615838 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ceea588-74ac-4e23-8d00-5defca4213b1 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:42.642283 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: WARNING keystone.server.flask.application [None req-7ceea588-74ac-4e23-8d00-5defca4213b1 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 25 02:23:42.643857 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 379/744] 10.222.0.117 () {56 vars in 1134 bytes} [Tue Jan 25 02:23:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:23:42.648965 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d147e018-510b-47e9-b106-2eb288ff7115 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:42.659116 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d147e018-510b-47e9-b106-2eb288ff7115 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:42.668822 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451d552c-b69f-46b1-8084-d8e23aace3f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:42.669475 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451d552c-b69f-46b1-8084-d8e23aace3f2 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:42.669756 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451d552c-b69f-46b1-8084-d8e23aace3f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:42.670030 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451d552c-b69f-46b1-8084-d8e23aace3f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:42.670819 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451d552c-b69f-46b1-8084-d8e23aace3f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:42.671121 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451d552c-b69f-46b1-8084-d8e23aace3f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:42.672768 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451d552c-b69f-46b1-8084-d8e23aace3f2 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:42.693854 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 366/745] 10.222.0.117 () {56 vars in 1135 bytes} [Tue Jan 25 02:23:42 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:42.700011 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ceea588-74ac-4e23-8d00-5defca4213b1 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:42.715230 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ceea588-74ac-4e23-8d00-5defca4213b1 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:42.721949 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832d4f0f-2639-4ea9-bacf-0ebb6812fdd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:42.722791 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832d4f0f-2639-4ea9-bacf-0ebb6812fdd3 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:42.723071 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832d4f0f-2639-4ea9-bacf-0ebb6812fdd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:42.723345 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832d4f0f-2639-4ea9-bacf-0ebb6812fdd3 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:42.732353 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832d4f0f-2639-4ea9-bacf-0ebb6812fdd3 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:42.734308 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832d4f0f-2639-4ea9-bacf-0ebb6812fdd3 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:42.753415 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: WARNING keystone.server.flask.application [None req-832d4f0f-2639-4ea9-bacf-0ebb6812fdd3 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 25 02:23:42.759101 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 380/746] 10.222.0.117 () {56 vars in 1137 bytes} [Tue Jan 25 02:23:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:23:42.765305 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451d552c-b69f-46b1-8084-d8e23aace3f2 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:42.784612 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451d552c-b69f-46b1-8084-d8e23aace3f2 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:42.796892 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea00e84-fae4-4498-96f9-4b08af68dce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:42.797553 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea00e84-fae4-4498-96f9-4b08af68dce6 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:42.797837 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea00e84-fae4-4498-96f9-4b08af68dce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:42.798111 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea00e84-fae4-4498-96f9-4b08af68dce6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:42.798915 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea00e84-fae4-4498-96f9-4b08af68dce6 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:42.799221 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea00e84-fae4-4498-96f9-4b08af68dce6 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:42.801081 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea00e84-fae4-4498-96f9-4b08af68dce6 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:42.826516 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 367/747] 10.222.0.117 () {56 vars in 1174 bytes} [Tue Jan 25 02:23:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:42.832322 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832d4f0f-2639-4ea9-bacf-0ebb6812fdd3 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:42.847187 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832d4f0f-2639-4ea9-bacf-0ebb6812fdd3 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:42.857677 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beca016b-897d-46b0-9231-aeb6dfd18b7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:42.858341 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beca016b-897d-46b0-9231-aeb6dfd18b7e admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:42.858622 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beca016b-897d-46b0-9231-aeb6dfd18b7e admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:42.858941 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beca016b-897d-46b0-9231-aeb6dfd18b7e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:42.859824 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beca016b-897d-46b0-9231-aeb6dfd18b7e admin admin] RBAC: Adding query filter params (role.id=8e4691cb5a4b4439b9712d27ef133c20, scope.project.id=61a6fe9d4c914755bb0a64c392bd16aa, user.id=5924414ee6e948a680b8b75c8797b466) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:42.860182 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beca016b-897d-46b0-9231-aeb6dfd18b7e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:42.862112 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beca016b-897d-46b0-9231-aeb6dfd18b7e admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:42.877331 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 381/748] 10.222.0.117 () {56 vars in 1400 bytes} [Tue Jan 25 02:23:42 2022] GET /identity/v3/role_assignments?user.id=5924414ee6e948a680b8b75c8797b466&scope.project.id=61a6fe9d4c914755bb0a64c392bd16aa&role.id=8e4691cb5a4b4439b9712d27ef133c20 => generated 260 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:43.467220 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca16c6e2-4da5-4f0b-8218-208d0f58f3d8 None None] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:43.468167 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca16c6e2-4da5-4f0b-8218-208d0f58f3d8 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:43.468623 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca16c6e2-4da5-4f0b-8218-208d0f58f3d8 None None] PATH_INFO: `/` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:43.471154 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 368/749] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:23:43 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:23:43.474218 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f0f4d6-d704-41e8-aba9-1094fc1050d2 None None] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:43.474651 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f0f4d6-d704-41e8-aba9-1094fc1050d2 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:43.474826 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f0f4d6-d704-41e8-aba9-1094fc1050d2 None None] PATH_INFO: `/` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:43.476563 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 382/750] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:23:43 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:23:43.481429 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f03e6ac-1a4f-41f3-8eac-fa107fc52a7d None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:43.481940 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f03e6ac-1a4f-41f3-8eac-fa107fc52a7d None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:43.482433 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f03e6ac-1a4f-41f3-8eac-fa107fc52a7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:43.482550 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4def3f-a2bf-4127-8210-8becf1c5c7b7 None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:43.482803 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4def3f-a2bf-4127-8210-8becf1c5c7b7 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:43.483089 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4def3f-a2bf-4127-8210-8becf1c5c7b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:43.510316 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-0f03e6ac-1a4f-41f3-8eac-fa107fc52a7d None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:23:43.512394 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-0d4def3f-a2bf-4127-8210-8becf1c5c7b7 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:23:43.513586 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-0d4def3f-a2bf-4127-8210-8becf1c5c7b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:23:43.515077 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-0f03e6ac-1a4f-41f3-8eac-fa107fc52a7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:23:43.527667 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 383/751] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:23:43 2022] POST /identity/v3/auth/tokens => generated 1019 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:23:43.533766 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 369/752] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:23:43 2022] POST /identity/v3/auth/tokens => generated 1019 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:23:43.579303 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4def3f-a2bf-4127-8210-8becf1c5c7b7 None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:43.595937 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f03e6ac-1a4f-41f3-8eac-fa107fc52a7d None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:43.598418 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4def3f-a2bf-4127-8210-8becf1c5c7b7 None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:43.603013 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1dc9ef-3dc2-4a7f-bf5b-e49b2c912c4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:43.603829 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1dc9ef-3dc2-4a7f-bf5b-e49b2c912c4d admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:43.604141 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1dc9ef-3dc2-4a7f-bf5b-e49b2c912c4d admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:43.605147 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1dc9ef-3dc2-4a7f-bf5b-e49b2c912c4d admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:43.613982 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f03e6ac-1a4f-41f3-8eac-fa107fc52a7d None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:43.624286 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1dc9ef-3dc2-4a7f-bf5b-e49b2c912c4d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 25 02:23:43.625069 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57107492-1bf3-4fc2-952d-fb45cb565944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:43.625970 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57107492-1bf3-4fc2-952d-fb45cb565944 admin admin] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:43.626458 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57107492-1bf3-4fc2-952d-fb45cb565944 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:43.626924 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57107492-1bf3-4fc2-952d-fb45cb565944 admin admin] PATH_INFO: `/v3/services` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:43.627891 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57107492-1bf3-4fc2-952d-fb45cb565944 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:43.632783 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: WARNING py.warnings [None req-57107492-1bf3-4fc2-952d-fb45cb565944 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 25 02:23:43.632783 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: warnings.warn(msg) Jan 25 02:23:43.632783 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: Jan 25 02:23:43.634032 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57107492-1bf3-4fc2-952d-fb45cb565944 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:43.641640 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: WARNING keystone.server.flask.application [None req-8e1dc9ef-3dc2-4a7f-bf5b-e49b2c912c4d admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 25 02:23:43.644022 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 384/753] 10.222.0.117 () {56 vars in 1122 bytes} [Tue Jan 25 02:23:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:23:43.650838 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1dc9ef-3dc2-4a7f-bf5b-e49b2c912c4d admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:43.662720 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 370/754] 10.222.0.117 () {60 vars in 1167 bytes} [Tue Jan 25 02:23:43 2022] POST /identity/v3/services => generated 241 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 25 02:23:43.668954 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1dc9ef-3dc2-4a7f-bf5b-e49b2c912c4d admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:43.687863 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1464de1-dcd7-4be6-8fb7-fa0bf954c502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:43.688901 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1464de1-dcd7-4be6-8fb7-fa0bf954c502 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:43.689406 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1464de1-dcd7-4be6-8fb7-fa0bf954c502 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:43.689871 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1464de1-dcd7-4be6-8fb7-fa0bf954c502 admin admin] PATH_INFO: `/v3/roles` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:43.690911 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1464de1-dcd7-4be6-8fb7-fa0bf954c502 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:43.691456 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1464de1-dcd7-4be6-8fb7-fa0bf954c502 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:43.693296 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1464de1-dcd7-4be6-8fb7-fa0bf954c502 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:43.704205 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 385/755] 10.222.0.117 () {56 vars in 1125 bytes} [Tue Jan 25 02:23:43 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:43.712889 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57107492-1bf3-4fc2-952d-fb45cb565944 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:43.726913 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57107492-1bf3-4fc2-952d-fb45cb565944 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:43.735880 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90142e2b-711a-424d-83a3-6664b6b7c56d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:43.737114 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90142e2b-711a-424d-83a3-6664b6b7c56d admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:43.737655 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90142e2b-711a-424d-83a3-6664b6b7c56d admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:43.738131 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90142e2b-711a-424d-83a3-6664b6b7c56d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:43.756507 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90142e2b-711a-424d-83a3-6664b6b7c56d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:43.758374 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90142e2b-711a-424d-83a3-6664b6b7c56d admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:43.787676 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: WARNING keystone.server.flask.application [None req-90142e2b-711a-424d-83a3-6664b6b7c56d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 25 02:23:43.788997 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 371/756] 10.222.0.117 () {56 vars in 1134 bytes} [Tue Jan 25 02:23:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:23:43.796122 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1464de1-dcd7-4be6-8fb7-fa0bf954c502 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:43.813551 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1464de1-dcd7-4be6-8fb7-fa0bf954c502 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:43.824230 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d68ba4-1978-4a67-b600-65731aaf4c00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:43.825379 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d68ba4-1978-4a67-b600-65731aaf4c00 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:43.825937 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d68ba4-1978-4a67-b600-65731aaf4c00 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:43.826406 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d68ba4-1978-4a67-b600-65731aaf4c00 admin admin] PATH_INFO: `/v3/domains` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:43.827411 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d68ba4-1978-4a67-b600-65731aaf4c00 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:43.827937 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d68ba4-1978-4a67-b600-65731aaf4c00 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:43.829882 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d68ba4-1978-4a67-b600-65731aaf4c00 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:43.852343 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 386/757] 10.222.0.117 () {56 vars in 1135 bytes} [Tue Jan 25 02:23:43 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:43.859415 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90142e2b-711a-424d-83a3-6664b6b7c56d admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:43.874005 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90142e2b-711a-424d-83a3-6664b6b7c56d admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:43.886013 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabf745d-53f3-4bde-a207-8f50b54658ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:43.887115 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabf745d-53f3-4bde-a207-8f50b54658ae admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:43.887410 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabf745d-53f3-4bde-a207-8f50b54658ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:43.888092 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabf745d-53f3-4bde-a207-8f50b54658ae admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:43.905023 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabf745d-53f3-4bde-a207-8f50b54658ae admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:43.907079 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabf745d-53f3-4bde-a207-8f50b54658ae admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:43.925255 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: WARNING keystone.server.flask.application [None req-aabf745d-53f3-4bde-a207-8f50b54658ae admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jan 25 02:23:43.926946 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 372/758] 10.222.0.117 () {56 vars in 1122 bytes} [Tue Jan 25 02:23:43 2022] GET /identity/v3/users/swift => generated 83 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 25 02:23:43.934371 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d68ba4-1978-4a67-b600-65731aaf4c00 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:43.953256 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d68ba4-1978-4a67-b600-65731aaf4c00 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:43.958829 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de97214d-9f08-430d-88ba-dc4b8eaf97be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:43.959509 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de97214d-9f08-430d-88ba-dc4b8eaf97be admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:43.959857 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de97214d-9f08-430d-88ba-dc4b8eaf97be admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:43.960147 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de97214d-9f08-430d-88ba-dc4b8eaf97be admin admin] PATH_INFO: `/v3/users` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:43.961010 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de97214d-9f08-430d-88ba-dc4b8eaf97be admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:43.961321 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de97214d-9f08-430d-88ba-dc4b8eaf97be admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:43.963295 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de97214d-9f08-430d-88ba-dc4b8eaf97be admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:43.983682 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 387/759] 10.222.0.117 () {56 vars in 1161 bytes} [Tue Jan 25 02:23:43 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 372 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 02:23:43.990084 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabf745d-53f3-4bde-a207-8f50b54658ae admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:44.008694 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabf745d-53f3-4bde-a207-8f50b54658ae admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:44.016791 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ae3b74-4153-4431-bbb8-fbffa64797b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:44.017433 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ae3b74-4153-4431-bbb8-fbffa64797b7 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:44.017769 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ae3b74-4153-4431-bbb8-fbffa64797b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:44.018040 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ae3b74-4153-4431-bbb8-fbffa64797b7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:44.028013 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ae3b74-4153-4431-bbb8-fbffa64797b7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:44.029812 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ae3b74-4153-4431-bbb8-fbffa64797b7 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:44.039225 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 373/760] 10.222.0.117 () {58 vars in 1329 bytes} [Tue Jan 25 02:23:43 2022] GET /identity/v3/auth/tokens => generated 1118 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 25 02:23:44.046269 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de97214d-9f08-430d-88ba-dc4b8eaf97be admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:44.059462 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de97214d-9f08-430d-88ba-dc4b8eaf97be admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:44.064050 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16d4bd4-54b0-4f43-930b-d580c2cacc0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:44.064830 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16d4bd4-54b0-4f43-930b-d580c2cacc0e admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:44.065167 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16d4bd4-54b0-4f43-930b-d580c2cacc0e admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:44.065440 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16d4bd4-54b0-4f43-930b-d580c2cacc0e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:44.077327 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16d4bd4-54b0-4f43-930b-d580c2cacc0e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:44.079166 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16d4bd4-54b0-4f43-930b-d580c2cacc0e admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:44.097211 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: WARNING keystone.server.flask.application [None req-a16d4bd4-54b0-4f43-930b-d580c2cacc0e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 25 02:23:44.098689 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 388/761] 10.222.0.117 () {56 vars in 1134 bytes} [Tue Jan 25 02:23:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 25 02:23:44.105187 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ae3b74-4153-4431-bbb8-fbffa64797b7 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:44.125093 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ae3b74-4153-4431-bbb8-fbffa64797b7 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:44.141350 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ad5504-e946-4371-b8d2-ea1eb4c38ce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:44.142314 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ad5504-e946-4371-b8d2-ea1eb4c38ce6 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:44.142725 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ad5504-e946-4371-b8d2-ea1eb4c38ce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:44.143133 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ad5504-e946-4371-b8d2-ea1eb4c38ce6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:44.144252 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ad5504-e946-4371-b8d2-ea1eb4c38ce6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:44.144696 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ad5504-e946-4371-b8d2-ea1eb4c38ce6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:44.147163 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ad5504-e946-4371-b8d2-ea1eb4c38ce6 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:44.174631 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 374/762] 10.222.0.117 () {56 vars in 1135 bytes} [Tue Jan 25 02:23:44 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 02:23:44.179719 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16d4bd4-54b0-4f43-930b-d580c2cacc0e admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:44.193252 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16d4bd4-54b0-4f43-930b-d580c2cacc0e admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:44.201677 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da78354-5157-4a16-8e00-665b527b559d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:44.202521 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da78354-5157-4a16-8e00-665b527b559d admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:44.202800 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da78354-5157-4a16-8e00-665b527b559d admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:44.203073 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da78354-5157-4a16-8e00-665b527b559d admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:44.221743 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da78354-5157-4a16-8e00-665b527b559d admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:44.224539 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da78354-5157-4a16-8e00-665b527b559d admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:44.242596 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: WARNING keystone.server.flask.application [None req-9da78354-5157-4a16-8e00-665b527b559d admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 25 02:23:44.244140 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 389/763] 10.222.0.117 () {56 vars in 1137 bytes} [Tue Jan 25 02:23:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:23:44.251554 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ad5504-e946-4371-b8d2-ea1eb4c38ce6 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:44.274532 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ad5504-e946-4371-b8d2-ea1eb4c38ce6 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:44.290144 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b7cf54-c88c-4f4e-b360-c7ff30595380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:44.291075 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b7cf54-c88c-4f4e-b360-c7ff30595380 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:44.291461 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b7cf54-c88c-4f4e-b360-c7ff30595380 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:44.292457 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b7cf54-c88c-4f4e-b360-c7ff30595380 admin admin] PATH_INFO: `/v3/projects` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:44.293623 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b7cf54-c88c-4f4e-b360-c7ff30595380 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:44.294054 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b7cf54-c88c-4f4e-b360-c7ff30595380 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:44.296811 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b7cf54-c88c-4f4e-b360-c7ff30595380 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:44.323679 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 375/764] 10.222.0.117 () {56 vars in 1174 bytes} [Tue Jan 25 02:23:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:44.329826 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da78354-5157-4a16-8e00-665b527b559d admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:44.344747 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da78354-5157-4a16-8e00-665b527b559d admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:44.352146 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b934ffa2-ab93-4dd9-b88c-6dd07bf2aadf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:44.352800 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b934ffa2-ab93-4dd9-b88c-6dd07bf2aadf admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:44.353247 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b934ffa2-ab93-4dd9-b88c-6dd07bf2aadf admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:44.353532 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b934ffa2-ab93-4dd9-b88c-6dd07bf2aadf admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:44.355154 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b934ffa2-ab93-4dd9-b88c-6dd07bf2aadf admin admin] RBAC: Adding query filter params (role.id=d8dbc6d83d9d41d28c3feb8b3485b291, scope.project.id=61a6fe9d4c914755bb0a64c392bd16aa, user.id=100f12ee56754f1c859106bf3e473df6) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:44.355533 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b934ffa2-ab93-4dd9-b88c-6dd07bf2aadf admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:44.357487 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b934ffa2-ab93-4dd9-b88c-6dd07bf2aadf admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:44.368218 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 390/765] 10.222.0.117 () {56 vars in 1400 bytes} [Tue Jan 25 02:23:44 2022] GET /identity/v3/role_assignments?user.id=100f12ee56754f1c859106bf3e473df6&scope.project.id=61a6fe9d4c914755bb0a64c392bd16aa&role.id=d8dbc6d83d9d41d28c3feb8b3485b291 => generated 260 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 02:23:45.183124 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ebd18b-7a34-4cd0-b6d5-df7216c94eae None None] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:45.183677 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ebd18b-7a34-4cd0-b6d5-df7216c94eae None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:45.183975 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ebd18b-7a34-4cd0-b6d5-df7216c94eae None None] PATH_INFO: `/` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:45.185936 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 376/766] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:23:45 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:23:45.190977 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361778ff-1fb4-4347-9abc-df2382b6deb1 None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:45.191383 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361778ff-1fb4-4347-9abc-df2382b6deb1 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:45.191568 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361778ff-1fb4-4347-9abc-df2382b6deb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:45.216672 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-361778ff-1fb4-4347-9abc-df2382b6deb1 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:23:45.217876 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-361778ff-1fb4-4347-9abc-df2382b6deb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:23:45.226866 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 391/767] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:23:45 2022] POST /identity/v3/auth/tokens => generated 1118 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 25 02:23:45.253369 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7ccd8d-05f0-45b2-af78-4591f664f48a None None] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:45.253716 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7ccd8d-05f0-45b2-af78-4591f664f48a None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:45.253932 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7ccd8d-05f0-45b2-af78-4591f664f48a None None] PATH_INFO: `/` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:45.254044 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361778ff-1fb4-4347-9abc-df2382b6deb1 None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:45.255985 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 377/768] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:23:45 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:23:45.261804 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4822ff3-5715-4a4a-8eb5-f297bd66aada None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:45.262059 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4822ff3-5715-4a4a-8eb5-f297bd66aada None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:45.262272 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4822ff3-5715-4a4a-8eb5-f297bd66aada None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:45.266739 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361778ff-1fb4-4347-9abc-df2382b6deb1 None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:45.281540 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af94132d-f7a7-464b-8495-55fb1fbd0fcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:45.282401 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af94132d-f7a7-464b-8495-55fb1fbd0fcc admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:45.282683 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af94132d-f7a7-464b-8495-55fb1fbd0fcc admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:45.283007 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af94132d-f7a7-464b-8495-55fb1fbd0fcc admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:45.292952 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-f4822ff3-5715-4a4a-8eb5-f297bd66aada None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:23:45.294370 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-f4822ff3-5715-4a4a-8eb5-f297bd66aada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:23:45.303304 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af94132d-f7a7-464b-8495-55fb1fbd0fcc admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 25 02:23:45.310687 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: WARNING keystone.server.flask.application [None req-af94132d-f7a7-464b-8495-55fb1fbd0fcc admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 25 02:23:45.311937 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 392/769] 10.222.0.117 () {56 vars in 1122 bytes} [Tue Jan 25 02:23:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:23:45.319800 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 378/770] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:23:45 2022] POST /identity/v3/auth/tokens => generated 1118 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:23:45.320704 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af94132d-f7a7-464b-8495-55fb1fbd0fcc admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:45.331359 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af94132d-f7a7-464b-8495-55fb1fbd0fcc admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:45.339777 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a651a433-e89e-4fa0-a439-108a4676c6b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:45.340437 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a651a433-e89e-4fa0-a439-108a4676c6b7 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:45.340771 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a651a433-e89e-4fa0-a439-108a4676c6b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:45.341050 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a651a433-e89e-4fa0-a439-108a4676c6b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:45.341829 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a651a433-e89e-4fa0-a439-108a4676c6b7 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:45.342131 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a651a433-e89e-4fa0-a439-108a4676c6b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:45.343793 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a651a433-e89e-4fa0-a439-108a4676c6b7 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:45.355097 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 393/771] 10.222.0.117 () {56 vars in 1125 bytes} [Tue Jan 25 02:23:45 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:45.361117 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4822ff3-5715-4a4a-8eb5-f297bd66aada None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:45.376070 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4822ff3-5715-4a4a-8eb5-f297bd66aada None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:45.378564 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a651a433-e89e-4fa0-a439-108a4676c6b7 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:45.381003 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a01a73d-6293-4319-9b9e-96a1609cb46f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:45.381815 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a01a73d-6293-4319-9b9e-96a1609cb46f admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:45.382092 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a01a73d-6293-4319-9b9e-96a1609cb46f admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:45.382359 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a01a73d-6293-4319-9b9e-96a1609cb46f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:45.389148 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a651a433-e89e-4fa0-a439-108a4676c6b7 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:45.394497 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a01a73d-6293-4319-9b9e-96a1609cb46f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:45.396399 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a01a73d-6293-4319-9b9e-96a1609cb46f admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:45.404517 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff663734-bca8-4cee-8f76-9e75415cfc80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:45.405346 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff663734-bca8-4cee-8f76-9e75415cfc80 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:45.405626 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff663734-bca8-4cee-8f76-9e75415cfc80 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:45.405899 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff663734-bca8-4cee-8f76-9e75415cfc80 admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:45.406587 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff663734-bca8-4cee-8f76-9e75415cfc80 admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:45.408238 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff663734-bca8-4cee-8f76-9e75415cfc80 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:45.416017 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: WARNING keystone.server.flask.application [None req-0a01a73d-6293-4319-9b9e-96a1609cb46f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 25 02:23:45.418149 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 379/772] 10.222.0.117 () {56 vars in 1134 bytes} [Tue Jan 25 02:23:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:23:45.421147 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: WARNING keystone.server.flask.application [None req-ff663734-bca8-4cee-8f76-9e75415cfc80 admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jan 25 02:23:45.422866 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 394/773] 10.222.0.117 () {56 vars in 1155 bytes} [Tue Jan 25 02:23:45 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:23:45.424528 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a01a73d-6293-4319-9b9e-96a1609cb46f admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:45.428926 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff663734-bca8-4cee-8f76-9e75415cfc80 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:45.441636 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a01a73d-6293-4319-9b9e-96a1609cb46f admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:45.441794 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff663734-bca8-4cee-8f76-9e75415cfc80 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:45.446201 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf1ba6c-9060-4cf3-83ae-06e0fbbfc2bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:45.446856 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf1ba6c-9060-4cf3-83ae-06e0fbbfc2bc admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:45.447142 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf1ba6c-9060-4cf3-83ae-06e0fbbfc2bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:45.447363 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f87cd4-6319-44f3-bb49-a966477e3f9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:45.447473 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf1ba6c-9060-4cf3-83ae-06e0fbbfc2bc admin admin] PATH_INFO: `/v3/services` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:45.449110 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf1ba6c-9060-4cf3-83ae-06e0fbbfc2bc admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:45.449110 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf1ba6c-9060-4cf3-83ae-06e0fbbfc2bc admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:45.449790 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f87cd4-6319-44f3-bb49-a966477e3f9f admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:45.450275 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f87cd4-6319-44f3-bb49-a966477e3f9f admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:45.450600 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf1ba6c-9060-4cf3-83ae-06e0fbbfc2bc admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:45.450971 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f87cd4-6319-44f3-bb49-a966477e3f9f admin admin] PATH_INFO: `/v3/domains` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:45.451929 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f87cd4-6319-44f3-bb49-a966477e3f9f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:45.452457 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f87cd4-6319-44f3-bb49-a966477e3f9f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:45.454347 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f87cd4-6319-44f3-bb49-a966477e3f9f admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:45.464163 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 395/774] 10.222.0.117 () {56 vars in 1150 bytes} [Tue Jan 25 02:23:45 2022] GET /identity/v3/services?name=block-storage => generated 131 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:45.465200 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf1ba6c-9060-4cf3-83ae-06e0fbbfc2bc admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:45.480633 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf1ba6c-9060-4cf3-83ae-06e0fbbfc2bc admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:45.483811 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 380/775] 10.222.0.117 () {56 vars in 1135 bytes} [Tue Jan 25 02:23:45 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:45.487875 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e58c38-78be-4022-b2d0-a5c515d90afc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:45.488576 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e58c38-78be-4022-b2d0-a5c515d90afc admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:45.488847 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e58c38-78be-4022-b2d0-a5c515d90afc admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:45.489187 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e58c38-78be-4022-b2d0-a5c515d90afc admin admin] PATH_INFO: `/v3/services` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:45.490650 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f87cd4-6319-44f3-bb49-a966477e3f9f admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:45.496833 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e58c38-78be-4022-b2d0-a5c515d90afc admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:45.497179 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e58c38-78be-4022-b2d0-a5c515d90afc admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:45.498833 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e58c38-78be-4022-b2d0-a5c515d90afc admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:45.504586 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 396/776] 10.222.0.117 () {56 vars in 1150 bytes} [Tue Jan 25 02:23:45 2022] GET /identity/v3/services?type=block-storage => generated 369 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:45.513005 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f87cd4-6319-44f3-bb49-a966477e3f9f admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:45.517681 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a563255e-44bf-4d0b-95ad-03e7f54fcc15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:45.517811 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e58c38-78be-4022-b2d0-a5c515d90afc admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:45.518608 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a563255e-44bf-4d0b-95ad-03e7f54fcc15 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:45.518863 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a563255e-44bf-4d0b-95ad-03e7f54fcc15 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:45.519137 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a563255e-44bf-4d0b-95ad-03e7f54fcc15 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:45.532720 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a563255e-44bf-4d0b-95ad-03e7f54fcc15 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:45.534741 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a563255e-44bf-4d0b-95ad-03e7f54fcc15 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:45.539789 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e58c38-78be-4022-b2d0-a5c515d90afc admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:45.549717 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c2abf4-81ad-4b87-a1ba-7dd6ee370b2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:45.550379 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c2abf4-81ad-4b87-a1ba-7dd6ee370b2c admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:45.550661 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c2abf4-81ad-4b87-a1ba-7dd6ee370b2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:45.550930 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c2abf4-81ad-4b87-a1ba-7dd6ee370b2c admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:45.551755 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c2abf4-81ad-4b87-a1ba-7dd6ee370b2c admin admin] RBAC: Adding query filter params (interface=public, service_id=9f783600d35e463e853deeb80480486e, region_id=RegionOne) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:45.552066 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c2abf4-81ad-4b87-a1ba-7dd6ee370b2c admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:45.553100 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: WARNING py.warnings [None req-25c2abf4-81ad-4b87-a1ba-7dd6ee370b2c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_endpoints": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 25 02:23:45.553100 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: warnings.warn(msg) Jan 25 02:23:45.553100 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: Jan 25 02:23:45.553979 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c2abf4-81ad-4b87-a1ba-7dd6ee370b2c admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:45.558990 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: WARNING keystone.server.flask.application [None req-a563255e-44bf-4d0b-95ad-03e7f54fcc15 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jan 25 02:23:45.560816 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 381/777] 10.222.0.117 () {56 vars in 1119 bytes} [Tue Jan 25 02:23:45 2022] GET /identity/v3/users/nova => generated 82 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 25 02:23:45.566337 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a563255e-44bf-4d0b-95ad-03e7f54fcc15 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:45.570296 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 397/778] 10.222.0.117 () {56 vars in 1277 bytes} [Tue Jan 25 02:23:45 2022] GET /identity/v3/endpoints?service_id=9f783600d35e463e853deeb80480486e&interface=public®ion_id=RegionOne => generated 195 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 02:23:45.576626 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c2abf4-81ad-4b87-a1ba-7dd6ee370b2c admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:45.586264 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a563255e-44bf-4d0b-95ad-03e7f54fcc15 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:45.594413 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cd117e-9d43-43d6-9b4d-b76fd7b76b60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:45.595718 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cd117e-9d43-43d6-9b4d-b76fd7b76b60 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:45.596215 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cd117e-9d43-43d6-9b4d-b76fd7b76b60 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:45.596707 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cd117e-9d43-43d6-9b4d-b76fd7b76b60 admin admin] PATH_INFO: `/v3/users` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:45.598134 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cd117e-9d43-43d6-9b4d-b76fd7b76b60 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:45.598632 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cd117e-9d43-43d6-9b4d-b76fd7b76b60 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:45.599252 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c2abf4-81ad-4b87-a1ba-7dd6ee370b2c admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:45.600976 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cd117e-9d43-43d6-9b4d-b76fd7b76b60 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:45.620720 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b3ec4d-0854-400a-94bc-7236f1915409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:45.621351 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b3ec4d-0854-400a-94bc-7236f1915409 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:45.621634 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b3ec4d-0854-400a-94bc-7236f1915409 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:45.621915 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b3ec4d-0854-400a-94bc-7236f1915409 admin admin] PATH_INFO: `/v3/services` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:45.622627 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b3ec4d-0854-400a-94bc-7236f1915409 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:45.627756 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b3ec4d-0854-400a-94bc-7236f1915409 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:45.629124 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 382/779] 10.222.0.117 () {56 vars in 1159 bytes} [Tue Jan 25 02:23:45 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 370 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 02:23:45.630685 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cd117e-9d43-43d6-9b4d-b76fd7b76b60 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:45.640635 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 398/780] 10.222.0.117 () {56 vars in 1113 bytes} [Tue Jan 25 02:23:45 2022] GET /identity/v3/services => generated 776 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:45.643157 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cd117e-9d43-43d6-9b4d-b76fd7b76b60 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:45.648108 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43f3a07-342f-42e6-b6ef-bbf87e23435b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:45.649065 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43f3a07-342f-42e6-b6ef-bbf87e23435b admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:45.649485 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43f3a07-342f-42e6-b6ef-bbf87e23435b admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:45.649943 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43f3a07-342f-42e6-b6ef-bbf87e23435b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:45.665037 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43f3a07-342f-42e6-b6ef-bbf87e23435b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:45.668435 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43f3a07-342f-42e6-b6ef-bbf87e23435b admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:45.685225 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 383/781] 10.222.0.117 () {58 vars in 1329 bytes} [Tue Jan 25 02:23:45 2022] GET /identity/v3/auth/tokens => generated 1118 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 25 02:23:45.691011 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b3ec4d-0854-400a-94bc-7236f1915409 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:45.695573 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fb84af-880f-4d86-8f2d-1a9dc2cbd32b None None] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:45.695878 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fb84af-880f-4d86-8f2d-1a9dc2cbd32b None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:45.696327 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fb84af-880f-4d86-8f2d-1a9dc2cbd32b None None] PATH_INFO: `/` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:45.699379 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 384/782] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:23:45 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:23:45.705555 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b0e2a0-938d-481d-9043-9f326e28147b None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:45.705990 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b0e2a0-938d-481d-9043-9f326e28147b None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:45.706277 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b0e2a0-938d-481d-9043-9f326e28147b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:45.722267 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b3ec4d-0854-400a-94bc-7236f1915409 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:45.725227 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-69b0e2a0-938d-481d-9043-9f326e28147b None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:23:45.726462 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-69b0e2a0-938d-481d-9043-9f326e28147b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:23:45.735508 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 385/783] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:23:45 2022] POST /identity/v3/auth/tokens => generated 1118 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 25 02:23:45.756496 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e35836c-4ffd-4e10-87d8-bd78c225deb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:45.757322 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e35836c-4ffd-4e10-87d8-bd78c225deb4 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:45.757618 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e35836c-4ffd-4e10-87d8-bd78c225deb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:45.757893 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e35836c-4ffd-4e10-87d8-bd78c225deb4 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:45.760116 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b0e2a0-938d-481d-9043-9f326e28147b None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:45.777031 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b0e2a0-938d-481d-9043-9f326e28147b None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:45.781415 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e35836c-4ffd-4e10-87d8-bd78c225deb4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:45.783311 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e35836c-4ffd-4e10-87d8-bd78c225deb4 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:45.788410 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e319f9-048b-4af1-9c67-9be0c1b94dfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:45.789232 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e319f9-048b-4af1-9c67-9be0c1b94dfe admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:45.789513 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e319f9-048b-4af1-9c67-9be0c1b94dfe admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:45.789789 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e319f9-048b-4af1-9c67-9be0c1b94dfe admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:45.811815 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: WARNING keystone.server.flask.application [None req-6e35836c-4ffd-4e10-87d8-bd78c225deb4 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 25 02:23:45.813600 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 399/784] 10.222.0.117 () {56 vars in 1134 bytes} [Tue Jan 25 02:23:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 123 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:23:45.819266 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e35836c-4ffd-4e10-87d8-bd78c225deb4 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:45.831222 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e35836c-4ffd-4e10-87d8-bd78c225deb4 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:45.836264 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc0d339-2347-4269-a1f5-57c68ddb62c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:45.836423 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e319f9-048b-4af1-9c67-9be0c1b94dfe admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 25 02:23:45.837279 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc0d339-2347-4269-a1f5-57c68ddb62c0 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:45.837701 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc0d339-2347-4269-a1f5-57c68ddb62c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:45.838151 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc0d339-2347-4269-a1f5-57c68ddb62c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:45.840603 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc0d339-2347-4269-a1f5-57c68ddb62c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:45.841111 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc0d339-2347-4269-a1f5-57c68ddb62c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:45.842947 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc0d339-2347-4269-a1f5-57c68ddb62c0 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:45.844107 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: WARNING keystone.server.flask.application [None req-d5e319f9-048b-4af1-9c67-9be0c1b94dfe admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 25 02:23:45.845881 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 386/785] 10.222.0.117 () {56 vars in 1128 bytes} [Tue Jan 25 02:23:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 86 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:23:45.852683 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e319f9-048b-4af1-9c67-9be0c1b94dfe admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:45.858475 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 400/786] 10.222.0.117 () {56 vars in 1135 bytes} [Tue Jan 25 02:23:45 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 02:23:45.864032 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc0d339-2347-4269-a1f5-57c68ddb62c0 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:45.874696 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e319f9-048b-4af1-9c67-9be0c1b94dfe admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:45.883327 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f97ddda-f987-4b5e-a256-b5af42648e5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:45.887176 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f97ddda-f987-4b5e-a256-b5af42648e5f admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:45.888725 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc0d339-2347-4269-a1f5-57c68ddb62c0 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:45.889270 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f97ddda-f987-4b5e-a256-b5af42648e5f admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:45.889689 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f97ddda-f987-4b5e-a256-b5af42648e5f admin admin] PATH_INFO: `/v3/roles` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:45.891206 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f97ddda-f987-4b5e-a256-b5af42648e5f admin admin] RBAC: Adding query filter params (name=service) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:45.891840 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f97ddda-f987-4b5e-a256-b5af42648e5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:45.897331 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f97ddda-f987-4b5e-a256-b5af42648e5f admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:45.900220 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5929a5b6-dc3b-4b3e-9333-fd87282e4716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:45.903778 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5929a5b6-dc3b-4b3e-9333-fd87282e4716 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:45.904279 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5929a5b6-dc3b-4b3e-9333-fd87282e4716 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:45.904692 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5929a5b6-dc3b-4b3e-9333-fd87282e4716 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:45.912580 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5929a5b6-dc3b-4b3e-9333-fd87282e4716 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:45.914915 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5929a5b6-dc3b-4b3e-9333-fd87282e4716 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:45.916110 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 387/787] 10.222.0.117 () {56 vars in 1129 bytes} [Tue Jan 25 02:23:45 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:45.918194 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f97ddda-f987-4b5e-a256-b5af42648e5f admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:45.931328 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f97ddda-f987-4b5e-a256-b5af42648e5f admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:45.931568 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: WARNING keystone.server.flask.application [None req-5929a5b6-dc3b-4b3e-9333-fd87282e4716 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 25 02:23:45.934905 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 401/788] 10.222.0.117 () {56 vars in 1137 bytes} [Tue Jan 25 02:23:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:23:45.941200 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5929a5b6-dc3b-4b3e-9333-fd87282e4716 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:45.945196 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dc980f-d9f9-4d9f-9350-803e50795b14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:45.946939 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dc980f-d9f9-4d9f-9350-803e50795b14 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:45.949446 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dc980f-d9f9-4d9f-9350-803e50795b14 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:45.949446 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dc980f-d9f9-4d9f-9350-803e50795b14 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:45.956239 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5929a5b6-dc3b-4b3e-9333-fd87282e4716 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:45.961963 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f119970-0eae-40fc-8974-72689d3bf39b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:45.962178 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dc980f-d9f9-4d9f-9350-803e50795b14 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:45.962934 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f119970-0eae-40fc-8974-72689d3bf39b admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:45.963373 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f119970-0eae-40fc-8974-72689d3bf39b admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:45.964414 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f119970-0eae-40fc-8974-72689d3bf39b admin admin] PATH_INFO: `/v3/projects` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:45.965080 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dc980f-d9f9-4d9f-9350-803e50795b14 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:45.966199 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f119970-0eae-40fc-8974-72689d3bf39b admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:45.966660 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f119970-0eae-40fc-8974-72689d3bf39b admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:45.969242 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f119970-0eae-40fc-8974-72689d3bf39b admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:45.985365 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 402/789] 10.222.0.117 () {56 vars in 1174 bytes} [Tue Jan 25 02:23:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:45.986854 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: WARNING keystone.server.flask.application [None req-11dc980f-d9f9-4d9f-9350-803e50795b14 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 25 02:23:45.988698 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 388/790] 10.222.0.117 () {56 vars in 1134 bytes} [Tue Jan 25 02:23:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 25 02:23:45.991190 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f119970-0eae-40fc-8974-72689d3bf39b admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:45.993598 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dc980f-d9f9-4d9f-9350-803e50795b14 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:46.002855 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f119970-0eae-40fc-8974-72689d3bf39b admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:46.007810 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9cafbe-0561-476f-aaf7-326370bf1636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:46.008710 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9cafbe-0561-476f-aaf7-326370bf1636 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:46.009658 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9cafbe-0561-476f-aaf7-326370bf1636 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:46.010078 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9cafbe-0561-476f-aaf7-326370bf1636 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:46.012503 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9cafbe-0561-476f-aaf7-326370bf1636 admin admin] RBAC: Adding query filter params (role.id=d8dbc6d83d9d41d28c3feb8b3485b291, scope.project.id=61a6fe9d4c914755bb0a64c392bd16aa, user.id=d9ad6269900346458050063c12cac299) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:46.013143 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9cafbe-0561-476f-aaf7-326370bf1636 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:46.015055 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dc980f-d9f9-4d9f-9350-803e50795b14 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:46.015357 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9cafbe-0561-476f-aaf7-326370bf1636 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:46.022654 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 403/791] 10.222.0.117 () {56 vars in 1400 bytes} [Tue Jan 25 02:23:45 2022] GET /identity/v3/role_assignments?user.id=d9ad6269900346458050063c12cac299&scope.project.id=61a6fe9d4c914755bb0a64c392bd16aa&role.id=d8dbc6d83d9d41d28c3feb8b3485b291 => generated 610 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:46.028496 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be758260-c154-47fa-99fc-a072b8cb1e42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:46.029188 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be758260-c154-47fa-99fc-a072b8cb1e42 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:46.029480 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be758260-c154-47fa-99fc-a072b8cb1e42 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:46.029763 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be758260-c154-47fa-99fc-a072b8cb1e42 admin admin] PATH_INFO: `/v3/domains` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:46.030533 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be758260-c154-47fa-99fc-a072b8cb1e42 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:46.030844 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be758260-c154-47fa-99fc-a072b8cb1e42 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:46.034406 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be758260-c154-47fa-99fc-a072b8cb1e42 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:46.046994 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 389/792] 10.222.0.117 () {56 vars in 1135 bytes} [Tue Jan 25 02:23:45 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 02:23:46.052734 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9cafbe-0561-476f-aaf7-326370bf1636 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:46.063917 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9cafbe-0561-476f-aaf7-326370bf1636 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:46.068879 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b619956e-7d1f-4f44-b5e1-1219605f34fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:46.069917 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b619956e-7d1f-4f44-b5e1-1219605f34fe admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:46.070365 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b619956e-7d1f-4f44-b5e1-1219605f34fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:46.070786 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b619956e-7d1f-4f44-b5e1-1219605f34fe admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:46.089579 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b619956e-7d1f-4f44-b5e1-1219605f34fe admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:46.092000 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b619956e-7d1f-4f44-b5e1-1219605f34fe admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:46.116060 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: WARNING keystone.server.flask.application [None req-b619956e-7d1f-4f44-b5e1-1219605f34fe admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jan 25 02:23:46.117487 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 404/793] 10.222.0.117 () {56 vars in 1143 bytes} [Tue Jan 25 02:23:46 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:23:46.123604 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be758260-c154-47fa-99fc-a072b8cb1e42 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:46.138563 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be758260-c154-47fa-99fc-a072b8cb1e42 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:46.154254 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014cd99c-6950-4b5c-9f3e-9c88f516893e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:46.155222 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014cd99c-6950-4b5c-9f3e-9c88f516893e admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:46.155654 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014cd99c-6950-4b5c-9f3e-9c88f516893e admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:46.156091 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014cd99c-6950-4b5c-9f3e-9c88f516893e admin admin] PATH_INFO: `/v3/users` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:46.157102 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014cd99c-6950-4b5c-9f3e-9c88f516893e admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:46.157578 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014cd99c-6950-4b5c-9f3e-9c88f516893e admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:46.159605 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014cd99c-6950-4b5c-9f3e-9c88f516893e admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:46.180868 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 390/794] 10.222.0.117 () {56 vars in 1175 bytes} [Tue Jan 25 02:23:46 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 386 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:46.187272 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b619956e-7d1f-4f44-b5e1-1219605f34fe admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:46.197771 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b619956e-7d1f-4f44-b5e1-1219605f34fe admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:46.203169 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea380b86-3774-453b-a14e-f3e869eafaff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:46.204192 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea380b86-3774-453b-a14e-f3e869eafaff admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:46.204646 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea380b86-3774-453b-a14e-f3e869eafaff admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:46.205073 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea380b86-3774-453b-a14e-f3e869eafaff admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:46.217044 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea380b86-3774-453b-a14e-f3e869eafaff admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:46.219255 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea380b86-3774-453b-a14e-f3e869eafaff admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:46.237709 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: WARNING keystone.server.flask.application [None req-ea380b86-3774-453b-a14e-f3e869eafaff admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 25 02:23:46.239148 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 405/795] 10.222.0.117 () {56 vars in 1134 bytes} [Tue Jan 25 02:23:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:23:46.245677 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014cd99c-6950-4b5c-9f3e-9c88f516893e admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:46.256697 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014cd99c-6950-4b5c-9f3e-9c88f516893e admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:46.263368 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aae2f67-0b2a-4299-919e-0ef3e5ff118b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:46.264288 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aae2f67-0b2a-4299-919e-0ef3e5ff118b admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:46.264721 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aae2f67-0b2a-4299-919e-0ef3e5ff118b admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:46.265244 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aae2f67-0b2a-4299-919e-0ef3e5ff118b admin admin] PATH_INFO: `/v3/domains` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:46.266235 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aae2f67-0b2a-4299-919e-0ef3e5ff118b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:46.266702 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aae2f67-0b2a-4299-919e-0ef3e5ff118b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:46.268539 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aae2f67-0b2a-4299-919e-0ef3e5ff118b admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:46.281986 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 391/796] 10.222.0.117 () {56 vars in 1135 bytes} [Tue Jan 25 02:23:46 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:46.287529 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea380b86-3774-453b-a14e-f3e869eafaff admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:46.298048 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea380b86-3774-453b-a14e-f3e869eafaff admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:46.302973 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ff85fe-c8dc-4edb-b7f6-a2b2d9f41ee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:46.304020 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ff85fe-c8dc-4edb-b7f6-a2b2d9f41ee6 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:46.304462 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ff85fe-c8dc-4edb-b7f6-a2b2d9f41ee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:46.304987 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ff85fe-c8dc-4edb-b7f6-a2b2d9f41ee6 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:46.313003 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ff85fe-c8dc-4edb-b7f6-a2b2d9f41ee6 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:46.315343 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ff85fe-c8dc-4edb-b7f6-a2b2d9f41ee6 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:46.330726 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: WARNING keystone.server.flask.application [None req-22ff85fe-c8dc-4edb-b7f6-a2b2d9f41ee6 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 25 02:23:46.332474 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 406/797] 10.222.0.117 () {56 vars in 1137 bytes} [Tue Jan 25 02:23:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:23:46.338239 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aae2f67-0b2a-4299-919e-0ef3e5ff118b admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:46.349908 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aae2f67-0b2a-4299-919e-0ef3e5ff118b admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:46.356176 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4067a10d-ded1-4957-bcca-d074dbff443b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:46.357079 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4067a10d-ded1-4957-bcca-d074dbff443b admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:46.357533 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4067a10d-ded1-4957-bcca-d074dbff443b admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:46.357972 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4067a10d-ded1-4957-bcca-d074dbff443b admin admin] PATH_INFO: `/v3/projects` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:46.358963 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4067a10d-ded1-4957-bcca-d074dbff443b admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:46.359428 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4067a10d-ded1-4957-bcca-d074dbff443b admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:46.361588 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4067a10d-ded1-4957-bcca-d074dbff443b admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:46.375063 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 392/798] 10.222.0.117 () {56 vars in 1174 bytes} [Tue Jan 25 02:23:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:46.380950 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ff85fe-c8dc-4edb-b7f6-a2b2d9f41ee6 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:46.391769 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ff85fe-c8dc-4edb-b7f6-a2b2d9f41ee6 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:46.397012 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e43f0a-8f42-457d-8a4c-8ffb73a6fc53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:46.398128 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e43f0a-8f42-457d-8a4c-8ffb73a6fc53 admin admin] REQUEST_METHOD: `PUT` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:46.398558 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e43f0a-8f42-457d-8a4c-8ffb73a6fc53 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:46.398994 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e43f0a-8f42-457d-8a4c-8ffb73a6fc53 admin admin] PATH_INFO: `/v3/projects/61a6fe9d4c914755bb0a64c392bd16aa/users/5924414ee6e948a680b8b75c8797b466/roles/8e4691cb5a4b4439b9712d27ef133c20` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:46.415219 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e43f0a-8f42-457d-8a4c-8ffb73a6fc53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=61a6fe9d4c914755bb0a64c392bd16aa, user_id=5924414ee6e948a680b8b75c8797b466, role_id=8e4691cb5a4b4439b9712d27ef133c20)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:46.418864 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e43f0a-8f42-457d-8a4c-8ffb73a6fc53 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:46.433848 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 407/799] 10.222.0.117 () {58 vars in 1465 bytes} [Tue Jan 25 02:23:46 2022] PUT /identity/v3/projects/61a6fe9d4c914755bb0a64c392bd16aa/users/5924414ee6e948a680b8b75c8797b466/roles/8e4691cb5a4b4439b9712d27ef133c20 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:23:46.793425 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc861d38-b912-439b-962b-6dc727cd514b None None] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:46.794117 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc861d38-b912-439b-962b-6dc727cd514b None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:46.794638 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc861d38-b912-439b-962b-6dc727cd514b None None] PATH_INFO: `/` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:46.796942 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 393/800] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:23:46 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:23:46.802170 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee1e63c-d29a-473e-aea0-2cc6ac02f51a None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:46.802719 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee1e63c-d29a-473e-aea0-2cc6ac02f51a None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:46.803205 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee1e63c-d29a-473e-aea0-2cc6ac02f51a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:46.825262 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-2ee1e63c-d29a-473e-aea0-2cc6ac02f51a None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:23:46.826812 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-2ee1e63c-d29a-473e-aea0-2cc6ac02f51a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:23:46.906010 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 408/801] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:23:46 2022] POST /identity/v3/auth/tokens => generated 1118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:23:46.942077 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc861d38-b912-439b-962b-6dc727cd514b None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:46.961612 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc861d38-b912-439b-962b-6dc727cd514b None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:46.967099 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117d9d98-2d2e-47e5-9f4b-9154ea91e367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:46.968278 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117d9d98-2d2e-47e5-9f4b-9154ea91e367 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:46.968776 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117d9d98-2d2e-47e5-9f4b-9154ea91e367 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:46.969312 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117d9d98-2d2e-47e5-9f4b-9154ea91e367 admin admin] PATH_INFO: `/v3/services/network` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:46.970492 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117d9d98-2d2e-47e5-9f4b-9154ea91e367 admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:46.972416 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117d9d98-2d2e-47e5-9f4b-9154ea91e367 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:46.988164 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: WARNING keystone.server.flask.application [None req-117d9d98-2d2e-47e5-9f4b-9154ea91e367 admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jan 25 02:23:46.990001 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 394/802] 10.222.0.117 () {56 vars in 1137 bytes} [Tue Jan 25 02:23:46 2022] GET /identity/v3/services/network => generated 88 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:23:46.996473 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee1e63c-d29a-473e-aea0-2cc6ac02f51a None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:47.006081 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee1e63c-d29a-473e-aea0-2cc6ac02f51a None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:47.015040 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb53b6d-965e-45c4-b607-13a29733966c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:47.016021 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb53b6d-965e-45c4-b607-13a29733966c admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:47.016564 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb53b6d-965e-45c4-b607-13a29733966c admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:47.017049 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb53b6d-965e-45c4-b607-13a29733966c admin admin] PATH_INFO: `/v3/services` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:47.018032 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb53b6d-965e-45c4-b607-13a29733966c admin admin] RBAC: Adding query filter params (name=network) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:47.018567 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb53b6d-965e-45c4-b607-13a29733966c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:47.020479 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb53b6d-965e-45c4-b607-13a29733966c admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:47.025906 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 409/803] 10.222.0.117 () {56 vars in 1138 bytes} [Tue Jan 25 02:23:46 2022] GET /identity/v3/services?name=network => generated 125 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:47.031737 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117d9d98-2d2e-47e5-9f4b-9154ea91e367 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:47.042155 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117d9d98-2d2e-47e5-9f4b-9154ea91e367 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:47.052877 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5216bb3c-252b-4221-8730-59985322bdc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:47.053543 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5216bb3c-252b-4221-8730-59985322bdc4 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:47.053829 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5216bb3c-252b-4221-8730-59985322bdc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:47.054112 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5216bb3c-252b-4221-8730-59985322bdc4 admin admin] PATH_INFO: `/v3/services` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:47.054840 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5216bb3c-252b-4221-8730-59985322bdc4 admin admin] RBAC: Adding query filter params (type=network) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:47.055176 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5216bb3c-252b-4221-8730-59985322bdc4 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:47.056779 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5216bb3c-252b-4221-8730-59985322bdc4 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:47.069016 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 395/804] 10.222.0.117 () {56 vars in 1138 bytes} [Tue Jan 25 02:23:47 2022] GET /identity/v3/services?type=network => generated 352 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:47.075186 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb53b6d-965e-45c4-b607-13a29733966c admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:47.089190 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb53b6d-965e-45c4-b607-13a29733966c admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:47.099856 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419f98a5-5825-40b3-aeb4-64479d90aafc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:47.100516 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419f98a5-5825-40b3-aeb4-64479d90aafc admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:47.100801 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419f98a5-5825-40b3-aeb4-64479d90aafc admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:47.101079 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419f98a5-5825-40b3-aeb4-64479d90aafc admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:47.101896 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419f98a5-5825-40b3-aeb4-64479d90aafc admin admin] RBAC: Adding query filter params (interface=public, service_id=934f6f5b67ea4681bc4a7ffa095daa05, region_id=RegionOne) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:47.102209 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419f98a5-5825-40b3-aeb4-64479d90aafc admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:47.103864 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419f98a5-5825-40b3-aeb4-64479d90aafc admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:47.116596 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 410/805] 10.222.0.117 () {56 vars in 1277 bytes} [Tue Jan 25 02:23:47 2022] GET /identity/v3/endpoints?service_id=934f6f5b67ea4681bc4a7ffa095daa05&interface=public®ion_id=RegionOne => generated 195 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:47.122251 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5216bb3c-252b-4221-8730-59985322bdc4 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:47.137225 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5216bb3c-252b-4221-8730-59985322bdc4 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:47.147838 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392b3316-732d-4ddf-9663-4b0d3b544b34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:47.148496 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392b3316-732d-4ddf-9663-4b0d3b544b34 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:47.148785 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392b3316-732d-4ddf-9663-4b0d3b544b34 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:47.149065 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392b3316-732d-4ddf-9663-4b0d3b544b34 admin admin] PATH_INFO: `/v3/services` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:47.149762 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392b3316-732d-4ddf-9663-4b0d3b544b34 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:47.152093 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392b3316-732d-4ddf-9663-4b0d3b544b34 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:47.160240 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 396/806] 10.222.0.117 () {56 vars in 1113 bytes} [Tue Jan 25 02:23:47 2022] GET /identity/v3/services => generated 776 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:47.285865 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c83e77b-79c1-4a95-b9ed-681d29174c80 None None] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:47.286382 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c83e77b-79c1-4a95-b9ed-681d29174c80 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:47.286457 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c83e77b-79c1-4a95-b9ed-681d29174c80 None None] PATH_INFO: `/` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:47.288267 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 411/807] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:23:47 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jan 25 02:23:47.294226 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c1f41c-dc86-4bc8-b53e-9f2b7e836b57 None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:47.294837 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c1f41c-dc86-4bc8-b53e-9f2b7e836b57 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:47.294837 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c1f41c-dc86-4bc8-b53e-9f2b7e836b57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:47.319272 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-97c1f41c-dc86-4bc8-b53e-9f2b7e836b57 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:23:47.320504 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-97c1f41c-dc86-4bc8-b53e-9f2b7e836b57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:23:47.334199 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 397/808] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:23:47 2022] POST /identity/v3/auth/tokens => generated 1118 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:23:47.366226 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c83e77b-79c1-4a95-b9ed-681d29174c80 None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:47.381645 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c83e77b-79c1-4a95-b9ed-681d29174c80 None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:47.388327 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e4c68c-6d52-4fef-b60f-aba615282484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:47.389125 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e4c68c-6d52-4fef-b60f-aba615282484 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:47.389420 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e4c68c-6d52-4fef-b60f-aba615282484 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:47.389687 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e4c68c-6d52-4fef-b60f-aba615282484 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:47.405194 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e4c68c-6d52-4fef-b60f-aba615282484 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 25 02:23:47.412103 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: WARNING keystone.server.flask.application [None req-12e4c68c-6d52-4fef-b60f-aba615282484 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 25 02:23:47.413610 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 412/809] 10.222.0.117 () {56 vars in 1122 bytes} [Tue Jan 25 02:23:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:23:47.420437 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c1f41c-dc86-4bc8-b53e-9f2b7e836b57 None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:47.431465 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c1f41c-dc86-4bc8-b53e-9f2b7e836b57 None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:47.437103 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c04862a-d3b5-46a8-904d-20d11fdcd687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:47.437781 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c04862a-d3b5-46a8-904d-20d11fdcd687 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:47.438071 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c04862a-d3b5-46a8-904d-20d11fdcd687 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:47.438354 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c04862a-d3b5-46a8-904d-20d11fdcd687 admin admin] PATH_INFO: `/v3/roles` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:47.439133 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c04862a-d3b5-46a8-904d-20d11fdcd687 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:47.439441 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c04862a-d3b5-46a8-904d-20d11fdcd687 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:47.441105 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c04862a-d3b5-46a8-904d-20d11fdcd687 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:47.451328 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 398/810] 10.222.0.117 () {56 vars in 1125 bytes} [Tue Jan 25 02:23:47 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:47.456474 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e4c68c-6d52-4fef-b60f-aba615282484 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:47.469030 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e4c68c-6d52-4fef-b60f-aba615282484 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:47.475036 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42385130-53c4-4570-a146-915cbce526c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:47.475860 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42385130-53c4-4570-a146-915cbce526c5 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:47.476138 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42385130-53c4-4570-a146-915cbce526c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:47.476411 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42385130-53c4-4570-a146-915cbce526c5 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:47.497192 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42385130-53c4-4570-a146-915cbce526c5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:47.499070 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42385130-53c4-4570-a146-915cbce526c5 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:47.524063 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: WARNING keystone.server.flask.application [None req-42385130-53c4-4570-a146-915cbce526c5 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 25 02:23:47.525573 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 413/811] 10.222.0.117 () {56 vars in 1134 bytes} [Tue Jan 25 02:23:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:23:47.532039 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c04862a-d3b5-46a8-904d-20d11fdcd687 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:47.548889 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c04862a-d3b5-46a8-904d-20d11fdcd687 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:47.557543 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3333e25d-d868-41c4-8af0-6f97da71f9d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:47.558188 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3333e25d-d868-41c4-8af0-6f97da71f9d4 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:47.558578 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3333e25d-d868-41c4-8af0-6f97da71f9d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:47.558907 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3333e25d-d868-41c4-8af0-6f97da71f9d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:47.559665 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3333e25d-d868-41c4-8af0-6f97da71f9d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:47.560012 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3333e25d-d868-41c4-8af0-6f97da71f9d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:47.561673 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3333e25d-d868-41c4-8af0-6f97da71f9d4 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:47.575020 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 399/812] 10.222.0.117 () {56 vars in 1135 bytes} [Tue Jan 25 02:23:47 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:47.580145 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42385130-53c4-4570-a146-915cbce526c5 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:47.600965 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42385130-53c4-4570-a146-915cbce526c5 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:47.612407 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbe2c16-1085-493a-a844-4fd709ac91ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:47.613380 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbe2c16-1085-493a-a844-4fd709ac91ad admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:47.613668 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbe2c16-1085-493a-a844-4fd709ac91ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:47.613941 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbe2c16-1085-493a-a844-4fd709ac91ad admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:47.624880 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbe2c16-1085-493a-a844-4fd709ac91ad admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:47.626940 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbe2c16-1085-493a-a844-4fd709ac91ad admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:47.651810 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: WARNING keystone.server.flask.application [None req-edbe2c16-1085-493a-a844-4fd709ac91ad admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jan 25 02:23:47.659813 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 414/813] 10.222.0.117 () {56 vars in 1122 bytes} [Tue Jan 25 02:23:47 2022] GET /identity/v3/users/swift => generated 83 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:23:47.661600 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3333e25d-d868-41c4-8af0-6f97da71f9d4 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:47.686640 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3333e25d-d868-41c4-8af0-6f97da71f9d4 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:47.692017 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d76efd-cadb-4a2b-b13b-756b9c9a3553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:47.692691 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d76efd-cadb-4a2b-b13b-756b9c9a3553 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:47.693026 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d76efd-cadb-4a2b-b13b-756b9c9a3553 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:47.693384 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d76efd-cadb-4a2b-b13b-756b9c9a3553 admin admin] PATH_INFO: `/v3/users` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:47.694408 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d76efd-cadb-4a2b-b13b-756b9c9a3553 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:47.694593 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d76efd-cadb-4a2b-b13b-756b9c9a3553 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:47.696668 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d76efd-cadb-4a2b-b13b-756b9c9a3553 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:47.726977 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 400/814] 10.222.0.117 () {56 vars in 1161 bytes} [Tue Jan 25 02:23:47 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 372 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:47.733796 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbe2c16-1085-493a-a844-4fd709ac91ad admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:47.744558 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbe2c16-1085-493a-a844-4fd709ac91ad admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:47.755947 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea45c604-d07b-4d78-ad37-05921d3504ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:47.756742 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea45c604-d07b-4d78-ad37-05921d3504ce admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:47.757022 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea45c604-d07b-4d78-ad37-05921d3504ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:47.757298 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea45c604-d07b-4d78-ad37-05921d3504ce admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:47.776860 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea45c604-d07b-4d78-ad37-05921d3504ce admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:47.778742 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea45c604-d07b-4d78-ad37-05921d3504ce admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:47.802343 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: WARNING keystone.server.flask.application [None req-ea45c604-d07b-4d78-ad37-05921d3504ce admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 25 02:23:47.803874 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 415/815] 10.222.0.117 () {56 vars in 1134 bytes} [Tue Jan 25 02:23:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:23:47.810577 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d76efd-cadb-4a2b-b13b-756b9c9a3553 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:47.824373 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d76efd-cadb-4a2b-b13b-756b9c9a3553 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:47.834174 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18079b97-51c4-4944-90fc-de9f679773d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:47.834844 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18079b97-51c4-4944-90fc-de9f679773d2 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:47.835126 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18079b97-51c4-4944-90fc-de9f679773d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:47.835401 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18079b97-51c4-4944-90fc-de9f679773d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:47.836164 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18079b97-51c4-4944-90fc-de9f679773d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:47.836469 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18079b97-51c4-4944-90fc-de9f679773d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:47.838068 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18079b97-51c4-4944-90fc-de9f679773d2 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:47.857268 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 401/816] 10.222.0.117 () {56 vars in 1135 bytes} [Tue Jan 25 02:23:47 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:47.862800 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea45c604-d07b-4d78-ad37-05921d3504ce admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:47.876097 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea45c604-d07b-4d78-ad37-05921d3504ce admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:47.884852 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a71dcd-a08a-4c98-9ef8-1b6905b1e90f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:47.885678 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a71dcd-a08a-4c98-9ef8-1b6905b1e90f admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:47.885951 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a71dcd-a08a-4c98-9ef8-1b6905b1e90f admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:47.886386 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a71dcd-a08a-4c98-9ef8-1b6905b1e90f admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:47.896764 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a71dcd-a08a-4c98-9ef8-1b6905b1e90f admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:47.898759 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a71dcd-a08a-4c98-9ef8-1b6905b1e90f admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:47.915156 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: WARNING keystone.server.flask.application [None req-82a71dcd-a08a-4c98-9ef8-1b6905b1e90f admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 25 02:23:47.916377 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 416/817] 10.222.0.117 () {56 vars in 1137 bytes} [Tue Jan 25 02:23:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:23:47.922973 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18079b97-51c4-4944-90fc-de9f679773d2 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:47.937706 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18079b97-51c4-4944-90fc-de9f679773d2 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:47.948346 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca9efde-7322-4074-9439-8079d488fb67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:47.949021 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca9efde-7322-4074-9439-8079d488fb67 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:47.949304 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca9efde-7322-4074-9439-8079d488fb67 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:47.949587 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca9efde-7322-4074-9439-8079d488fb67 admin admin] PATH_INFO: `/v3/projects` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:47.953521 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca9efde-7322-4074-9439-8079d488fb67 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:47.953521 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca9efde-7322-4074-9439-8079d488fb67 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:47.953521 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca9efde-7322-4074-9439-8079d488fb67 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:47.966872 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 402/818] 10.222.0.117 () {56 vars in 1174 bytes} [Tue Jan 25 02:23:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:47.974013 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a71dcd-a08a-4c98-9ef8-1b6905b1e90f admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:47.992771 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a71dcd-a08a-4c98-9ef8-1b6905b1e90f admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:48.001167 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2002d8-53cc-467c-bb25-64043a176c9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:48.002042 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2002d8-53cc-467c-bb25-64043a176c9d admin admin] REQUEST_METHOD: `PUT` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:48.002319 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2002d8-53cc-467c-bb25-64043a176c9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:48.002593 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2002d8-53cc-467c-bb25-64043a176c9d admin admin] PATH_INFO: `/v3/projects/61a6fe9d4c914755bb0a64c392bd16aa/users/100f12ee56754f1c859106bf3e473df6/roles/d8dbc6d83d9d41d28c3feb8b3485b291` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:48.004626 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2002d8-53cc-467c-bb25-64043a176c9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=61a6fe9d4c914755bb0a64c392bd16aa, user_id=100f12ee56754f1c859106bf3e473df6, role_id=d8dbc6d83d9d41d28c3feb8b3485b291)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:48.007243 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2002d8-53cc-467c-bb25-64043a176c9d admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:48.031490 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 417/819] 10.222.0.117 () {58 vars in 1465 bytes} [Tue Jan 25 02:23:47 2022] PUT /identity/v3/projects/61a6fe9d4c914755bb0a64c392bd16aa/users/100f12ee56754f1c859106bf3e473df6/roles/d8dbc6d83d9d41d28c3feb8b3485b291 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:23:48.545261 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d61094d-3c9e-4571-889e-c40211e51087 None None] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:48.545261 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d61094d-3c9e-4571-889e-c40211e51087 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:48.545261 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d61094d-3c9e-4571-889e-c40211e51087 None None] PATH_INFO: `/` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:48.546560 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 403/820] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:23:48 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:23:48.550643 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c444ad-113a-47ae-b875-40356698a66c None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:48.551443 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c444ad-113a-47ae-b875-40356698a66c None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:48.551947 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c444ad-113a-47ae-b875-40356698a66c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:48.576746 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-07c444ad-113a-47ae-b875-40356698a66c None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:23:48.578334 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-07c444ad-113a-47ae-b875-40356698a66c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:23:48.661399 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 418/821] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:23:48 2022] POST /identity/v3/auth/tokens => generated 1118 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:23:48.709173 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d61094d-3c9e-4571-889e-c40211e51087 None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:48.724903 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d61094d-3c9e-4571-889e-c40211e51087 None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:48.730977 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6dcd06-3c77-4075-9cfd-452510ff6a42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:48.732075 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6dcd06-3c77-4075-9cfd-452510ff6a42 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:48.732575 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6dcd06-3c77-4075-9cfd-452510ff6a42 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:48.733046 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6dcd06-3c77-4075-9cfd-452510ff6a42 admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:48.733993 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6dcd06-3c77-4075-9cfd-452510ff6a42 admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:48.735889 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6dcd06-3c77-4075-9cfd-452510ff6a42 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:48.751888 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: WARNING keystone.server.flask.application [None req-fa6dcd06-3c77-4075-9cfd-452510ff6a42 admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jan 25 02:23:48.758921 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 404/822] 10.222.0.117 () {56 vars in 1155 bytes} [Tue Jan 25 02:23:48 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:23:48.760453 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c444ad-113a-47ae-b875-40356698a66c None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:48.775724 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c444ad-113a-47ae-b875-40356698a66c None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:48.788831 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3406f7c-4495-4b7d-bfd4-7829fcbd2754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:48.789880 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3406f7c-4495-4b7d-bfd4-7829fcbd2754 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:48.790367 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3406f7c-4495-4b7d-bfd4-7829fcbd2754 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:48.790865 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3406f7c-4495-4b7d-bfd4-7829fcbd2754 admin admin] PATH_INFO: `/v3/services` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:48.792433 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3406f7c-4495-4b7d-bfd4-7829fcbd2754 admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:48.793174 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3406f7c-4495-4b7d-bfd4-7829fcbd2754 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:48.795049 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3406f7c-4495-4b7d-bfd4-7829fcbd2754 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:48.803821 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 419/823] 10.222.0.117 () {56 vars in 1150 bytes} [Tue Jan 25 02:23:48 2022] GET /identity/v3/services?name=block-storage => generated 131 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:48.809527 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6dcd06-3c77-4075-9cfd-452510ff6a42 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:48.824102 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6dcd06-3c77-4075-9cfd-452510ff6a42 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:48.832109 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224c39d5-c7e8-47f8-86fc-8c03e58da812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:48.832787 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224c39d5-c7e8-47f8-86fc-8c03e58da812 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:48.833065 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224c39d5-c7e8-47f8-86fc-8c03e58da812 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:48.833340 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224c39d5-c7e8-47f8-86fc-8c03e58da812 admin admin] PATH_INFO: `/v3/services` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:48.834069 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224c39d5-c7e8-47f8-86fc-8c03e58da812 admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:48.834376 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224c39d5-c7e8-47f8-86fc-8c03e58da812 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:48.836006 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224c39d5-c7e8-47f8-86fc-8c03e58da812 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:48.845523 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 405/824] 10.222.0.117 () {56 vars in 1150 bytes} [Tue Jan 25 02:23:48 2022] GET /identity/v3/services?type=block-storage => generated 369 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:48.851120 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3406f7c-4495-4b7d-bfd4-7829fcbd2754 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:48.865532 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3406f7c-4495-4b7d-bfd4-7829fcbd2754 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:48.872738 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4941c258-6b87-4682-bd2e-84eb53ef6d86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:48.873391 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4941c258-6b87-4682-bd2e-84eb53ef6d86 admin admin] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:48.873676 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4941c258-6b87-4682-bd2e-84eb53ef6d86 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:48.873951 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4941c258-6b87-4682-bd2e-84eb53ef6d86 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:48.874719 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4941c258-6b87-4682-bd2e-84eb53ef6d86 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:48.875788 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: WARNING py.warnings [None req-4941c258-6b87-4682-bd2e-84eb53ef6d86 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 25 02:23:48.875788 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: warnings.warn(msg) Jan 25 02:23:48.875788 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: Jan 25 02:23:48.876801 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4941c258-6b87-4682-bd2e-84eb53ef6d86 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:48.911105 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 420/825] 10.222.0.117 () {60 vars in 1170 bytes} [Tue Jan 25 02:23:48 2022] POST /identity/v3/endpoints => generated 348 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 25 02:23:49.040858 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f63c1a-b957-420c-b609-046a96867bdf None None] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:49.041218 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f63c1a-b957-420c-b609-046a96867bdf None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:49.041414 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f63c1a-b957-420c-b609-046a96867bdf None None] PATH_INFO: `/` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:49.044258 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 406/826] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:23:49 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:23:49.049547 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4405cf4-f62a-4f5c-9605-2f10bc557b96 None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:49.049833 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4405cf4-f62a-4f5c-9605-2f10bc557b96 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:49.050111 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4405cf4-f62a-4f5c-9605-2f10bc557b96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:49.076842 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-f4405cf4-f62a-4f5c-9605-2f10bc557b96 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:23:49.077985 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-f4405cf4-f62a-4f5c-9605-2f10bc557b96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:23:49.096209 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 421/827] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:23:49 2022] POST /identity/v3/auth/tokens => generated 1305 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:23:49.124412 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f63c1a-b957-420c-b609-046a96867bdf None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:49.140464 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f63c1a-b957-420c-b609-046a96867bdf None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:49.147180 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ee498b-ab48-4bc9-9452-1f8c6dfbafaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:49.148007 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ee498b-ab48-4bc9-9452-1f8c6dfbafaf admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:49.148286 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ee498b-ab48-4bc9-9452-1f8c6dfbafaf admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:49.148554 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ee498b-ab48-4bc9-9452-1f8c6dfbafaf admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:49.166263 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ee498b-ab48-4bc9-9452-1f8c6dfbafaf admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 25 02:23:49.174353 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: WARNING keystone.server.flask.application [None req-b1ee498b-ab48-4bc9-9452-1f8c6dfbafaf admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 25 02:23:49.180974 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 407/828] 10.222.0.117 () {56 vars in 1128 bytes} [Tue Jan 25 02:23:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:23:49.181411 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4405cf4-f62a-4f5c-9605-2f10bc557b96 None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:49.195522 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4405cf4-f62a-4f5c-9605-2f10bc557b96 None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:49.201456 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d60772-1e80-4bc0-9855-0e3ba728476c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:49.202158 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d60772-1e80-4bc0-9855-0e3ba728476c admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:49.202449 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d60772-1e80-4bc0-9855-0e3ba728476c admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:49.202725 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d60772-1e80-4bc0-9855-0e3ba728476c admin admin] PATH_INFO: `/v3/roles` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:49.203543 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d60772-1e80-4bc0-9855-0e3ba728476c admin admin] RBAC: Adding query filter params (name=service) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:49.203897 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d60772-1e80-4bc0-9855-0e3ba728476c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:49.205567 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d60772-1e80-4bc0-9855-0e3ba728476c admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:49.216633 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 422/829] 10.222.0.117 () {56 vars in 1129 bytes} [Tue Jan 25 02:23:49 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 02:23:49.222484 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ee498b-ab48-4bc9-9452-1f8c6dfbafaf admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:49.233742 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ee498b-ab48-4bc9-9452-1f8c6dfbafaf admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:49.238356 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b0b753-51be-4b0b-bfd4-28e055310097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:49.239198 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b0b753-51be-4b0b-bfd4-28e055310097 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:49.239527 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b0b753-51be-4b0b-bfd4-28e055310097 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:49.239839 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b0b753-51be-4b0b-bfd4-28e055310097 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:49.258921 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b0b753-51be-4b0b-bfd4-28e055310097 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:49.261556 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b0b753-51be-4b0b-bfd4-28e055310097 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:49.281827 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: WARNING keystone.server.flask.application [None req-f7b0b753-51be-4b0b-bfd4-28e055310097 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 25 02:23:49.283091 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 408/830] 10.222.0.117 () {56 vars in 1134 bytes} [Tue Jan 25 02:23:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:23:49.288882 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d60772-1e80-4bc0-9855-0e3ba728476c admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:49.300344 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d60772-1e80-4bc0-9855-0e3ba728476c admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:49.308633 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e27bc1-97c7-48af-a5b9-02c786c5a547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:49.309348 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e27bc1-97c7-48af-a5b9-02c786c5a547 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:49.309629 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e27bc1-97c7-48af-a5b9-02c786c5a547 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:49.309899 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e27bc1-97c7-48af-a5b9-02c786c5a547 admin admin] PATH_INFO: `/v3/domains` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:49.310690 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e27bc1-97c7-48af-a5b9-02c786c5a547 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:49.310991 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e27bc1-97c7-48af-a5b9-02c786c5a547 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:49.316793 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e27bc1-97c7-48af-a5b9-02c786c5a547 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:49.335798 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 423/831] 10.222.0.117 () {56 vars in 1135 bytes} [Tue Jan 25 02:23:49 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:49.341880 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b0b753-51be-4b0b-bfd4-28e055310097 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:49.357858 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b0b753-51be-4b0b-bfd4-28e055310097 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:49.365765 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc3c9a4-09f8-4c87-b02d-a67a8f83200d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:49.366577 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc3c9a4-09f8-4c87-b02d-a67a8f83200d admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:49.366861 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc3c9a4-09f8-4c87-b02d-a67a8f83200d admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:49.367137 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc3c9a4-09f8-4c87-b02d-a67a8f83200d admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:49.379353 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc3c9a4-09f8-4c87-b02d-a67a8f83200d admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:49.381474 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc3c9a4-09f8-4c87-b02d-a67a8f83200d admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:49.404630 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: WARNING keystone.server.flask.application [None req-9cc3c9a4-09f8-4c87-b02d-a67a8f83200d admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jan 25 02:23:49.406032 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 409/832] 10.222.0.117 () {56 vars in 1143 bytes} [Tue Jan 25 02:23:49 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:23:49.411407 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e27bc1-97c7-48af-a5b9-02c786c5a547 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:49.425760 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e27bc1-97c7-48af-a5b9-02c786c5a547 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:49.436168 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6d183a-8c70-4b1d-bd66-bbbabef2599b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:49.436895 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6d183a-8c70-4b1d-bd66-bbbabef2599b admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:49.437174 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6d183a-8c70-4b1d-bd66-bbbabef2599b admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:49.437448 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6d183a-8c70-4b1d-bd66-bbbabef2599b admin admin] PATH_INFO: `/v3/users` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:49.438340 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6d183a-8c70-4b1d-bd66-bbbabef2599b admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:49.438644 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6d183a-8c70-4b1d-bd66-bbbabef2599b admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:49.440637 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6d183a-8c70-4b1d-bd66-bbbabef2599b admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:49.467984 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 424/833] 10.222.0.117 () {56 vars in 1175 bytes} [Tue Jan 25 02:23:49 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 386 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:49.476969 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc3c9a4-09f8-4c87-b02d-a67a8f83200d admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:49.494116 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc3c9a4-09f8-4c87-b02d-a67a8f83200d admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:49.506708 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b6b484-1c0e-47e5-811e-cf1f1c0ccc2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:49.507381 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b6b484-1c0e-47e5-811e-cf1f1c0ccc2b admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:49.507667 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b6b484-1c0e-47e5-811e-cf1f1c0ccc2b admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:49.507971 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b6b484-1c0e-47e5-811e-cf1f1c0ccc2b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:49.519959 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b6b484-1c0e-47e5-811e-cf1f1c0ccc2b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:49.521728 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b6b484-1c0e-47e5-811e-cf1f1c0ccc2b admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:49.535654 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 410/834] 10.222.0.117 () {58 vars in 1329 bytes} [Tue Jan 25 02:23:49 2022] GET /identity/v3/auth/tokens => generated 1305 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:23:49.541344 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6d183a-8c70-4b1d-bd66-bbbabef2599b admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:49.553908 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6d183a-8c70-4b1d-bd66-bbbabef2599b admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:49.563927 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736ba6b5-9b4c-47d9-8254-a8b02a9d0e7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:49.564815 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736ba6b5-9b4c-47d9-8254-a8b02a9d0e7a admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:49.565094 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736ba6b5-9b4c-47d9-8254-a8b02a9d0e7a admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:49.565365 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736ba6b5-9b4c-47d9-8254-a8b02a9d0e7a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:49.584835 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736ba6b5-9b4c-47d9-8254-a8b02a9d0e7a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:49.586831 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736ba6b5-9b4c-47d9-8254-a8b02a9d0e7a admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:49.611549 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: WARNING keystone.server.flask.application [None req-736ba6b5-9b4c-47d9-8254-a8b02a9d0e7a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 25 02:23:49.612002 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f199e435-a5fd-4852-9c0b-872e2c7aae46 None None] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:49.612504 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f199e435-a5fd-4852-9c0b-872e2c7aae46 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:49.612681 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f199e435-a5fd-4852-9c0b-872e2c7aae46 None None] PATH_INFO: `/` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:49.613046 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 425/835] 10.222.0.117 () {56 vars in 1134 bytes} [Tue Jan 25 02:23:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:23:49.614304 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 411/836] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:23:49 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jan 25 02:23:49.619161 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a65a0d-5b28-46af-b876-d22f07eec4a5 None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:49.619442 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a65a0d-5b28-46af-b876-d22f07eec4a5 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:49.620316 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a65a0d-5b28-46af-b876-d22f07eec4a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:49.622724 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736ba6b5-9b4c-47d9-8254-a8b02a9d0e7a admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:49.638934 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736ba6b5-9b4c-47d9-8254-a8b02a9d0e7a admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:49.648965 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87baad59-0466-46f5-8322-a78b4b8a9b46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:49.650117 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87baad59-0466-46f5-8322-a78b4b8a9b46 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:49.650415 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87baad59-0466-46f5-8322-a78b4b8a9b46 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:49.650696 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87baad59-0466-46f5-8322-a78b4b8a9b46 admin admin] PATH_INFO: `/v3/domains` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:49.651502 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87baad59-0466-46f5-8322-a78b4b8a9b46 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:49.651836 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87baad59-0466-46f5-8322-a78b4b8a9b46 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:49.653494 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87baad59-0466-46f5-8322-a78b4b8a9b46 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:49.665865 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-a2a65a0d-5b28-46af-b876-d22f07eec4a5 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:23:49.667131 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-a2a65a0d-5b28-46af-b876-d22f07eec4a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:23:49.678482 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 426/837] 10.222.0.117 () {56 vars in 1135 bytes} [Tue Jan 25 02:23:49 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:49.688767 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87baad59-0466-46f5-8322-a78b4b8a9b46 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:49.698784 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 412/838] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:23:49 2022] POST /identity/v3/auth/tokens => generated 1305 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:23:49.705042 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87baad59-0466-46f5-8322-a78b4b8a9b46 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:49.716133 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af207854-1473-4937-9a0f-b17e4667f813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:49.716977 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af207854-1473-4937-9a0f-b17e4667f813 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:49.717261 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af207854-1473-4937-9a0f-b17e4667f813 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:49.717588 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af207854-1473-4937-9a0f-b17e4667f813 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:49.720865 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a65a0d-5b28-46af-b876-d22f07eec4a5 None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:49.732063 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a65a0d-5b28-46af-b876-d22f07eec4a5 None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:49.739517 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e02b6e-5432-4a16-a6ff-f235dc9b081a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:49.741237 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af207854-1473-4937-9a0f-b17e4667f813 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:49.742430 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e02b6e-5432-4a16-a6ff-f235dc9b081a admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:49.742715 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e02b6e-5432-4a16-a6ff-f235dc9b081a admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:49.742990 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e02b6e-5432-4a16-a6ff-f235dc9b081a admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:49.743656 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e02b6e-5432-4a16-a6ff-f235dc9b081a admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:49.746192 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af207854-1473-4937-9a0f-b17e4667f813 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:49.747768 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e02b6e-5432-4a16-a6ff-f235dc9b081a admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:49.771264 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: WARNING keystone.server.flask.application [None req-69e02b6e-5432-4a16-a6ff-f235dc9b081a admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jan 25 02:23:49.772529 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 413/839] 10.222.0.117 () {56 vars in 1158 bytes} [Tue Jan 25 02:23:49 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:23:49.774381 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: WARNING keystone.server.flask.application [None req-af207854-1473-4937-9a0f-b17e4667f813 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 25 02:23:49.775976 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 427/840] 10.222.0.117 () {56 vars in 1137 bytes} [Tue Jan 25 02:23:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 88 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:23:49.781656 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e02b6e-5432-4a16-a6ff-f235dc9b081a admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:49.782217 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af207854-1473-4937-9a0f-b17e4667f813 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:49.797952 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af207854-1473-4937-9a0f-b17e4667f813 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:49.799448 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e02b6e-5432-4a16-a6ff-f235dc9b081a admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:49.807830 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32934322-0151-4d22-b40b-57a6bf9d3c66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:49.808766 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3761284-9dad-4ad8-94dd-21aa14ed9c3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:49.809450 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3761284-9dad-4ad8-94dd-21aa14ed9c3a admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:49.809730 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3761284-9dad-4ad8-94dd-21aa14ed9c3a admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:49.810006 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3761284-9dad-4ad8-94dd-21aa14ed9c3a admin admin] PATH_INFO: `/v3/services` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:49.810745 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3761284-9dad-4ad8-94dd-21aa14ed9c3a admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:49.811050 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3761284-9dad-4ad8-94dd-21aa14ed9c3a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:49.812714 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3761284-9dad-4ad8-94dd-21aa14ed9c3a admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:49.814542 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32934322-0151-4d22-b40b-57a6bf9d3c66 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:49.814829 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32934322-0151-4d22-b40b-57a6bf9d3c66 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:49.815107 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32934322-0151-4d22-b40b-57a6bf9d3c66 admin admin] PATH_INFO: `/v3/projects` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:49.815940 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32934322-0151-4d22-b40b-57a6bf9d3c66 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:49.816249 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32934322-0151-4d22-b40b-57a6bf9d3c66 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:49.818076 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32934322-0151-4d22-b40b-57a6bf9d3c66 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:49.825460 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 428/841] 10.222.0.117 () {56 vars in 1152 bytes} [Tue Jan 25 02:23:49 2022] GET /identity/v3/services?name=compute_legacy => generated 132 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 02:23:49.840347 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 414/842] 10.222.0.117 () {56 vars in 1174 bytes} [Tue Jan 25 02:23:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:49.841754 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3761284-9dad-4ad8-94dd-21aa14ed9c3a admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:49.851811 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3761284-9dad-4ad8-94dd-21aa14ed9c3a admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:49.853297 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32934322-0151-4d22-b40b-57a6bf9d3c66 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:49.865365 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc6bc75-fb22-4568-aec5-d458ff421e04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:49.866029 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc6bc75-fb22-4568-aec5-d458ff421e04 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:49.866313 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc6bc75-fb22-4568-aec5-d458ff421e04 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:49.866588 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc6bc75-fb22-4568-aec5-d458ff421e04 admin admin] PATH_INFO: `/v3/services` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:49.867316 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc6bc75-fb22-4568-aec5-d458ff421e04 admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:49.867620 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc6bc75-fb22-4568-aec5-d458ff421e04 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:49.869262 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc6bc75-fb22-4568-aec5-d458ff421e04 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:49.872994 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32934322-0151-4d22-b40b-57a6bf9d3c66 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:49.878148 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 429/843] 10.222.0.117 () {56 vars in 1152 bytes} [Tue Jan 25 02:23:49 2022] GET /identity/v3/services?type=compute_legacy => generated 132 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:49.887261 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5cf7d9-675c-4e62-903a-4346a7c7f04b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:49.887957 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5cf7d9-675c-4e62-903a-4346a7c7f04b admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:49.888240 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5cf7d9-675c-4e62-903a-4346a7c7f04b admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:49.888517 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5cf7d9-675c-4e62-903a-4346a7c7f04b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:49.889367 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5cf7d9-675c-4e62-903a-4346a7c7f04b admin admin] RBAC: Adding query filter params (role.id=8e4691cb5a4b4439b9712d27ef133c20, scope.project.id=61a6fe9d4c914755bb0a64c392bd16aa, user.id=5924414ee6e948a680b8b75c8797b466) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:49.889676 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5cf7d9-675c-4e62-903a-4346a7c7f04b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:49.891532 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5cf7d9-675c-4e62-903a-4346a7c7f04b admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:49.899519 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 415/844] 10.222.0.117 () {56 vars in 1400 bytes} [Tue Jan 25 02:23:49 2022] GET /identity/v3/role_assignments?user.id=5924414ee6e948a680b8b75c8797b466&scope.project.id=61a6fe9d4c914755bb0a64c392bd16aa&role.id=8e4691cb5a4b4439b9712d27ef133c20 => generated 610 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:50.081439 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da024810-cf42-46f2-baf6-938cef39165f None None] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:50.081829 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da024810-cf42-46f2-baf6-938cef39165f None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:50.082016 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da024810-cf42-46f2-baf6-938cef39165f None None] PATH_INFO: `/` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:50.083991 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 430/845] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:23:50 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:23:50.090027 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5069e5-7dff-4e7c-add0-df4ae9ef4fbb None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:50.090331 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5069e5-7dff-4e7c-add0-df4ae9ef4fbb None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:50.090613 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5069e5-7dff-4e7c-add0-df4ae9ef4fbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:50.115195 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-3d5069e5-7dff-4e7c-add0-df4ae9ef4fbb None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:23:50.116461 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-3d5069e5-7dff-4e7c-add0-df4ae9ef4fbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:23:50.127417 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 416/846] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:23:50 2022] POST /identity/v3/auth/tokens => generated 1305 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:23:50.151456 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da024810-cf42-46f2-baf6-938cef39165f None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:50.167244 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da024810-cf42-46f2-baf6-938cef39165f None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:50.173181 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d7d3fa-bd1a-4839-8905-2c029a4c7300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:50.173981 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d7d3fa-bd1a-4839-8905-2c029a4c7300 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:50.174321 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d7d3fa-bd1a-4839-8905-2c029a4c7300 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:50.174603 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d7d3fa-bd1a-4839-8905-2c029a4c7300 admin admin] PATH_INFO: `/v3/services/network` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:50.175282 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d7d3fa-bd1a-4839-8905-2c029a4c7300 admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:50.176996 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d7d3fa-bd1a-4839-8905-2c029a4c7300 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:50.191181 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: WARNING keystone.server.flask.application [None req-36d7d3fa-bd1a-4839-8905-2c029a4c7300 admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jan 25 02:23:50.193310 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 431/847] 10.222.0.117 () {56 vars in 1137 bytes} [Tue Jan 25 02:23:50 2022] GET /identity/v3/services/network => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:23:50.199322 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5069e5-7dff-4e7c-add0-df4ae9ef4fbb None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:50.208742 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5069e5-7dff-4e7c-add0-df4ae9ef4fbb None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:50.220413 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbb0cb5-01a7-4bed-9fc3-64d3cc8a3e7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:50.221092 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbb0cb5-01a7-4bed-9fc3-64d3cc8a3e7e admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:50.221375 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbb0cb5-01a7-4bed-9fc3-64d3cc8a3e7e admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:50.221648 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbb0cb5-01a7-4bed-9fc3-64d3cc8a3e7e admin admin] PATH_INFO: `/v3/services` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:50.222379 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbb0cb5-01a7-4bed-9fc3-64d3cc8a3e7e admin admin] RBAC: Adding query filter params (name=network) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:50.222687 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbb0cb5-01a7-4bed-9fc3-64d3cc8a3e7e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:50.224445 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbb0cb5-01a7-4bed-9fc3-64d3cc8a3e7e admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:50.230549 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 417/848] 10.222.0.117 () {56 vars in 1138 bytes} [Tue Jan 25 02:23:50 2022] GET /identity/v3/services?name=network => generated 125 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:50.236819 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d7d3fa-bd1a-4839-8905-2c029a4c7300 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:50.248841 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d7d3fa-bd1a-4839-8905-2c029a4c7300 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:50.253745 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18a63ba-121c-4a27-8e2b-f32371f46dc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:50.254642 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18a63ba-121c-4a27-8e2b-f32371f46dc4 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:50.255132 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18a63ba-121c-4a27-8e2b-f32371f46dc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:50.255613 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18a63ba-121c-4a27-8e2b-f32371f46dc4 admin admin] PATH_INFO: `/v3/services` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:50.256658 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18a63ba-121c-4a27-8e2b-f32371f46dc4 admin admin] RBAC: Adding query filter params (type=network) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:50.257168 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18a63ba-121c-4a27-8e2b-f32371f46dc4 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:50.258982 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18a63ba-121c-4a27-8e2b-f32371f46dc4 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:50.265424 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 432/849] 10.222.0.117 () {56 vars in 1138 bytes} [Tue Jan 25 02:23:50 2022] GET /identity/v3/services?type=network => generated 352 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 02:23:50.271034 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbb0cb5-01a7-4bed-9fc3-64d3cc8a3e7e admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:50.282793 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbb0cb5-01a7-4bed-9fc3-64d3cc8a3e7e admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:50.287938 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7df5e61-671d-4080-9470-d660e296280d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:50.288879 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7df5e61-671d-4080-9470-d660e296280d admin admin] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:50.289421 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7df5e61-671d-4080-9470-d660e296280d admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:50.289949 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7df5e61-671d-4080-9470-d660e296280d admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:50.290971 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7df5e61-671d-4080-9470-d660e296280d admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:50.293188 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: WARNING py.warnings [None req-c7df5e61-671d-4080-9470-d660e296280d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 25 02:23:50.293188 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: warnings.warn(msg) Jan 25 02:23:50.293188 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: Jan 25 02:23:50.294569 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7df5e61-671d-4080-9470-d660e296280d admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:50.321072 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 418/850] 10.222.0.117 () {60 vars in 1170 bytes} [Tue Jan 25 02:23:50 2022] POST /identity/v3/endpoints => generated 329 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 02:23:50.735205 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca74b6a0-4352-4b78-9214-a425c33f2a6a None None] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:50.735732 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca74b6a0-4352-4b78-9214-a425c33f2a6a None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:50.735814 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca74b6a0-4352-4b78-9214-a425c33f2a6a None None] PATH_INFO: `/` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:50.737747 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 433/851] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:23:50 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:23:50.743279 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651491b2-dbdd-4a34-af59-865c5a899dc2 None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:50.743680 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651491b2-dbdd-4a34-af59-865c5a899dc2 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:50.743909 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651491b2-dbdd-4a34-af59-865c5a899dc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:50.765656 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-651491b2-dbdd-4a34-af59-865c5a899dc2 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:23:50.766837 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-651491b2-dbdd-4a34-af59-865c5a899dc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:23:50.800413 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 419/852] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:23:50 2022] POST /identity/v3/auth/tokens => generated 1455 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 25 02:23:50.825817 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca74b6a0-4352-4b78-9214-a425c33f2a6a None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:50.839855 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca74b6a0-4352-4b78-9214-a425c33f2a6a None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:50.846941 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27fd298-4115-4371-a51a-8c0627b008b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:50.848041 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27fd298-4115-4371-a51a-8c0627b008b6 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:50.848560 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27fd298-4115-4371-a51a-8c0627b008b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:50.849057 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27fd298-4115-4371-a51a-8c0627b008b6 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:50.862969 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27fd298-4115-4371-a51a-8c0627b008b6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 25 02:23:50.870149 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: WARNING keystone.server.flask.application [None req-a27fd298-4115-4371-a51a-8c0627b008b6 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 25 02:23:50.871567 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 434/853] 10.222.0.117 () {56 vars in 1122 bytes} [Tue Jan 25 02:23:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:23:50.879766 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651491b2-dbdd-4a34-af59-865c5a899dc2 None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:50.890177 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651491b2-dbdd-4a34-af59-865c5a899dc2 None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:50.895098 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925a83d6-d394-4ec7-aaa4-5226b1fabaa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:50.895794 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925a83d6-d394-4ec7-aaa4-5226b1fabaa9 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:50.896576 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925a83d6-d394-4ec7-aaa4-5226b1fabaa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:50.896576 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925a83d6-d394-4ec7-aaa4-5226b1fabaa9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:50.897124 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925a83d6-d394-4ec7-aaa4-5226b1fabaa9 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:50.897443 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925a83d6-d394-4ec7-aaa4-5226b1fabaa9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:50.899181 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925a83d6-d394-4ec7-aaa4-5226b1fabaa9 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:50.914361 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 420/854] 10.222.0.117 () {56 vars in 1125 bytes} [Tue Jan 25 02:23:50 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:50.920746 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27fd298-4115-4371-a51a-8c0627b008b6 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:50.931221 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27fd298-4115-4371-a51a-8c0627b008b6 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:50.938132 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd67c5cc-2d4d-404c-b9df-931b70a53687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:50.939015 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd67c5cc-2d4d-404c-b9df-931b70a53687 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:50.939297 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd67c5cc-2d4d-404c-b9df-931b70a53687 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:50.939566 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd67c5cc-2d4d-404c-b9df-931b70a53687 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:50.950394 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd67c5cc-2d4d-404c-b9df-931b70a53687 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:50.952350 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd67c5cc-2d4d-404c-b9df-931b70a53687 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:50.971446 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: WARNING keystone.server.flask.application [None req-cd67c5cc-2d4d-404c-b9df-931b70a53687 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 25 02:23:50.972935 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 435/855] 10.222.0.117 () {56 vars in 1134 bytes} [Tue Jan 25 02:23:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:23:50.978457 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925a83d6-d394-4ec7-aaa4-5226b1fabaa9 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:50.990105 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925a83d6-d394-4ec7-aaa4-5226b1fabaa9 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:50.994729 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6da4ed0-844f-43d1-b6ed-b5c5213de52d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:50.995802 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6da4ed0-844f-43d1-b6ed-b5c5213de52d admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:50.996134 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6da4ed0-844f-43d1-b6ed-b5c5213de52d admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:50.996458 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6da4ed0-844f-43d1-b6ed-b5c5213de52d admin admin] PATH_INFO: `/v3/domains` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:50.997233 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6da4ed0-844f-43d1-b6ed-b5c5213de52d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:50.997533 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6da4ed0-844f-43d1-b6ed-b5c5213de52d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:50.999190 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6da4ed0-844f-43d1-b6ed-b5c5213de52d admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:51.011948 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 421/856] 10.222.0.117 () {56 vars in 1135 bytes} [Tue Jan 25 02:23:50 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:51.017394 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd67c5cc-2d4d-404c-b9df-931b70a53687 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:51.028459 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd67c5cc-2d4d-404c-b9df-931b70a53687 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:51.033073 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320f6f49-07d7-439d-be89-fbcb8f586867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:51.033853 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320f6f49-07d7-439d-be89-fbcb8f586867 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:51.034188 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320f6f49-07d7-439d-be89-fbcb8f586867 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:51.034458 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320f6f49-07d7-439d-be89-fbcb8f586867 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:51.043100 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320f6f49-07d7-439d-be89-fbcb8f586867 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:51.045542 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320f6f49-07d7-439d-be89-fbcb8f586867 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:51.060405 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: WARNING keystone.server.flask.application [None req-320f6f49-07d7-439d-be89-fbcb8f586867 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jan 25 02:23:51.061880 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 436/857] 10.222.0.117 () {56 vars in 1122 bytes} [Tue Jan 25 02:23:51 2022] GET /identity/v3/users/swift => generated 83 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:23:51.067396 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6da4ed0-844f-43d1-b6ed-b5c5213de52d admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:51.077806 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6da4ed0-844f-43d1-b6ed-b5c5213de52d admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:51.082428 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919356cd-8578-4a56-89dd-4e975cb195e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:51.083144 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919356cd-8578-4a56-89dd-4e975cb195e7 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:51.083427 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919356cd-8578-4a56-89dd-4e975cb195e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:51.083722 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919356cd-8578-4a56-89dd-4e975cb195e7 admin admin] PATH_INFO: `/v3/users` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:51.084621 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919356cd-8578-4a56-89dd-4e975cb195e7 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:51.084928 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919356cd-8578-4a56-89dd-4e975cb195e7 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:51.086930 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919356cd-8578-4a56-89dd-4e975cb195e7 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:51.107319 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 422/858] 10.222.0.117 () {56 vars in 1161 bytes} [Tue Jan 25 02:23:51 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 372 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:51.112849 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320f6f49-07d7-439d-be89-fbcb8f586867 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:51.123295 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320f6f49-07d7-439d-be89-fbcb8f586867 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:51.127925 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f61a35d-c42c-4249-9d24-379cfc4a5caf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:51.128557 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f61a35d-c42c-4249-9d24-379cfc4a5caf admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:51.128889 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f61a35d-c42c-4249-9d24-379cfc4a5caf admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:51.129159 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f61a35d-c42c-4249-9d24-379cfc4a5caf admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:51.138159 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f61a35d-c42c-4249-9d24-379cfc4a5caf admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:51.140007 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f61a35d-c42c-4249-9d24-379cfc4a5caf admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:51.149635 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 437/859] 10.222.0.117 () {58 vars in 1329 bytes} [Tue Jan 25 02:23:51 2022] GET /identity/v3/auth/tokens => generated 1455 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:23:51.156197 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919356cd-8578-4a56-89dd-4e975cb195e7 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:51.165969 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919356cd-8578-4a56-89dd-4e975cb195e7 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:51.171321 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edec00c8-b18c-48b0-8d66-a96f65c867c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:51.172136 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edec00c8-b18c-48b0-8d66-a96f65c867c4 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:51.172474 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edec00c8-b18c-48b0-8d66-a96f65c867c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:51.172743 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edec00c8-b18c-48b0-8d66-a96f65c867c4 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:51.183742 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edec00c8-b18c-48b0-8d66-a96f65c867c4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:51.185687 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edec00c8-b18c-48b0-8d66-a96f65c867c4 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:51.208202 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: WARNING keystone.server.flask.application [None req-edec00c8-b18c-48b0-8d66-a96f65c867c4 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 25 02:23:51.209820 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 423/860] 10.222.0.117 () {56 vars in 1134 bytes} [Tue Jan 25 02:23:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 25 02:23:51.216054 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f61a35d-c42c-4249-9d24-379cfc4a5caf admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:51.232824 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f61a35d-c42c-4249-9d24-379cfc4a5caf admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:51.237315 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254b5990-e476-4eba-8e20-98d6c2c44eb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:51.237967 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254b5990-e476-4eba-8e20-98d6c2c44eb6 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:51.238245 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254b5990-e476-4eba-8e20-98d6c2c44eb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:51.238694 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254b5990-e476-4eba-8e20-98d6c2c44eb6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:51.239435 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254b5990-e476-4eba-8e20-98d6c2c44eb6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:51.239764 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254b5990-e476-4eba-8e20-98d6c2c44eb6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:51.241367 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254b5990-e476-4eba-8e20-98d6c2c44eb6 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:51.254910 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 438/861] 10.222.0.117 () {56 vars in 1135 bytes} [Tue Jan 25 02:23:51 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:51.260949 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edec00c8-b18c-48b0-8d66-a96f65c867c4 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:51.271149 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edec00c8-b18c-48b0-8d66-a96f65c867c4 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:51.275644 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fd1943-1544-4417-94d3-913091e73488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:51.276777 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fd1943-1544-4417-94d3-913091e73488 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:51.277059 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fd1943-1544-4417-94d3-913091e73488 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:51.277330 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fd1943-1544-4417-94d3-913091e73488 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:51.285607 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fd1943-1544-4417-94d3-913091e73488 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:51.287625 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fd1943-1544-4417-94d3-913091e73488 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:51.301093 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: WARNING keystone.server.flask.application [None req-d5fd1943-1544-4417-94d3-913091e73488 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 25 02:23:51.302555 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 424/862] 10.222.0.117 () {56 vars in 1137 bytes} [Tue Jan 25 02:23:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:23:51.309359 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254b5990-e476-4eba-8e20-98d6c2c44eb6 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:51.319261 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254b5990-e476-4eba-8e20-98d6c2c44eb6 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:51.325107 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30313ce-3d78-4c7c-95a3-a45cde9b04d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:51.326058 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30313ce-3d78-4c7c-95a3-a45cde9b04d8 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:51.326553 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30313ce-3d78-4c7c-95a3-a45cde9b04d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:51.327182 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30313ce-3d78-4c7c-95a3-a45cde9b04d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:51.328986 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30313ce-3d78-4c7c-95a3-a45cde9b04d8 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:51.329729 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30313ce-3d78-4c7c-95a3-a45cde9b04d8 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:51.331928 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30313ce-3d78-4c7c-95a3-a45cde9b04d8 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:51.348209 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 439/863] 10.222.0.117 () {56 vars in 1174 bytes} [Tue Jan 25 02:23:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:51.355317 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fd1943-1544-4417-94d3-913091e73488 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:51.366009 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fd1943-1544-4417-94d3-913091e73488 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:51.370986 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6d618e-02ef-441e-b64f-041f9e167c83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:51.371716 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6d618e-02ef-441e-b64f-041f9e167c83 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:51.372011 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6d618e-02ef-441e-b64f-041f9e167c83 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:51.372279 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6d618e-02ef-441e-b64f-041f9e167c83 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:51.373106 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6d618e-02ef-441e-b64f-041f9e167c83 admin admin] RBAC: Adding query filter params (role.id=d8dbc6d83d9d41d28c3feb8b3485b291, scope.project.id=61a6fe9d4c914755bb0a64c392bd16aa, user.id=100f12ee56754f1c859106bf3e473df6) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:51.373411 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6d618e-02ef-441e-b64f-041f9e167c83 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:51.375237 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6d618e-02ef-441e-b64f-041f9e167c83 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:51.381431 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 425/864] 10.222.0.117 () {56 vars in 1400 bytes} [Tue Jan 25 02:23:51 2022] GET /identity/v3/role_assignments?user.id=100f12ee56754f1c859106bf3e473df6&scope.project.id=61a6fe9d4c914755bb0a64c392bd16aa&role.id=d8dbc6d83d9d41d28c3feb8b3485b291 => generated 610 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:51.765370 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b674c296-3bfb-4e83-a1f2-8388d5943f5a None None] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:51.765890 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b674c296-3bfb-4e83-a1f2-8388d5943f5a None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:51.765965 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b674c296-3bfb-4e83-a1f2-8388d5943f5a None None] PATH_INFO: `/` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:51.767993 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 440/865] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:23:51 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:23:51.773330 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9d8644-52e7-40c0-bf9e-91ce92e02c85 None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:51.773746 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9d8644-52e7-40c0-bf9e-91ce92e02c85 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:51.773879 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9d8644-52e7-40c0-bf9e-91ce92e02c85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:51.791514 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-eb9d8644-52e7-40c0-bf9e-91ce92e02c85 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:23:51.792735 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-eb9d8644-52e7-40c0-bf9e-91ce92e02c85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:23:51.807800 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 426/866] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:23:51 2022] POST /identity/v3/auth/tokens => generated 1455 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:23:51.824451 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b674c296-3bfb-4e83-a1f2-8388d5943f5a None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:51.838981 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b674c296-3bfb-4e83-a1f2-8388d5943f5a None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:51.843630 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a02296-b94d-4c14-a7db-9674e30483e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:51.844513 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a02296-b94d-4c14-a7db-9674e30483e3 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:51.845121 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a02296-b94d-4c14-a7db-9674e30483e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:51.845399 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a02296-b94d-4c14-a7db-9674e30483e3 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:51.846061 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a02296-b94d-4c14-a7db-9674e30483e3 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:51.847654 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a02296-b94d-4c14-a7db-9674e30483e3 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:51.859347 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: WARNING keystone.server.flask.application [None req-e5a02296-b94d-4c14-a7db-9674e30483e3 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jan 25 02:23:51.860846 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 441/867] 10.222.0.117 () {56 vars in 1140 bytes} [Tue Jan 25 02:23:51 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:23:51.868908 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9d8644-52e7-40c0-bf9e-91ce92e02c85 None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:51.878836 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9d8644-52e7-40c0-bf9e-91ce92e02c85 None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:51.883373 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f480608-e2ac-4bef-8f26-bbb21830af0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:51.884071 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f480608-e2ac-4bef-8f26-bbb21830af0f admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:51.884359 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f480608-e2ac-4bef-8f26-bbb21830af0f admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:51.884636 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f480608-e2ac-4bef-8f26-bbb21830af0f admin admin] PATH_INFO: `/v3/services` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:51.886067 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f480608-e2ac-4bef-8f26-bbb21830af0f admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:51.886346 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f480608-e2ac-4bef-8f26-bbb21830af0f admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:51.887972 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f480608-e2ac-4bef-8f26-bbb21830af0f admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:51.895779 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 427/868] 10.222.0.117 () {56 vars in 1140 bytes} [Tue Jan 25 02:23:51 2022] GET /identity/v3/services?name=volumev3 => generated 126 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:51.898532 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a02296-b94d-4c14-a7db-9674e30483e3 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:51.908863 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a02296-b94d-4c14-a7db-9674e30483e3 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:51.913645 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437ac5b0-7b57-4200-991b-9c745d7774e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:51.914299 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437ac5b0-7b57-4200-991b-9c745d7774e7 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:51.914634 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437ac5b0-7b57-4200-991b-9c745d7774e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:51.914907 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437ac5b0-7b57-4200-991b-9c745d7774e7 admin admin] PATH_INFO: `/v3/services` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:51.915627 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437ac5b0-7b57-4200-991b-9c745d7774e7 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:51.916014 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437ac5b0-7b57-4200-991b-9c745d7774e7 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:51.918212 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437ac5b0-7b57-4200-991b-9c745d7774e7 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:51.928020 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 442/869] 10.222.0.117 () {56 vars in 1140 bytes} [Tue Jan 25 02:23:51 2022] GET /identity/v3/services?type=volumev3 => generated 126 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 02:23:52.399455 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfb9ddc-1869-4cd3-8cff-ed59f3b3320e None None] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:52.399824 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfb9ddc-1869-4cd3-8cff-ed59f3b3320e None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:52.400124 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfb9ddc-1869-4cd3-8cff-ed59f3b3320e None None] PATH_INFO: `/` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:52.402765 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 428/870] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:23:52 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:23:52.407986 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19872aa1-ccc3-420f-bf29-9ee35ff3a3c1 None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:52.408278 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19872aa1-ccc3-420f-bf29-9ee35ff3a3c1 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:52.408557 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19872aa1-ccc3-420f-bf29-9ee35ff3a3c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:52.426792 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-19872aa1-ccc3-420f-bf29-9ee35ff3a3c1 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:23:52.428045 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-19872aa1-ccc3-420f-bf29-9ee35ff3a3c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:23:52.436798 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 443/871] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:23:52 2022] POST /identity/v3/auth/tokens => generated 1455 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:23:52.459493 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfb9ddc-1869-4cd3-8cff-ed59f3b3320e None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:52.472813 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfb9ddc-1869-4cd3-8cff-ed59f3b3320e None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:52.477164 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f85079f-32ec-4f61-b7e9-a06f28a1191f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:52.477810 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f85079f-32ec-4f61-b7e9-a06f28a1191f admin admin] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:52.478086 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f85079f-32ec-4f61-b7e9-a06f28a1191f admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:52.478358 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f85079f-32ec-4f61-b7e9-a06f28a1191f admin admin] PATH_INFO: `/v3/services` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:52.479136 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f85079f-32ec-4f61-b7e9-a06f28a1191f admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:52.481073 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f85079f-32ec-4f61-b7e9-a06f28a1191f admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:52.498793 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 429/872] 10.222.0.117 () {60 vars in 1167 bytes} [Tue Jan 25 02:23:52 2022] POST /identity/v3/services => generated 270 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 02:23:52.633399 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead588c4-8ace-4987-82d0-4a96e1740623 None None] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:52.634089 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead588c4-8ace-4987-82d0-4a96e1740623 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:52.634587 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead588c4-8ace-4987-82d0-4a96e1740623 None None] PATH_INFO: `/` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:52.637071 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 444/873] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:23:52 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jan 25 02:23:52.642664 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d191014-e135-4966-b7e8-16f80b184249 None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:52.642973 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d191014-e135-4966-b7e8-16f80b184249 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:52.643232 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d191014-e135-4966-b7e8-16f80b184249 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:52.666985 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-7d191014-e135-4966-b7e8-16f80b184249 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:23:52.668652 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-7d191014-e135-4966-b7e8-16f80b184249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:23:52.686896 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 430/874] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:23:52 2022] POST /identity/v3/auth/tokens => generated 1565 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 25 02:23:52.710767 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead588c4-8ace-4987-82d0-4a96e1740623 None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:52.725491 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead588c4-8ace-4987-82d0-4a96e1740623 None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:52.730150 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58b1c04-78ee-4e49-a3f1-44b8e80e2ea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:52.730957 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58b1c04-78ee-4e49-a3f1-44b8e80e2ea2 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:52.731241 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58b1c04-78ee-4e49-a3f1-44b8e80e2ea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:52.731511 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58b1c04-78ee-4e49-a3f1-44b8e80e2ea2 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:52.742301 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58b1c04-78ee-4e49-a3f1-44b8e80e2ea2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 25 02:23:52.750531 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: WARNING keystone.server.flask.application [None req-b58b1c04-78ee-4e49-a3f1-44b8e80e2ea2 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jan 25 02:23:52.752077 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 445/875] 10.222.0.117 () {56 vars in 1146 bytes} [Tue Jan 25 02:23:52 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:23:52.757839 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d191014-e135-4966-b7e8-16f80b184249 None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:52.767752 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d191014-e135-4966-b7e8-16f80b184249 None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:52.772331 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cb0ed4-5d37-4dc2-a876-b16a7353b8e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:52.772973 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cb0ed4-5d37-4dc2-a876-b16a7353b8e3 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:52.773253 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cb0ed4-5d37-4dc2-a876-b16a7353b8e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:52.773524 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cb0ed4-5d37-4dc2-a876-b16a7353b8e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:52.774288 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cb0ed4-5d37-4dc2-a876-b16a7353b8e3 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:52.774590 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cb0ed4-5d37-4dc2-a876-b16a7353b8e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:52.776808 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cb0ed4-5d37-4dc2-a876-b16a7353b8e3 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:52.785573 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 431/876] 10.222.0.117 () {56 vars in 1141 bytes} [Tue Jan 25 02:23:52 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 340 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:52.790967 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58b1c04-78ee-4e49-a3f1-44b8e80e2ea2 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:52.803267 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58b1c04-78ee-4e49-a3f1-44b8e80e2ea2 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:52.808395 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061ab302-2a0e-4310-b85d-71b930258ef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:52.809380 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061ab302-2a0e-4310-b85d-71b930258ef8 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:52.809833 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061ab302-2a0e-4310-b85d-71b930258ef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:52.810296 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061ab302-2a0e-4310-b85d-71b930258ef8 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:52.821623 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061ab302-2a0e-4310-b85d-71b930258ef8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:52.824162 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061ab302-2a0e-4310-b85d-71b930258ef8 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:52.841447 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: WARNING keystone.server.flask.application [None req-061ab302-2a0e-4310-b85d-71b930258ef8 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 25 02:23:52.842914 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 446/877] 10.222.0.117 () {56 vars in 1134 bytes} [Tue Jan 25 02:23:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:23:52.848833 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cb0ed4-5d37-4dc2-a876-b16a7353b8e3 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:52.859349 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cb0ed4-5d37-4dc2-a876-b16a7353b8e3 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:52.864120 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733dd3d0-5746-4c33-8400-a80113da3489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:52.864759 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733dd3d0-5746-4c33-8400-a80113da3489 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:52.865092 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733dd3d0-5746-4c33-8400-a80113da3489 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:52.865366 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733dd3d0-5746-4c33-8400-a80113da3489 admin admin] PATH_INFO: `/v3/domains` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:52.866147 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733dd3d0-5746-4c33-8400-a80113da3489 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:52.866456 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733dd3d0-5746-4c33-8400-a80113da3489 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:52.868200 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733dd3d0-5746-4c33-8400-a80113da3489 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:52.880762 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 432/878] 10.222.0.117 () {56 vars in 1135 bytes} [Tue Jan 25 02:23:52 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:52.886691 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061ab302-2a0e-4310-b85d-71b930258ef8 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:52.897028 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061ab302-2a0e-4310-b85d-71b930258ef8 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:52.903205 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b408c0-b326-4ca7-add7-630acc00a63a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:52.904095 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b408c0-b326-4ca7-add7-630acc00a63a admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:52.904377 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b408c0-b326-4ca7-add7-630acc00a63a admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:52.904700 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b408c0-b326-4ca7-add7-630acc00a63a admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:52.913222 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b408c0-b326-4ca7-add7-630acc00a63a admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:52.915434 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b408c0-b326-4ca7-add7-630acc00a63a admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:52.930059 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: WARNING keystone.server.flask.application [None req-59b408c0-b326-4ca7-add7-630acc00a63a admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jan 25 02:23:52.931802 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 447/879] 10.222.0.117 () {56 vars in 1143 bytes} [Tue Jan 25 02:23:52 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 25 02:23:52.937630 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733dd3d0-5746-4c33-8400-a80113da3489 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:52.948359 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733dd3d0-5746-4c33-8400-a80113da3489 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:52.953116 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffacc97-9657-4816-a826-9dd8951e9fc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:52.953828 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffacc97-9657-4816-a826-9dd8951e9fc4 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:52.954111 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffacc97-9657-4816-a826-9dd8951e9fc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:52.954382 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffacc97-9657-4816-a826-9dd8951e9fc4 admin admin] PATH_INFO: `/v3/users` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:52.955294 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffacc97-9657-4816-a826-9dd8951e9fc4 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:52.955605 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffacc97-9657-4816-a826-9dd8951e9fc4 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:52.957542 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffacc97-9657-4816-a826-9dd8951e9fc4 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:52.976992 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 433/880] 10.222.0.117 () {56 vars in 1175 bytes} [Tue Jan 25 02:23:52 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 386 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:52.982691 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b408c0-b326-4ca7-add7-630acc00a63a admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:52.992935 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b408c0-b326-4ca7-add7-630acc00a63a admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:52.999630 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f44d26-3de5-4891-8153-d57a194bd3fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:53.000320 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f44d26-3de5-4891-8153-d57a194bd3fd admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:53.000603 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f44d26-3de5-4891-8153-d57a194bd3fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:53.000875 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f44d26-3de5-4891-8153-d57a194bd3fd admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:53.014537 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f44d26-3de5-4891-8153-d57a194bd3fd admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:53.016554 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f44d26-3de5-4891-8153-d57a194bd3fd admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:53.028004 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 448/881] 10.222.0.117 () {58 vars in 1329 bytes} [Tue Jan 25 02:23:52 2022] GET /identity/v3/auth/tokens => generated 1565 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:23:53.033638 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffacc97-9657-4816-a826-9dd8951e9fc4 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:53.044621 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffacc97-9657-4816-a826-9dd8951e9fc4 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:53.049537 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8f8a61-56b8-4506-92a2-e184fab71dca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:53.050596 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8f8a61-56b8-4506-92a2-e184fab71dca admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:53.051110 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8f8a61-56b8-4506-92a2-e184fab71dca admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:53.051577 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8f8a61-56b8-4506-92a2-e184fab71dca admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:53.063652 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8f8a61-56b8-4506-92a2-e184fab71dca admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:53.065852 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8f8a61-56b8-4506-92a2-e184fab71dca admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:53.084187 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: WARNING keystone.server.flask.application [None req-6e8f8a61-56b8-4506-92a2-e184fab71dca admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 25 02:23:53.086029 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 434/882] 10.222.0.117 () {56 vars in 1134 bytes} [Tue Jan 25 02:23:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:23:53.092919 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f44d26-3de5-4891-8153-d57a194bd3fd admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:53.103072 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f44d26-3de5-4891-8153-d57a194bd3fd admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:53.108922 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3542e4-9114-4cd6-9793-067d28948b3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:53.109885 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3542e4-9114-4cd6-9793-067d28948b3a admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:53.110418 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3542e4-9114-4cd6-9793-067d28948b3a admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:53.110889 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3542e4-9114-4cd6-9793-067d28948b3a admin admin] PATH_INFO: `/v3/domains` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:53.111941 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3542e4-9114-4cd6-9793-067d28948b3a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:53.112444 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3542e4-9114-4cd6-9793-067d28948b3a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:53.114374 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3542e4-9114-4cd6-9793-067d28948b3a admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:53.127378 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 449/883] 10.222.0.117 () {56 vars in 1135 bytes} [Tue Jan 25 02:23:53 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:53.133157 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8f8a61-56b8-4506-92a2-e184fab71dca admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:53.145275 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8f8a61-56b8-4506-92a2-e184fab71dca admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:53.150283 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9e0174-6852-4371-9508-b07f32807056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:53.151952 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9e0174-6852-4371-9508-b07f32807056 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:53.152564 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9e0174-6852-4371-9508-b07f32807056 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:53.153034 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9e0174-6852-4371-9508-b07f32807056 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:53.160364 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9e0174-6852-4371-9508-b07f32807056 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:53.162653 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9e0174-6852-4371-9508-b07f32807056 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:53.176458 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: WARNING keystone.server.flask.application [None req-0d9e0174-6852-4371-9508-b07f32807056 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 25 02:23:53.178160 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 435/884] 10.222.0.117 () {56 vars in 1137 bytes} [Tue Jan 25 02:23:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 25 02:23:53.184466 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3542e4-9114-4cd6-9793-067d28948b3a admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:53.194581 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3542e4-9114-4cd6-9793-067d28948b3a admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:53.200015 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b051c80d-4ba1-49e3-91c1-4cc5bf8af519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:53.200889 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b051c80d-4ba1-49e3-91c1-4cc5bf8af519 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:53.201402 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b051c80d-4ba1-49e3-91c1-4cc5bf8af519 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:53.201891 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b051c80d-4ba1-49e3-91c1-4cc5bf8af519 admin admin] PATH_INFO: `/v3/projects` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:53.202939 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b051c80d-4ba1-49e3-91c1-4cc5bf8af519 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:53.203460 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b051c80d-4ba1-49e3-91c1-4cc5bf8af519 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:53.205754 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b051c80d-4ba1-49e3-91c1-4cc5bf8af519 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:53.218877 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 450/885] 10.222.0.117 () {56 vars in 1174 bytes} [Tue Jan 25 02:23:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:53.225237 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9e0174-6852-4371-9508-b07f32807056 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:53.236314 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9e0174-6852-4371-9508-b07f32807056 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:53.241188 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e7546b-14de-4240-87a8-465888ce5785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:53.242096 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e7546b-14de-4240-87a8-465888ce5785 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:53.242575 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e7546b-14de-4240-87a8-465888ce5785 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:53.243057 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e7546b-14de-4240-87a8-465888ce5785 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:53.244144 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e7546b-14de-4240-87a8-465888ce5785 admin admin] RBAC: Adding query filter params (role.id=06cf9f8251c94c588ee2dafb34cab2a8, scope.project.id=61a6fe9d4c914755bb0a64c392bd16aa, user.id=5924414ee6e948a680b8b75c8797b466) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:53.245251 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e7546b-14de-4240-87a8-465888ce5785 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:53.247403 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e7546b-14de-4240-87a8-465888ce5785 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:53.253733 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 436/886] 10.222.0.117 () {56 vars in 1400 bytes} [Tue Jan 25 02:23:53 2022] GET /identity/v3/role_assignments?user.id=5924414ee6e948a680b8b75c8797b466&scope.project.id=61a6fe9d4c914755bb0a64c392bd16aa&role.id=06cf9f8251c94c588ee2dafb34cab2a8 => generated 260 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:53.765824 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6549d1de-091f-4407-9559-326938a971c1 None None] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:53.766158 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6549d1de-091f-4407-9559-326938a971c1 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:53.766385 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6549d1de-091f-4407-9559-326938a971c1 None None] PATH_INFO: `/` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:53.768612 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 451/887] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:23:53 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:23:53.774528 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5124a4f2-7bda-4d17-99cd-4d8665aaea0c None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:53.775049 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5124a4f2-7bda-4d17-99cd-4d8665aaea0c None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:53.775123 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5124a4f2-7bda-4d17-99cd-4d8665aaea0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:53.793370 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-5124a4f2-7bda-4d17-99cd-4d8665aaea0c None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:23:53.794564 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-5124a4f2-7bda-4d17-99cd-4d8665aaea0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:23:53.802597 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 437/888] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:23:53 2022] POST /identity/v3/auth/tokens => generated 1565 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:23:53.826583 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6549d1de-091f-4407-9559-326938a971c1 None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:53.839681 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6549d1de-091f-4407-9559-326938a971c1 None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:53.844191 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2297b96a-5617-432f-841b-b8836d3d510e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:53.845242 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2297b96a-5617-432f-841b-b8836d3d510e admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:53.845526 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2297b96a-5617-432f-841b-b8836d3d510e admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:53.845801 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2297b96a-5617-432f-841b-b8836d3d510e admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:53.846466 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2297b96a-5617-432f-841b-b8836d3d510e admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:53.848116 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2297b96a-5617-432f-841b-b8836d3d510e admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:53.859560 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: WARNING keystone.server.flask.application [None req-2297b96a-5617-432f-841b-b8836d3d510e admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jan 25 02:23:53.861091 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 452/889] 10.222.0.117 () {56 vars in 1152 bytes} [Tue Jan 25 02:23:53 2022] GET /identity/v3/services/object-store => generated 93 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:23:53.866972 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5124a4f2-7bda-4d17-99cd-4d8665aaea0c None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:53.876319 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5124a4f2-7bda-4d17-99cd-4d8665aaea0c None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:53.880894 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018b3ca8-2c04-45ea-ba4c-b7c7fe9bcaac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:53.881554 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018b3ca8-2c04-45ea-ba4c-b7c7fe9bcaac admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:53.881839 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018b3ca8-2c04-45ea-ba4c-b7c7fe9bcaac admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:53.882113 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018b3ca8-2c04-45ea-ba4c-b7c7fe9bcaac admin admin] PATH_INFO: `/v3/services` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:53.882832 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018b3ca8-2c04-45ea-ba4c-b7c7fe9bcaac admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:53.883134 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018b3ca8-2c04-45ea-ba4c-b7c7fe9bcaac admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:53.884765 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018b3ca8-2c04-45ea-ba4c-b7c7fe9bcaac admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:53.890228 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 438/890] 10.222.0.117 () {56 vars in 1148 bytes} [Tue Jan 25 02:23:53 2022] GET /identity/v3/services?name=object-store => generated 130 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:53.895992 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2297b96a-5617-432f-841b-b8836d3d510e admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:53.907005 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2297b96a-5617-432f-841b-b8836d3d510e admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:53.911629 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce1b132-9312-41aa-9f3e-eff4ab3ae2f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:53.912312 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce1b132-9312-41aa-9f3e-eff4ab3ae2f8 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:53.912598 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce1b132-9312-41aa-9f3e-eff4ab3ae2f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:53.912872 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce1b132-9312-41aa-9f3e-eff4ab3ae2f8 admin admin] PATH_INFO: `/v3/services` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:53.913594 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce1b132-9312-41aa-9f3e-eff4ab3ae2f8 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:53.913898 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce1b132-9312-41aa-9f3e-eff4ab3ae2f8 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:53.915512 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce1b132-9312-41aa-9f3e-eff4ab3ae2f8 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:53.920496 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 453/891] 10.222.0.117 () {56 vars in 1148 bytes} [Tue Jan 25 02:23:53 2022] GET /identity/v3/services?type=object-store => generated 130 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:54.224905 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f048ec-de6a-4fe7-8956-c1d50f4f5cea None None] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:54.225277 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f048ec-de6a-4fe7-8956-c1d50f4f5cea None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:54.225474 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f048ec-de6a-4fe7-8956-c1d50f4f5cea None None] PATH_INFO: `/` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:54.227507 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 439/892] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:23:54 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:23:54.233213 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a309e6-4b30-4e79-b281-2c0ba5629848 None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:54.233503 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a309e6-4b30-4e79-b281-2c0ba5629848 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:54.233979 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a309e6-4b30-4e79-b281-2c0ba5629848 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:54.252557 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-d1a309e6-4b30-4e79-b281-2c0ba5629848 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:23:54.253744 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-d1a309e6-4b30-4e79-b281-2c0ba5629848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:23:54.267804 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 454/893] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:23:54 2022] POST /identity/v3/auth/tokens => generated 1565 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:23:54.286233 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f048ec-de6a-4fe7-8956-c1d50f4f5cea None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:54.298649 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f048ec-de6a-4fe7-8956-c1d50f4f5cea None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:54.303259 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9021646b-e913-4f85-b8a9-1aeb15f39ec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:54.303993 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9021646b-e913-4f85-b8a9-1aeb15f39ec7 admin admin] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:54.304277 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9021646b-e913-4f85-b8a9-1aeb15f39ec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:54.304608 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9021646b-e913-4f85-b8a9-1aeb15f39ec7 admin admin] PATH_INFO: `/v3/services` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:54.305397 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9021646b-e913-4f85-b8a9-1aeb15f39ec7 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:54.307626 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9021646b-e913-4f85-b8a9-1aeb15f39ec7 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:54.327852 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 440/894] 10.222.0.117 () {60 vars in 1167 bytes} [Tue Jan 25 02:23:54 2022] POST /identity/v3/services => generated 252 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 02:23:54.903723 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33772606-d13f-409e-a563-0fa783114d78 None None] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:54.904442 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33772606-d13f-409e-a563-0fa783114d78 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:54.904442 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33772606-d13f-409e-a563-0fa783114d78 None None] PATH_INFO: `/` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:54.906260 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 455/895] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:23:54 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:23:54.911717 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d52f3e-69bc-4316-b66e-987aaf213627 None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:54.912212 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d52f3e-69bc-4316-b66e-987aaf213627 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:54.912365 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d52f3e-69bc-4316-b66e-987aaf213627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:54.930194 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-88d52f3e-69bc-4316-b66e-987aaf213627 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:23:54.931295 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-88d52f3e-69bc-4316-b66e-987aaf213627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:23:54.954407 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 441/896] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:23:54 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:23:54.977355 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33772606-d13f-409e-a563-0fa783114d78 None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:54.990733 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33772606-d13f-409e-a563-0fa783114d78 None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:54.995501 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a81278-b233-4240-8b4d-e39681cc7857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:54.996347 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a81278-b233-4240-8b4d-e39681cc7857 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:54.996628 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a81278-b233-4240-8b4d-e39681cc7857 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:54.996898 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a81278-b233-4240-8b4d-e39681cc7857 admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:54.997562 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a81278-b233-4240-8b4d-e39681cc7857 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:54.999163 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a81278-b233-4240-8b4d-e39681cc7857 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:55.011374 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: WARNING keystone.server.flask.application [None req-a1a81278-b233-4240-8b4d-e39681cc7857 admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jan 25 02:23:55.012909 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 456/897] 10.222.0.117 () {56 vars in 1158 bytes} [Tue Jan 25 02:23:54 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:23:55.018803 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d52f3e-69bc-4316-b66e-987aaf213627 None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:55.028675 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d52f3e-69bc-4316-b66e-987aaf213627 None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:55.033252 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a281f30-526d-4abe-8b30-f65030f67163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:55.033905 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a281f30-526d-4abe-8b30-f65030f67163 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:55.034185 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a281f30-526d-4abe-8b30-f65030f67163 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:55.034456 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a281f30-526d-4abe-8b30-f65030f67163 admin admin] PATH_INFO: `/v3/services` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:55.035165 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a281f30-526d-4abe-8b30-f65030f67163 admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:55.035468 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a281f30-526d-4abe-8b30-f65030f67163 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:55.037085 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a281f30-526d-4abe-8b30-f65030f67163 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:55.043377 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 442/898] 10.222.0.117 () {56 vars in 1152 bytes} [Tue Jan 25 02:23:55 2022] GET /identity/v3/services?name=compute_legacy => generated 132 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 02:23:55.049297 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a81278-b233-4240-8b4d-e39681cc7857 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:55.060059 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a81278-b233-4240-8b4d-e39681cc7857 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:55.064800 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bdd509-3922-402a-8511-26c6bd421123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:55.065504 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bdd509-3922-402a-8511-26c6bd421123 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:55.065787 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bdd509-3922-402a-8511-26c6bd421123 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:55.066064 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bdd509-3922-402a-8511-26c6bd421123 admin admin] PATH_INFO: `/v3/services` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:55.066839 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bdd509-3922-402a-8511-26c6bd421123 admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:55.067142 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bdd509-3922-402a-8511-26c6bd421123 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:55.068837 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bdd509-3922-402a-8511-26c6bd421123 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:55.075999 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 457/899] 10.222.0.117 () {56 vars in 1152 bytes} [Tue Jan 25 02:23:55 2022] GET /identity/v3/services?type=compute_legacy => generated 388 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:55.084841 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a281f30-526d-4abe-8b30-f65030f67163 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:55.096415 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a281f30-526d-4abe-8b30-f65030f67163 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:55.101121 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10691c32-1f3d-4655-8b82-4aadf7edfba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:55.101823 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10691c32-1f3d-4655-8b82-4aadf7edfba4 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:55.102102 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10691c32-1f3d-4655-8b82-4aadf7edfba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:55.102375 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10691c32-1f3d-4655-8b82-4aadf7edfba4 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:55.103221 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10691c32-1f3d-4655-8b82-4aadf7edfba4 admin admin] RBAC: Adding query filter params (interface=public, service_id=f415ceef109b4a20aa9eaaeb5150b699, region_id=RegionOne) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:55.103533 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10691c32-1f3d-4655-8b82-4aadf7edfba4 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:55.105556 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: WARNING py.warnings [None req-10691c32-1f3d-4655-8b82-4aadf7edfba4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_endpoints": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 25 02:23:55.105556 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: warnings.warn(msg) Jan 25 02:23:55.105556 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: Jan 25 02:23:55.106501 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10691c32-1f3d-4655-8b82-4aadf7edfba4 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:55.114824 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 443/900] 10.222.0.117 () {56 vars in 1277 bytes} [Tue Jan 25 02:23:55 2022] GET /identity/v3/endpoints?service_id=f415ceef109b4a20aa9eaaeb5150b699&interface=public®ion_id=RegionOne => generated 195 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:55.120590 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bdd509-3922-402a-8511-26c6bd421123 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:55.130421 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bdd509-3922-402a-8511-26c6bd421123 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:55.135927 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2611b0f1-a889-45a2-b115-f24768478d32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:55.136490 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2611b0f1-a889-45a2-b115-f24768478d32 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:55.136781 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2611b0f1-a889-45a2-b115-f24768478d32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:55.137054 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2611b0f1-a889-45a2-b115-f24768478d32 admin admin] PATH_INFO: `/v3/services` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:55.137748 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2611b0f1-a889-45a2-b115-f24768478d32 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:55.139350 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2611b0f1-a889-45a2-b115-f24768478d32 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:55.145593 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 458/901] 10.222.0.117 () {56 vars in 1113 bytes} [Tue Jan 25 02:23:55 2022] GET /identity/v3/services => generated 1274 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 02:23:55.562736 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38227904-8717-4556-84ef-7d10d7bf8f43 None None] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:55.562736 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38227904-8717-4556-84ef-7d10d7bf8f43 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:55.562736 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38227904-8717-4556-84ef-7d10d7bf8f43 None None] PATH_INFO: `/` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:55.562736 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 444/902] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:23:55 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:23:55.570743 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b61f67-a80b-46f5-bc2f-14f01b52af23 None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:55.570743 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b61f67-a80b-46f5-bc2f-14f01b52af23 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:55.570743 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b61f67-a80b-46f5-bc2f-14f01b52af23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:55.587990 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-88b61f67-a80b-46f5-bc2f-14f01b52af23 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:23:55.590276 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-88b61f67-a80b-46f5-bc2f-14f01b52af23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:23:55.602746 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 459/903] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:23:55 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:23:55.626752 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38227904-8717-4556-84ef-7d10d7bf8f43 None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:55.640522 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38227904-8717-4556-84ef-7d10d7bf8f43 None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:55.645146 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0066fd72-d9d7-46fb-99c0-6a0b9f1c26d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:55.645943 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0066fd72-d9d7-46fb-99c0-6a0b9f1c26d2 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:55.646220 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0066fd72-d9d7-46fb-99c0-6a0b9f1c26d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:55.646492 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0066fd72-d9d7-46fb-99c0-6a0b9f1c26d2 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:55.657679 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0066fd72-d9d7-46fb-99c0-6a0b9f1c26d2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 25 02:23:55.664952 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: WARNING keystone.server.flask.application [None req-0066fd72-d9d7-46fb-99c0-6a0b9f1c26d2 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jan 25 02:23:55.666569 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 445/904] 10.222.0.117 () {56 vars in 1146 bytes} [Tue Jan 25 02:23:55 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:23:55.672248 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b61f67-a80b-46f5-bc2f-14f01b52af23 None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:55.682484 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b61f67-a80b-46f5-bc2f-14f01b52af23 None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:55.687530 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716818c8-5b30-46fb-8530-7f3ce2489657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:55.688468 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716818c8-5b30-46fb-8530-7f3ce2489657 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:55.688950 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716818c8-5b30-46fb-8530-7f3ce2489657 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:55.689423 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716818c8-5b30-46fb-8530-7f3ce2489657 admin admin] PATH_INFO: `/v3/roles` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:55.690379 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716818c8-5b30-46fb-8530-7f3ce2489657 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:55.690885 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716818c8-5b30-46fb-8530-7f3ce2489657 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:55.692709 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716818c8-5b30-46fb-8530-7f3ce2489657 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:55.702090 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 460/905] 10.222.0.117 () {56 vars in 1141 bytes} [Tue Jan 25 02:23:55 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 340 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:55.707656 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0066fd72-d9d7-46fb-99c0-6a0b9f1c26d2 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:55.717865 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0066fd72-d9d7-46fb-99c0-6a0b9f1c26d2 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:55.723010 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67dc636-3c2e-40e2-b7fc-6069516a5c2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:55.724055 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67dc636-3c2e-40e2-b7fc-6069516a5c2b admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:55.724549 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67dc636-3c2e-40e2-b7fc-6069516a5c2b admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:55.725020 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67dc636-3c2e-40e2-b7fc-6069516a5c2b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:55.735377 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67dc636-3c2e-40e2-b7fc-6069516a5c2b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:55.737462 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67dc636-3c2e-40e2-b7fc-6069516a5c2b admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:55.754821 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: WARNING keystone.server.flask.application [None req-e67dc636-3c2e-40e2-b7fc-6069516a5c2b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 25 02:23:55.756599 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 446/906] 10.222.0.117 () {56 vars in 1134 bytes} [Tue Jan 25 02:23:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:23:55.763536 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716818c8-5b30-46fb-8530-7f3ce2489657 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:55.773769 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716818c8-5b30-46fb-8530-7f3ce2489657 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:55.780450 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f16cd1d-3e6f-4dd4-9d0b-a200255c8d0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:55.781888 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f16cd1d-3e6f-4dd4-9d0b-a200255c8d0f admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:55.782768 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f16cd1d-3e6f-4dd4-9d0b-a200255c8d0f admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:55.783255 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f16cd1d-3e6f-4dd4-9d0b-a200255c8d0f admin admin] PATH_INFO: `/v3/domains` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:55.784273 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f16cd1d-3e6f-4dd4-9d0b-a200255c8d0f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:55.785065 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f16cd1d-3e6f-4dd4-9d0b-a200255c8d0f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:55.787225 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f16cd1d-3e6f-4dd4-9d0b-a200255c8d0f admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:55.800484 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 461/907] 10.222.0.117 () {56 vars in 1135 bytes} [Tue Jan 25 02:23:55 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:55.806186 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67dc636-3c2e-40e2-b7fc-6069516a5c2b admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:55.817336 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67dc636-3c2e-40e2-b7fc-6069516a5c2b admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:55.822371 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb0660e-ebd0-4e4d-803f-f1f347a8e749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:55.824116 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb0660e-ebd0-4e4d-803f-f1f347a8e749 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:55.824649 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb0660e-ebd0-4e4d-803f-f1f347a8e749 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:55.825122 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb0660e-ebd0-4e4d-803f-f1f347a8e749 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:55.833261 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb0660e-ebd0-4e4d-803f-f1f347a8e749 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:55.835588 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb0660e-ebd0-4e4d-803f-f1f347a8e749 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:55.852113 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: WARNING keystone.server.flask.application [None req-0fb0660e-ebd0-4e4d-803f-f1f347a8e749 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jan 25 02:23:55.854419 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 447/908] 10.222.0.117 () {56 vars in 1143 bytes} [Tue Jan 25 02:23:55 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:23:55.860277 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f16cd1d-3e6f-4dd4-9d0b-a200255c8d0f admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:55.871618 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f16cd1d-3e6f-4dd4-9d0b-a200255c8d0f admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:55.876762 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1197b34c-cdf3-42ae-b3b5-f79f8b1f1239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:55.877748 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1197b34c-cdf3-42ae-b3b5-f79f8b1f1239 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:55.878237 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1197b34c-cdf3-42ae-b3b5-f79f8b1f1239 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:55.878756 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1197b34c-cdf3-42ae-b3b5-f79f8b1f1239 admin admin] PATH_INFO: `/v3/users` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:55.879876 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1197b34c-cdf3-42ae-b3b5-f79f8b1f1239 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:55.880386 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1197b34c-cdf3-42ae-b3b5-f79f8b1f1239 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:55.882549 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1197b34c-cdf3-42ae-b3b5-f79f8b1f1239 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:55.902903 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 462/909] 10.222.0.117 () {56 vars in 1175 bytes} [Tue Jan 25 02:23:55 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 386 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:55.909010 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb0660e-ebd0-4e4d-803f-f1f347a8e749 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:55.922025 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb0660e-ebd0-4e4d-803f-f1f347a8e749 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:55.926927 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5948536f-0076-46fd-a845-2a863a6ae8f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:55.927780 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5948536f-0076-46fd-a845-2a863a6ae8f9 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:55.928067 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5948536f-0076-46fd-a845-2a863a6ae8f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:55.928341 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5948536f-0076-46fd-a845-2a863a6ae8f9 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:55.940301 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5948536f-0076-46fd-a845-2a863a6ae8f9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:55.942147 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5948536f-0076-46fd-a845-2a863a6ae8f9 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:55.960123 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: WARNING keystone.server.flask.application [None req-5948536f-0076-46fd-a845-2a863a6ae8f9 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 25 02:23:55.961690 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 448/910] 10.222.0.117 () {56 vars in 1134 bytes} [Tue Jan 25 02:23:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 25 02:23:55.968585 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1197b34c-cdf3-42ae-b3b5-f79f8b1f1239 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:55.979944 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1197b34c-cdf3-42ae-b3b5-f79f8b1f1239 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:55.985204 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421307e4-f006-4119-9484-774c19acf108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:55.985894 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421307e4-f006-4119-9484-774c19acf108 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:55.986180 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421307e4-f006-4119-9484-774c19acf108 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:55.986503 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421307e4-f006-4119-9484-774c19acf108 admin admin] PATH_INFO: `/v3/domains` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:55.987266 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421307e4-f006-4119-9484-774c19acf108 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:55.987623 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421307e4-f006-4119-9484-774c19acf108 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:55.989387 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421307e4-f006-4119-9484-774c19acf108 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:56.002819 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 463/911] 10.222.0.117 () {56 vars in 1135 bytes} [Tue Jan 25 02:23:55 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:56.008329 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5948536f-0076-46fd-a845-2a863a6ae8f9 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:56.018880 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5948536f-0076-46fd-a845-2a863a6ae8f9 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:56.023607 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c716620-135f-4443-949f-2dcfd860d876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:56.024465 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c716620-135f-4443-949f-2dcfd860d876 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:56.024749 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c716620-135f-4443-949f-2dcfd860d876 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:56.025023 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c716620-135f-4443-949f-2dcfd860d876 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:56.033224 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c716620-135f-4443-949f-2dcfd860d876 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:56.035230 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c716620-135f-4443-949f-2dcfd860d876 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:56.048438 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: WARNING keystone.server.flask.application [None req-3c716620-135f-4443-949f-2dcfd860d876 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 25 02:23:56.049905 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 449/912] 10.222.0.117 () {56 vars in 1137 bytes} [Tue Jan 25 02:23:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:23:56.055547 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421307e4-f006-4119-9484-774c19acf108 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:56.065806 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421307e4-f006-4119-9484-774c19acf108 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:56.070504 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7046fe-b65f-4ff6-a994-aca02cbd6439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:56.071096 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7046fe-b65f-4ff6-a994-aca02cbd6439 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:56.071377 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7046fe-b65f-4ff6-a994-aca02cbd6439 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:56.071648 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7046fe-b65f-4ff6-a994-aca02cbd6439 admin admin] PATH_INFO: `/v3/projects` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:56.073026 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7046fe-b65f-4ff6-a994-aca02cbd6439 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:56.073319 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7046fe-b65f-4ff6-a994-aca02cbd6439 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:56.075270 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7046fe-b65f-4ff6-a994-aca02cbd6439 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:56.089208 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 464/913] 10.222.0.117 () {56 vars in 1174 bytes} [Tue Jan 25 02:23:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:56.095197 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c716620-135f-4443-949f-2dcfd860d876 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:56.105592 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c716620-135f-4443-949f-2dcfd860d876 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:56.110176 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7daf4ee-6d91-4d55-9c74-78d09940e32a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:56.111037 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7daf4ee-6d91-4d55-9c74-78d09940e32a admin admin] REQUEST_METHOD: `PUT` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:56.111313 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7daf4ee-6d91-4d55-9c74-78d09940e32a admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:56.111584 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7daf4ee-6d91-4d55-9c74-78d09940e32a admin admin] PATH_INFO: `/v3/projects/61a6fe9d4c914755bb0a64c392bd16aa/users/5924414ee6e948a680b8b75c8797b466/roles/06cf9f8251c94c588ee2dafb34cab2a8` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:56.113853 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7daf4ee-6d91-4d55-9c74-78d09940e32a admin admin] RBAC: Authorizing `identity:create_grant(project_id=61a6fe9d4c914755bb0a64c392bd16aa, user_id=5924414ee6e948a680b8b75c8797b466, role_id=06cf9f8251c94c588ee2dafb34cab2a8)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:56.116527 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7daf4ee-6d91-4d55-9c74-78d09940e32a admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:56.132344 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 450/914] 10.222.0.117 () {58 vars in 1465 bytes} [Tue Jan 25 02:23:56 2022] PUT /identity/v3/projects/61a6fe9d4c914755bb0a64c392bd16aa/users/5924414ee6e948a680b8b75c8797b466/roles/06cf9f8251c94c588ee2dafb34cab2a8 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:23:56.232151 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804b94b2-cf05-4e98-bbb3-7a5f22860470 None None] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:56.232480 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804b94b2-cf05-4e98-bbb3-7a5f22860470 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:56.232710 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804b94b2-cf05-4e98-bbb3-7a5f22860470 None None] PATH_INFO: `/` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:56.234791 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 465/915] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:23:56 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:23:56.240216 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19efacc6-d30c-4d40-ac98-8b6457b15c84 None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:56.240560 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19efacc6-d30c-4d40-ac98-8b6457b15c84 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:56.240842 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19efacc6-d30c-4d40-ac98-8b6457b15c84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:56.261115 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-19efacc6-d30c-4d40-ac98-8b6457b15c84 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:23:56.262482 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-19efacc6-d30c-4d40-ac98-8b6457b15c84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:23:56.325467 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 451/916] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:23:56 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:23:56.349417 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804b94b2-cf05-4e98-bbb3-7a5f22860470 None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:56.362982 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804b94b2-cf05-4e98-bbb3-7a5f22860470 None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:56.367403 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07aadf51-5bd8-4a69-abe8-ba75c02d4e4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:56.368088 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aadf51-5bd8-4a69-abe8-ba75c02d4e4d admin admin] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:56.368377 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aadf51-5bd8-4a69-abe8-ba75c02d4e4d admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:56.368656 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aadf51-5bd8-4a69-abe8-ba75c02d4e4d admin admin] PATH_INFO: `/v3/services` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:56.369466 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07aadf51-5bd8-4a69-abe8-ba75c02d4e4d admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:56.371240 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07aadf51-5bd8-4a69-abe8-ba75c02d4e4d admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:56.385702 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 466/917] 10.222.0.117 () {60 vars in 1167 bytes} [Tue Jan 25 02:23:56 2022] POST /identity/v3/services => generated 242 bytes in 37 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 02:23:56.686586 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce04a6a-21e2-44f4-bd01-4f61c35e1533 None None] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:56.686878 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce04a6a-21e2-44f4-bd01-4f61c35e1533 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:56.687159 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce04a6a-21e2-44f4-bd01-4f61c35e1533 None None] PATH_INFO: `/` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:56.689221 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 452/918] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:23:56 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:23:56.695319 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ae1c09-8ee5-442e-b34e-0474771099a4 None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:56.695319 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ae1c09-8ee5-442e-b34e-0474771099a4 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:56.695319 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ae1c09-8ee5-442e-b34e-0474771099a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:56.714431 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-d6ae1c09-8ee5-442e-b34e-0474771099a4 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:23:56.715876 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-d6ae1c09-8ee5-442e-b34e-0474771099a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:23:56.739790 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 467/919] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:23:56 2022] POST /identity/v3/auth/tokens => generated 1768 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 25 02:23:56.757227 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce04a6a-21e2-44f4-bd01-4f61c35e1533 None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:56.770011 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce04a6a-21e2-44f4-bd01-4f61c35e1533 None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:56.774641 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5227d02e-5565-46d4-995b-a456131e34ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:56.775638 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5227d02e-5565-46d4-995b-a456131e34ad admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:56.776195 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5227d02e-5565-46d4-995b-a456131e34ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:56.776613 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5227d02e-5565-46d4-995b-a456131e34ad admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:56.777521 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5227d02e-5565-46d4-995b-a456131e34ad admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:56.779259 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5227d02e-5565-46d4-995b-a456131e34ad admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:56.790652 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: WARNING keystone.server.flask.application [None req-5227d02e-5565-46d4-995b-a456131e34ad admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jan 25 02:23:56.797482 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 453/920] 10.222.0.117 () {56 vars in 1140 bytes} [Tue Jan 25 02:23:56 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:23:56.798940 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ae1c09-8ee5-442e-b34e-0474771099a4 None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:56.808740 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ae1c09-8ee5-442e-b34e-0474771099a4 None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:56.813458 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00379752-ce76-4ee5-bf1e-ffa954c626ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:56.814270 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00379752-ce76-4ee5-bf1e-ffa954c626ed admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:56.814725 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00379752-ce76-4ee5-bf1e-ffa954c626ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:56.815141 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00379752-ce76-4ee5-bf1e-ffa954c626ed admin admin] PATH_INFO: `/v3/services` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:56.816040 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00379752-ce76-4ee5-bf1e-ffa954c626ed admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:56.816491 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00379752-ce76-4ee5-bf1e-ffa954c626ed admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:56.818237 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00379752-ce76-4ee5-bf1e-ffa954c626ed admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:56.829627 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 468/921] 10.222.0.117 () {56 vars in 1140 bytes} [Tue Jan 25 02:23:56 2022] GET /identity/v3/services?name=volumev3 => generated 126 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:56.831112 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5227d02e-5565-46d4-995b-a456131e34ad admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:56.841912 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5227d02e-5565-46d4-995b-a456131e34ad admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:56.847155 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db46b22-79ce-40d6-ba86-fa7053932c02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:56.848008 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db46b22-79ce-40d6-ba86-fa7053932c02 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:56.848463 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db46b22-79ce-40d6-ba86-fa7053932c02 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:56.848895 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db46b22-79ce-40d6-ba86-fa7053932c02 admin admin] PATH_INFO: `/v3/services` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:56.849756 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db46b22-79ce-40d6-ba86-fa7053932c02 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:56.850203 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db46b22-79ce-40d6-ba86-fa7053932c02 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:56.851951 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db46b22-79ce-40d6-ba86-fa7053932c02 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:56.862534 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 454/922] 10.222.0.117 () {56 vars in 1140 bytes} [Tue Jan 25 02:23:56 2022] GET /identity/v3/services?type=volumev3 => generated 364 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:56.864068 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00379752-ce76-4ee5-bf1e-ffa954c626ed admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:56.874632 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00379752-ce76-4ee5-bf1e-ffa954c626ed admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:56.879561 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d285c4d4-0597-46c1-857a-3a51f5d25f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:56.880447 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d285c4d4-0597-46c1-857a-3a51f5d25f22 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:56.880897 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d285c4d4-0597-46c1-857a-3a51f5d25f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:56.881363 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d285c4d4-0597-46c1-857a-3a51f5d25f22 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:56.882312 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d285c4d4-0597-46c1-857a-3a51f5d25f22 admin admin] RBAC: Adding query filter params (interface=public, service_id=28d3f5972f064c20a85d321ab7156dbe, region_id=RegionOne) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:56.882814 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d285c4d4-0597-46c1-857a-3a51f5d25f22 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:56.884696 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d285c4d4-0597-46c1-857a-3a51f5d25f22 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:56.894935 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 469/923] 10.222.0.117 () {56 vars in 1277 bytes} [Tue Jan 25 02:23:56 2022] GET /identity/v3/endpoints?service_id=28d3f5972f064c20a85d321ab7156dbe&interface=public®ion_id=RegionOne => generated 195 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:56.896515 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db46b22-79ce-40d6-ba86-fa7053932c02 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:56.907024 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db46b22-79ce-40d6-ba86-fa7053932c02 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:56.912003 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63ca2c0-958f-4df9-b76c-11daf79bc6d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:56.912879 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63ca2c0-958f-4df9-b76c-11daf79bc6d6 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:56.913366 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63ca2c0-958f-4df9-b76c-11daf79bc6d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:56.913795 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63ca2c0-958f-4df9-b76c-11daf79bc6d6 admin admin] PATH_INFO: `/v3/services` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:56.914673 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63ca2c0-958f-4df9-b76c-11daf79bc6d6 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:56.917136 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63ca2c0-958f-4df9-b76c-11daf79bc6d6 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:56.927891 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 455/924] 10.222.0.117 () {56 vars in 1113 bytes} [Tue Jan 25 02:23:56 2022] GET /identity/v3/services => generated 1504 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 02:23:57.460524 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4398b193-276b-4d74-b2dc-ba270cb772a3 None None] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:57.461034 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4398b193-276b-4d74-b2dc-ba270cb772a3 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:57.461108 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4398b193-276b-4d74-b2dc-ba270cb772a3 None None] PATH_INFO: `/` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:57.463090 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 470/925] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:23:57 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:23:57.469128 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a09a8bd-d8ea-44c1-a85f-89b8632a5255 None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:57.469419 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a09a8bd-d8ea-44c1-a85f-89b8632a5255 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:57.469954 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a09a8bd-d8ea-44c1-a85f-89b8632a5255 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:57.488369 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-4a09a8bd-d8ea-44c1-a85f-89b8632a5255 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:23:57.489542 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-4a09a8bd-d8ea-44c1-a85f-89b8632a5255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:23:57.498376 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 456/926] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:23:57 2022] POST /identity/v3/auth/tokens => generated 1768 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:23:57.521422 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4398b193-276b-4d74-b2dc-ba270cb772a3 None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:57.534127 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4398b193-276b-4d74-b2dc-ba270cb772a3 None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:57.538532 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40eb213-c048-43d1-bb3c-ca673ac3e99c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:57.539323 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40eb213-c048-43d1-bb3c-ca673ac3e99c admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:57.539601 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40eb213-c048-43d1-bb3c-ca673ac3e99c admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:57.539898 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40eb213-c048-43d1-bb3c-ca673ac3e99c admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:57.540552 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40eb213-c048-43d1-bb3c-ca673ac3e99c admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:57.543011 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40eb213-c048-43d1-bb3c-ca673ac3e99c admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:57.554258 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: WARNING keystone.server.flask.application [None req-c40eb213-c048-43d1-bb3c-ca673ac3e99c admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jan 25 02:23:57.555664 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 471/927] 10.222.0.117 () {56 vars in 1158 bytes} [Tue Jan 25 02:23:57 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:23:57.562338 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a09a8bd-d8ea-44c1-a85f-89b8632a5255 None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:57.571378 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a09a8bd-d8ea-44c1-a85f-89b8632a5255 None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:57.581275 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3eef6a-3962-45ac-821f-e377f1b3a9fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:57.582317 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3eef6a-3962-45ac-821f-e377f1b3a9fd admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:57.582811 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3eef6a-3962-45ac-821f-e377f1b3a9fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:57.583316 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3eef6a-3962-45ac-821f-e377f1b3a9fd admin admin] PATH_INFO: `/v3/services` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:57.584326 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3eef6a-3962-45ac-821f-e377f1b3a9fd admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:57.584849 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3eef6a-3962-45ac-821f-e377f1b3a9fd admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:57.586736 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3eef6a-3962-45ac-821f-e377f1b3a9fd admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:57.595383 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 457/928] 10.222.0.117 () {56 vars in 1152 bytes} [Tue Jan 25 02:23:57 2022] GET /identity/v3/services?name=compute_legacy => generated 132 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:57.600793 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40eb213-c048-43d1-bb3c-ca673ac3e99c admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:57.611601 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40eb213-c048-43d1-bb3c-ca673ac3e99c admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:57.616193 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8c019d-a9b9-4803-a601-371eb3ab3692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:57.616842 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8c019d-a9b9-4803-a601-371eb3ab3692 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:57.617119 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8c019d-a9b9-4803-a601-371eb3ab3692 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:57.617441 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8c019d-a9b9-4803-a601-371eb3ab3692 admin admin] PATH_INFO: `/v3/services` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:57.618221 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8c019d-a9b9-4803-a601-371eb3ab3692 admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:57.618508 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8c019d-a9b9-4803-a601-371eb3ab3692 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:57.621127 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8c019d-a9b9-4803-a601-371eb3ab3692 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:57.626575 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 472/929] 10.222.0.117 () {56 vars in 1152 bytes} [Tue Jan 25 02:23:57 2022] GET /identity/v3/services?type=compute_legacy => generated 388 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:57.632053 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3eef6a-3962-45ac-821f-e377f1b3a9fd admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:57.643146 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3eef6a-3962-45ac-821f-e377f1b3a9fd admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:57.647680 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c10d8e-445a-44fc-a654-fa4a6ab6f879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:57.648369 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c10d8e-445a-44fc-a654-fa4a6ab6f879 admin admin] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:57.648652 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c10d8e-445a-44fc-a654-fa4a6ab6f879 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:57.648928 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c10d8e-445a-44fc-a654-fa4a6ab6f879 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:57.649691 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c10d8e-445a-44fc-a654-fa4a6ab6f879 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:57.652168 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c10d8e-445a-44fc-a654-fa4a6ab6f879 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:57.674037 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 458/930] 10.222.0.117 () {60 vars in 1170 bytes} [Tue Jan 25 02:23:57 2022] POST /identity/v3/endpoints => generated 349 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 02:23:58.487899 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d222190-34db-491c-866a-3fc448400476 None None] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:58.488430 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d222190-34db-491c-866a-3fc448400476 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:58.488430 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d222190-34db-491c-866a-3fc448400476 None None] PATH_INFO: `/` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:58.490574 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 473/931] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:23:58 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:23:58.496997 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043254a4-5e3b-4cc9-beed-2bbfc91afebb None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:58.497803 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043254a4-5e3b-4cc9-beed-2bbfc91afebb None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:58.497803 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043254a4-5e3b-4cc9-beed-2bbfc91afebb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:58.517126 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-043254a4-5e3b-4cc9-beed-2bbfc91afebb None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:23:58.518329 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-043254a4-5e3b-4cc9-beed-2bbfc91afebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:23:58.537126 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 459/932] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:23:58 2022] POST /identity/v3/auth/tokens => generated 1956 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:23:58.563328 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d222190-34db-491c-866a-3fc448400476 None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:58.576261 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d222190-34db-491c-866a-3fc448400476 None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:58.581073 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f204bdf-43a0-435c-a331-8c0d082544d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:58.582102 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f204bdf-43a0-435c-a331-8c0d082544d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:58.582600 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f204bdf-43a0-435c-a331-8c0d082544d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:58.583093 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f204bdf-43a0-435c-a331-8c0d082544d0 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:58.595959 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f204bdf-43a0-435c-a331-8c0d082544d0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 25 02:23:58.603602 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: WARNING keystone.server.flask.application [None req-4f204bdf-43a0-435c-a331-8c0d082544d0 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jan 25 02:23:58.610589 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 474/933] 10.222.0.117 () {56 vars in 1146 bytes} [Tue Jan 25 02:23:58 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:23:58.612176 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043254a4-5e3b-4cc9-beed-2bbfc91afebb None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:58.621849 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043254a4-5e3b-4cc9-beed-2bbfc91afebb None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:58.626616 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9195c20-09f5-4767-a7d9-39e75cbb1ac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:58.627520 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9195c20-09f5-4767-a7d9-39e75cbb1ac1 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:58.628027 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9195c20-09f5-4767-a7d9-39e75cbb1ac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:58.628502 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9195c20-09f5-4767-a7d9-39e75cbb1ac1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:58.629478 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9195c20-09f5-4767-a7d9-39e75cbb1ac1 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:58.629980 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9195c20-09f5-4767-a7d9-39e75cbb1ac1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:58.631831 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9195c20-09f5-4767-a7d9-39e75cbb1ac1 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:58.645478 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 460/934] 10.222.0.117 () {56 vars in 1141 bytes} [Tue Jan 25 02:23:58 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 340 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:58.647081 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f204bdf-43a0-435c-a331-8c0d082544d0 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:58.658079 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f204bdf-43a0-435c-a331-8c0d082544d0 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:58.662896 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5f0233-674b-471e-9b20-f86cab8e6816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:58.663939 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5f0233-674b-471e-9b20-f86cab8e6816 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:58.664420 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5f0233-674b-471e-9b20-f86cab8e6816 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:58.664887 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5f0233-674b-471e-9b20-f86cab8e6816 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:58.676281 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5f0233-674b-471e-9b20-f86cab8e6816 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:58.678387 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5f0233-674b-471e-9b20-f86cab8e6816 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:58.696552 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: WARNING keystone.server.flask.application [None req-0d5f0233-674b-471e-9b20-f86cab8e6816 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 25 02:23:58.703169 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 475/935] 10.222.0.117 () {56 vars in 1134 bytes} [Tue Jan 25 02:23:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:23:58.704659 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9195c20-09f5-4767-a7d9-39e75cbb1ac1 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:58.714502 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9195c20-09f5-4767-a7d9-39e75cbb1ac1 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:58.719246 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf4b6a7-bd3b-4011-b361-fc1570546e23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:58.720201 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf4b6a7-bd3b-4011-b361-fc1570546e23 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:58.720483 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf4b6a7-bd3b-4011-b361-fc1570546e23 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:58.720757 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf4b6a7-bd3b-4011-b361-fc1570546e23 admin admin] PATH_INFO: `/v3/domains` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:58.721502 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf4b6a7-bd3b-4011-b361-fc1570546e23 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:58.721806 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf4b6a7-bd3b-4011-b361-fc1570546e23 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:58.723398 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf4b6a7-bd3b-4011-b361-fc1570546e23 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:58.739957 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 461/936] 10.222.0.117 () {56 vars in 1135 bytes} [Tue Jan 25 02:23:58 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:58.741486 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5f0233-674b-471e-9b20-f86cab8e6816 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:58.742114 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d45467-b6f6-4964-930c-533a7d764929 None None] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:58.742407 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d45467-b6f6-4964-930c-533a7d764929 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:58.742687 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d45467-b6f6-4964-930c-533a7d764929 None None] PATH_INFO: `/` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:58.745494 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 462/937] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:23:58 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:23:58.750805 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e8da97-d53d-4a61-bc84-870bbc3c1fa9 None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:58.751084 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e8da97-d53d-4a61-bc84-870bbc3c1fa9 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:58.751356 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e8da97-d53d-4a61-bc84-870bbc3c1fa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:58.752522 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5f0233-674b-471e-9b20-f86cab8e6816 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:58.757509 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0653ad7c-dec6-448b-96c5-90d1668f399f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:58.758944 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0653ad7c-dec6-448b-96c5-90d1668f399f admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:58.758944 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0653ad7c-dec6-448b-96c5-90d1668f399f admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:58.758944 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0653ad7c-dec6-448b-96c5-90d1668f399f admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:58.767368 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0653ad7c-dec6-448b-96c5-90d1668f399f admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:58.769431 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0653ad7c-dec6-448b-96c5-90d1668f399f admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:58.770912 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-b6e8da97-d53d-4a61-bc84-870bbc3c1fa9 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:23:58.772128 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-b6e8da97-d53d-4a61-bc84-870bbc3c1fa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:23:58.785105 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: WARNING keystone.server.flask.application [None req-0653ad7c-dec6-448b-96c5-90d1668f399f admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jan 25 02:23:58.787776 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 463/939] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:23:58 2022] POST /identity/v3/auth/tokens => generated 1956 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 25 02:23:58.790838 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 476/939] 10.222.0.117 () {56 vars in 1143 bytes} [Tue Jan 25 02:23:58 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:23:58.792126 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e8da97-d53d-4a61-bc84-870bbc3c1fa9 None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:58.801521 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e8da97-d53d-4a61-bc84-870bbc3c1fa9 None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:58.804305 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0653ad7c-dec6-448b-96c5-90d1668f399f admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:58.807541 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d774fe-a683-44ac-8738-cfc92c587e0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:58.808713 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d774fe-a683-44ac-8738-cfc92c587e0f admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:58.808995 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d774fe-a683-44ac-8738-cfc92c587e0f admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:58.809265 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d774fe-a683-44ac-8738-cfc92c587e0f admin admin] PATH_INFO: `/v3/users` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:58.810183 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d774fe-a683-44ac-8738-cfc92c587e0f admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:58.810487 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d774fe-a683-44ac-8738-cfc92c587e0f admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:58.812488 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d774fe-a683-44ac-8738-cfc92c587e0f admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:58.815780 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0653ad7c-dec6-448b-96c5-90d1668f399f admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:58.822058 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7defcadc-9004-486b-b8db-7e79748cf045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:58.822058 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7defcadc-9004-486b-b8db-7e79748cf045 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:58.822058 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7defcadc-9004-486b-b8db-7e79748cf045 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:58.822058 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7defcadc-9004-486b-b8db-7e79748cf045 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:58.823430 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7defcadc-9004-486b-b8db-7e79748cf045 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:58.824080 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7defcadc-9004-486b-b8db-7e79748cf045 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:58.838398 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 464/940] 10.222.0.117 () {56 vars in 1175 bytes} [Tue Jan 25 02:23:58 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 386 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 02:23:58.842665 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: WARNING keystone.server.flask.application [None req-7defcadc-9004-486b-b8db-7e79748cf045 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jan 25 02:23:58.844324 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 477/941] 10.222.0.117 () {56 vars in 1152 bytes} [Tue Jan 25 02:23:58 2022] GET /identity/v3/services/object-store => generated 93 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 25 02:23:58.845834 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d774fe-a683-44ac-8738-cfc92c587e0f admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:58.853220 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7defcadc-9004-486b-b8db-7e79748cf045 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:58.859644 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d774fe-a683-44ac-8738-cfc92c587e0f admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:58.864673 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae28691-17bd-481f-82b7-5d9dbdf5fa75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:58.865606 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae28691-17bd-481f-82b7-5d9dbdf5fa75 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:58.866111 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae28691-17bd-481f-82b7-5d9dbdf5fa75 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:58.866225 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7defcadc-9004-486b-b8db-7e79748cf045 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:58.866689 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae28691-17bd-481f-82b7-5d9dbdf5fa75 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:58.871790 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385efc45-8eb3-45f8-82fe-89bb700a2152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:58.872500 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385efc45-8eb3-45f8-82fe-89bb700a2152 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:58.872783 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385efc45-8eb3-45f8-82fe-89bb700a2152 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:58.873061 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385efc45-8eb3-45f8-82fe-89bb700a2152 admin admin] PATH_INFO: `/v3/services` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:58.874001 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385efc45-8eb3-45f8-82fe-89bb700a2152 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:58.874174 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385efc45-8eb3-45f8-82fe-89bb700a2152 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:58.876030 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385efc45-8eb3-45f8-82fe-89bb700a2152 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:58.878145 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae28691-17bd-481f-82b7-5d9dbdf5fa75 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:58.880141 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae28691-17bd-481f-82b7-5d9dbdf5fa75 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:58.886013 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 478/942] 10.222.0.117 () {56 vars in 1148 bytes} [Tue Jan 25 02:23:58 2022] GET /identity/v3/services?name=object-store => generated 130 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:58.887399 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385efc45-8eb3-45f8-82fe-89bb700a2152 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:58.890283 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 465/943] 10.222.0.117 () {58 vars in 1329 bytes} [Tue Jan 25 02:23:58 2022] GET /identity/v3/auth/tokens => generated 1956 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 25 02:23:58.897730 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae28691-17bd-481f-82b7-5d9dbdf5fa75 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:58.903631 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385efc45-8eb3-45f8-82fe-89bb700a2152 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:58.907907 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae28691-17bd-481f-82b7-5d9dbdf5fa75 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:58.910027 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011d75d9-d663-4918-93ec-5e0a526cdc49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:58.911212 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011d75d9-d663-4918-93ec-5e0a526cdc49 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:58.911802 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011d75d9-d663-4918-93ec-5e0a526cdc49 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:58.912360 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011d75d9-d663-4918-93ec-5e0a526cdc49 admin admin] PATH_INFO: `/v3/services` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:58.912969 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766f516a-9a12-47b7-a4b6-e1e9cfdb19e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:58.913650 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011d75d9-d663-4918-93ec-5e0a526cdc49 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:58.913770 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766f516a-9a12-47b7-a4b6-e1e9cfdb19e3 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:58.914047 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766f516a-9a12-47b7-a4b6-e1e9cfdb19e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:58.914322 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766f516a-9a12-47b7-a4b6-e1e9cfdb19e3 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:58.914710 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011d75d9-d663-4918-93ec-5e0a526cdc49 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:58.917677 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011d75d9-d663-4918-93ec-5e0a526cdc49 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:58.927754 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766f516a-9a12-47b7-a4b6-e1e9cfdb19e3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:58.928306 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766f516a-9a12-47b7-a4b6-e1e9cfdb19e3 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:58.929111 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 479/944] 10.222.0.117 () {56 vars in 1148 bytes} [Tue Jan 25 02:23:58 2022] GET /identity/v3/services?type=object-store => generated 358 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:58.930379 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011d75d9-d663-4918-93ec-5e0a526cdc49 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:58.940809 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011d75d9-d663-4918-93ec-5e0a526cdc49 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:58.945526 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f192116b-d2a5-4432-bd25-7c9a9b73f0d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:58.946288 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f192116b-d2a5-4432-bd25-7c9a9b73f0d5 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:58.946669 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f192116b-d2a5-4432-bd25-7c9a9b73f0d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:58.947042 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f192116b-d2a5-4432-bd25-7c9a9b73f0d5 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:58.947478 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: WARNING keystone.server.flask.application [None req-766f516a-9a12-47b7-a4b6-e1e9cfdb19e3 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 25 02:23:58.948204 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f192116b-d2a5-4432-bd25-7c9a9b73f0d5 admin admin] RBAC: Adding query filter params (interface=public, service_id=82bbe8b8a7e14a6d97f926197028e573, region_id=RegionOne) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:58.949022 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 466/945] 10.222.0.117 () {56 vars in 1134 bytes} [Tue Jan 25 02:23:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:23:58.953454 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f192116b-d2a5-4432-bd25-7c9a9b73f0d5 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:58.954793 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766f516a-9a12-47b7-a4b6-e1e9cfdb19e3 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:58.955571 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f192116b-d2a5-4432-bd25-7c9a9b73f0d5 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:58.965129 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766f516a-9a12-47b7-a4b6-e1e9cfdb19e3 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:58.965921 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 480/946] 10.222.0.117 () {56 vars in 1277 bytes} [Tue Jan 25 02:23:58 2022] GET /identity/v3/endpoints?service_id=82bbe8b8a7e14a6d97f926197028e573&interface=public®ion_id=RegionOne => generated 195 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:58.967172 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f192116b-d2a5-4432-bd25-7c9a9b73f0d5 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:58.970831 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe26fd6-c76e-4e18-a25a-ec9b754e5614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:58.971821 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe26fd6-c76e-4e18-a25a-ec9b754e5614 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:58.972337 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe26fd6-c76e-4e18-a25a-ec9b754e5614 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:58.972785 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe26fd6-c76e-4e18-a25a-ec9b754e5614 admin admin] PATH_INFO: `/v3/domains` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:58.973740 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe26fd6-c76e-4e18-a25a-ec9b754e5614 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:58.974213 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe26fd6-c76e-4e18-a25a-ec9b754e5614 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:58.976066 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe26fd6-c76e-4e18-a25a-ec9b754e5614 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:58.977785 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f192116b-d2a5-4432-bd25-7c9a9b73f0d5 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:58.983108 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071f96a1-9799-4309-8342-e03d4b13c77b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:58.983879 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071f96a1-9799-4309-8342-e03d4b13c77b admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:58.984221 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071f96a1-9799-4309-8342-e03d4b13c77b admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:58.984568 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071f96a1-9799-4309-8342-e03d4b13c77b admin admin] PATH_INFO: `/v3/services` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:58.985331 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071f96a1-9799-4309-8342-e03d4b13c77b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:58.987022 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071f96a1-9799-4309-8342-e03d4b13c77b admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:58.996747 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 467/948] 10.222.0.117 () {56 vars in 1135 bytes} [Tue Jan 25 02:23:58 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 02:23:58.999769 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 481/948] 10.222.0.117 () {56 vars in 1113 bytes} [Tue Jan 25 02:23:58 2022] GET /identity/v3/services => generated 1504 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 02:23:59.001077 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe26fd6-c76e-4e18-a25a-ec9b754e5614 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:59.012873 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe26fd6-c76e-4e18-a25a-ec9b754e5614 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:59.021078 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271b8636-e38a-448e-b2d9-461ff8917bf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:59.022370 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271b8636-e38a-448e-b2d9-461ff8917bf4 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:59.022922 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271b8636-e38a-448e-b2d9-461ff8917bf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:59.023421 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271b8636-e38a-448e-b2d9-461ff8917bf4 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:59.033510 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271b8636-e38a-448e-b2d9-461ff8917bf4 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:59.036047 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271b8636-e38a-448e-b2d9-461ff8917bf4 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:59.052958 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: WARNING keystone.server.flask.application [None req-271b8636-e38a-448e-b2d9-461ff8917bf4 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 25 02:23:59.054951 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 468/949] 10.222.0.117 () {56 vars in 1137 bytes} [Tue Jan 25 02:23:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 25 02:23:59.062568 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071f96a1-9799-4309-8342-e03d4b13c77b admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:59.073374 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071f96a1-9799-4309-8342-e03d4b13c77b admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:59.079132 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ef93ad-f91a-48cc-8347-5e1a0f42bfd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:59.080215 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ef93ad-f91a-48cc-8347-5e1a0f42bfd3 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:59.080724 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ef93ad-f91a-48cc-8347-5e1a0f42bfd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:59.081194 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ef93ad-f91a-48cc-8347-5e1a0f42bfd3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:59.082282 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ef93ad-f91a-48cc-8347-5e1a0f42bfd3 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:59.082789 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ef93ad-f91a-48cc-8347-5e1a0f42bfd3 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:59.084971 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ef93ad-f91a-48cc-8347-5e1a0f42bfd3 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:59.099804 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 482/950] 10.222.0.117 () {56 vars in 1174 bytes} [Tue Jan 25 02:23:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:59.107398 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271b8636-e38a-448e-b2d9-461ff8917bf4 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:59.118647 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271b8636-e38a-448e-b2d9-461ff8917bf4 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:59.124684 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebfdc6d-d17e-4c56-b5d0-d3e4c0890bde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:59.125729 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebfdc6d-d17e-4c56-b5d0-d3e4c0890bde admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:59.126271 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebfdc6d-d17e-4c56-b5d0-d3e4c0890bde admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:59.126744 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebfdc6d-d17e-4c56-b5d0-d3e4c0890bde admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:59.127922 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebfdc6d-d17e-4c56-b5d0-d3e4c0890bde admin admin] RBAC: Adding query filter params (role.id=06cf9f8251c94c588ee2dafb34cab2a8, scope.project.id=61a6fe9d4c914755bb0a64c392bd16aa, user.id=5924414ee6e948a680b8b75c8797b466) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:59.128440 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebfdc6d-d17e-4c56-b5d0-d3e4c0890bde admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:59.130636 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebfdc6d-d17e-4c56-b5d0-d3e4c0890bde admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:59.138921 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 469/951] 10.222.0.117 () {56 vars in 1400 bytes} [Tue Jan 25 02:23:59 2022] GET /identity/v3/role_assignments?user.id=5924414ee6e948a680b8b75c8797b466&scope.project.id=61a6fe9d4c914755bb0a64c392bd16aa&role.id=06cf9f8251c94c588ee2dafb34cab2a8 => generated 610 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:59.297248 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5972ec-34d6-4c50-9a9f-82173b8ff43e None None] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:59.297584 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5972ec-34d6-4c50-9a9f-82173b8ff43e None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:59.297780 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5972ec-34d6-4c50-9a9f-82173b8ff43e None None] PATH_INFO: `/` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:59.299624 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 483/952] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:23:59 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:23:59.305519 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b3576c-a99a-47ea-9323-90ed9ae134a9 None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:59.306080 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b3576c-a99a-47ea-9323-90ed9ae134a9 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:59.306587 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b3576c-a99a-47ea-9323-90ed9ae134a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:59.327454 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-c5b3576c-a99a-47ea-9323-90ed9ae134a9 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:23:59.328706 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-c5b3576c-a99a-47ea-9323-90ed9ae134a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:23:59.336911 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 470/953] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:23:59 2022] POST /identity/v3/auth/tokens => generated 1956 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:23:59.361669 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5972ec-34d6-4c50-9a9f-82173b8ff43e None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:59.375459 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5972ec-34d6-4c50-9a9f-82173b8ff43e None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:59.380457 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ec75fc-9597-459b-8e3c-e379a42f178e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:59.381259 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ec75fc-9597-459b-8e3c-e379a42f178e admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:59.381595 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ec75fc-9597-459b-8e3c-e379a42f178e admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:59.381874 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ec75fc-9597-459b-8e3c-e379a42f178e admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:59.382542 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ec75fc-9597-459b-8e3c-e379a42f178e admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:59.384296 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ec75fc-9597-459b-8e3c-e379a42f178e admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:59.397232 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: WARNING keystone.server.flask.application [None req-57ec75fc-9597-459b-8e3c-e379a42f178e admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jan 25 02:23:59.398826 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 484/954] 10.222.0.117 () {56 vars in 1140 bytes} [Tue Jan 25 02:23:59 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:23:59.405436 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b3576c-a99a-47ea-9323-90ed9ae134a9 None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:59.414555 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b3576c-a99a-47ea-9323-90ed9ae134a9 None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:59.420072 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc28052-a967-4475-8d41-62f6fddbbbfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:59.420735 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc28052-a967-4475-8d41-62f6fddbbbfc admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:59.421017 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc28052-a967-4475-8d41-62f6fddbbbfc admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:59.421293 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc28052-a967-4475-8d41-62f6fddbbbfc admin admin] PATH_INFO: `/v3/services` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:59.422071 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc28052-a967-4475-8d41-62f6fddbbbfc admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:59.422379 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc28052-a967-4475-8d41-62f6fddbbbfc admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:59.424026 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc28052-a967-4475-8d41-62f6fddbbbfc admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:59.429448 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 471/955] 10.222.0.117 () {56 vars in 1140 bytes} [Tue Jan 25 02:23:59 2022] GET /identity/v3/services?name=volumev3 => generated 126 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:59.435116 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ec75fc-9597-459b-8e3c-e379a42f178e admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:59.445335 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ec75fc-9597-459b-8e3c-e379a42f178e admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:59.450302 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e21716-aff8-462f-8d73-35662cf2e9bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:59.450964 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e21716-aff8-462f-8d73-35662cf2e9bc admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:59.451296 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e21716-aff8-462f-8d73-35662cf2e9bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:59.451576 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e21716-aff8-462f-8d73-35662cf2e9bc admin admin] PATH_INFO: `/v3/services` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:59.452340 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e21716-aff8-462f-8d73-35662cf2e9bc admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:23:59.452701 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e21716-aff8-462f-8d73-35662cf2e9bc admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:59.454372 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e21716-aff8-462f-8d73-35662cf2e9bc admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:59.459940 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 485/956] 10.222.0.117 () {56 vars in 1140 bytes} [Tue Jan 25 02:23:59 2022] GET /identity/v3/services?type=volumev3 => generated 364 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:23:59.466215 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc28052-a967-4475-8d41-62f6fddbbbfc admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:23:59.476538 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc28052-a967-4475-8d41-62f6fddbbbfc admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:23:59.482285 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c2a153-5694-445c-8e94-0a293b4458ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:23:59.482990 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c2a153-5694-445c-8e94-0a293b4458ee admin admin] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:23:59.483279 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c2a153-5694-445c-8e94-0a293b4458ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:23:59.483559 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c2a153-5694-445c-8e94-0a293b4458ee admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:23:59.484407 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c2a153-5694-445c-8e94-0a293b4458ee admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:23:59.486058 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c2a153-5694-445c-8e94-0a293b4458ee admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:23:59.508691 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 472/957] 10.222.0.117 () {60 vars in 1170 bytes} [Tue Jan 25 02:23:59 2022] POST /identity/v3/endpoints => generated 348 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 02:24:00.053742 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298d2743-b293-415b-b2d8-d2207c296953 None None] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:00.054452 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298d2743-b293-415b-b2d8-d2207c296953 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:00.054452 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298d2743-b293-415b-b2d8-d2207c296953 None None] PATH_INFO: `/` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:00.056282 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 486/958] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:24:00 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:24:00.062550 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f574eec3-e279-45e5-98fb-29962ac775a3 None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:00.062842 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f574eec3-e279-45e5-98fb-29962ac775a3 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:00.063113 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f574eec3-e279-45e5-98fb-29962ac775a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:00.081594 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-f574eec3-e279-45e5-98fb-29962ac775a3 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:24:00.082768 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-f574eec3-e279-45e5-98fb-29962ac775a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:24:00.099930 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 473/959] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:24:00 2022] POST /identity/v3/auth/tokens => generated 2143 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:24:00.124034 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298d2743-b293-415b-b2d8-d2207c296953 None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:24:00.137079 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298d2743-b293-415b-b2d8-d2207c296953 None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:24:00.141472 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d2084f-af5f-4c61-8d5f-8a8f727f4b80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:24:00.142242 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d2084f-af5f-4c61-8d5f-8a8f727f4b80 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:00.142520 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d2084f-af5f-4c61-8d5f-8a8f727f4b80 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:00.142789 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d2084f-af5f-4c61-8d5f-8a8f727f4b80 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:00.143447 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d2084f-af5f-4c61-8d5f-8a8f727f4b80 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:24:00.145078 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d2084f-af5f-4c61-8d5f-8a8f727f4b80 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:24:00.156219 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: WARNING keystone.server.flask.application [None req-26d2084f-af5f-4c61-8d5f-8a8f727f4b80 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jan 25 02:24:00.157666 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 487/960] 10.222.0.117 () {56 vars in 1137 bytes} [Tue Jan 25 02:24:00 2022] GET /identity/v3/services/compute => generated 88 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:24:00.163582 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f574eec3-e279-45e5-98fb-29962ac775a3 None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:24:00.173459 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f574eec3-e279-45e5-98fb-29962ac775a3 None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:24:00.178177 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87343d93-ebfd-4f26-a4a1-d509bd6b563f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:24:00.178860 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87343d93-ebfd-4f26-a4a1-d509bd6b563f admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:00.179136 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87343d93-ebfd-4f26-a4a1-d509bd6b563f admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:00.179408 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87343d93-ebfd-4f26-a4a1-d509bd6b563f admin admin] PATH_INFO: `/v3/services` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:00.180181 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87343d93-ebfd-4f26-a4a1-d509bd6b563f admin admin] RBAC: Adding query filter params (name=compute) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:24:00.180481 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87343d93-ebfd-4f26-a4a1-d509bd6b563f admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:24:00.182754 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87343d93-ebfd-4f26-a4a1-d509bd6b563f admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:24:00.188664 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 474/961] 10.222.0.117 () {56 vars in 1138 bytes} [Tue Jan 25 02:24:00 2022] GET /identity/v3/services?name=compute => generated 125 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:24:00.194228 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d2084f-af5f-4c61-8d5f-8a8f727f4b80 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:24:00.205542 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d2084f-af5f-4c61-8d5f-8a8f727f4b80 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:24:00.210140 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c261fe13-96ee-4c27-b94f-38ae672a1fe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:24:00.210777 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c261fe13-96ee-4c27-b94f-38ae672a1fe2 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:00.211101 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c261fe13-96ee-4c27-b94f-38ae672a1fe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:00.211371 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c261fe13-96ee-4c27-b94f-38ae672a1fe2 admin admin] PATH_INFO: `/v3/services` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:00.212158 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c261fe13-96ee-4c27-b94f-38ae672a1fe2 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:24:00.212456 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c261fe13-96ee-4c27-b94f-38ae672a1fe2 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:24:00.215187 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c261fe13-96ee-4c27-b94f-38ae672a1fe2 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:24:00.220685 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 488/962] 10.222.0.117 () {56 vars in 1138 bytes} [Tue Jan 25 02:24:00 2022] GET /identity/v3/services?type=compute => generated 125 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:24:01.294013 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c4ca0c-153d-43d2-babc-341f9156fd1e None None] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:01.294711 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c4ca0c-153d-43d2-babc-341f9156fd1e None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:01.294711 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c4ca0c-153d-43d2-babc-341f9156fd1e None None] PATH_INFO: `/` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:01.296642 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 475/963] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:24:01 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:24:01.302304 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06c273a-440c-4829-ba58-d40e76392153 None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:01.302832 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06c273a-440c-4829-ba58-d40e76392153 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:01.302832 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06c273a-440c-4829-ba58-d40e76392153 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:01.320670 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-b06c273a-440c-4829-ba58-d40e76392153 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:24:01.321862 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-b06c273a-440c-4829-ba58-d40e76392153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:24:01.335963 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 489/964] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:24:01 2022] POST /identity/v3/auth/tokens => generated 2143 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:24:01.355596 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c4ca0c-153d-43d2-babc-341f9156fd1e None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:24:01.368787 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c4ca0c-153d-43d2-babc-341f9156fd1e None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:24:01.373694 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c345200-8033-43a2-9d40-655847dbb523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:24:01.374528 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c345200-8033-43a2-9d40-655847dbb523 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:01.374808 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c345200-8033-43a2-9d40-655847dbb523 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:01.375078 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c345200-8033-43a2-9d40-655847dbb523 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:01.375777 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c345200-8033-43a2-9d40-655847dbb523 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:24:01.377383 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c345200-8033-43a2-9d40-655847dbb523 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:24:01.389693 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: WARNING keystone.server.flask.application [None req-5c345200-8033-43a2-9d40-655847dbb523 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jan 25 02:24:01.395809 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 476/965] 10.222.0.117 () {56 vars in 1152 bytes} [Tue Jan 25 02:24:01 2022] GET /identity/v3/services/object-store => generated 93 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:24:01.397244 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06c273a-440c-4829-ba58-d40e76392153 None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:24:01.407197 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06c273a-440c-4829-ba58-d40e76392153 None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:24:01.411883 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c08fd3-2103-4dd6-bdf9-3d55fb12f04e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:24:01.412542 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c08fd3-2103-4dd6-bdf9-3d55fb12f04e admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:01.412824 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c08fd3-2103-4dd6-bdf9-3d55fb12f04e admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:01.413101 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c08fd3-2103-4dd6-bdf9-3d55fb12f04e admin admin] PATH_INFO: `/v3/services` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:01.413820 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c08fd3-2103-4dd6-bdf9-3d55fb12f04e admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:24:01.414123 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c08fd3-2103-4dd6-bdf9-3d55fb12f04e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:24:01.415754 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c08fd3-2103-4dd6-bdf9-3d55fb12f04e admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:24:01.426521 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 490/966] 10.222.0.117 () {56 vars in 1148 bytes} [Tue Jan 25 02:24:01 2022] GET /identity/v3/services?name=object-store => generated 130 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:24:01.427852 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c345200-8033-43a2-9d40-655847dbb523 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:24:01.438115 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c345200-8033-43a2-9d40-655847dbb523 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:24:01.442686 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fec4d63-ebd5-415a-a6f3-c424193e616e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:24:01.443337 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fec4d63-ebd5-415a-a6f3-c424193e616e admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:01.443622 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fec4d63-ebd5-415a-a6f3-c424193e616e admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:01.443934 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fec4d63-ebd5-415a-a6f3-c424193e616e admin admin] PATH_INFO: `/v3/services` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:01.444654 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fec4d63-ebd5-415a-a6f3-c424193e616e admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:24:01.444955 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fec4d63-ebd5-415a-a6f3-c424193e616e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:24:01.446544 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fec4d63-ebd5-415a-a6f3-c424193e616e admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:24:01.455811 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 477/967] 10.222.0.117 () {56 vars in 1148 bytes} [Tue Jan 25 02:24:01 2022] GET /identity/v3/services?type=object-store => generated 358 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:24:01.457858 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c08fd3-2103-4dd6-bdf9-3d55fb12f04e admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:24:01.468714 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c08fd3-2103-4dd6-bdf9-3d55fb12f04e admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:24:01.473593 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5330f15d-fbb1-4510-9754-3628d13822a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:24:01.474236 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5330f15d-fbb1-4510-9754-3628d13822a7 admin admin] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:01.474518 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5330f15d-fbb1-4510-9754-3628d13822a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:01.474793 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5330f15d-fbb1-4510-9754-3628d13822a7 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:01.475563 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5330f15d-fbb1-4510-9754-3628d13822a7 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:24:01.477210 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5330f15d-fbb1-4510-9754-3628d13822a7 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:24:01.503901 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18282ac-fd0b-458c-bf0f-552fa46ac8d2 None None] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:01.503901 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18282ac-fd0b-458c-bf0f-552fa46ac8d2 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:01.503901 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18282ac-fd0b-458c-bf0f-552fa46ac8d2 None None] PATH_INFO: `/` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:01.503901 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 478/969] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:24:01 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:24:01.504640 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 491/969] 10.222.0.117 () {60 vars in 1170 bytes} [Tue Jan 25 02:24:01 2022] POST /identity/v3/endpoints => generated 351 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 02:24:01.511762 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33e4a7b-d5d5-42b2-8908-c16373a07fc1 None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:01.511762 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33e4a7b-d5d5-42b2-8908-c16373a07fc1 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:01.511762 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33e4a7b-d5d5-42b2-8908-c16373a07fc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:01.533441 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-a33e4a7b-d5d5-42b2-8908-c16373a07fc1 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:24:01.535044 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-a33e4a7b-d5d5-42b2-8908-c16373a07fc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:24:01.553985 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 479/970] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:24:01 2022] POST /identity/v3/auth/tokens => generated 2333 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 25 02:24:01.579021 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5330f15d-fbb1-4510-9754-3628d13822a7 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:24:01.590473 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5330f15d-fbb1-4510-9754-3628d13822a7 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:24:01.598061 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5470f9c-c29c-4ed1-8ced-1e4c0085c5a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:24:01.598884 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5470f9c-c29c-4ed1-8ced-1e4c0085c5a2 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:01.599168 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5470f9c-c29c-4ed1-8ced-1e4c0085c5a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:01.599442 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5470f9c-c29c-4ed1-8ced-1e4c0085c5a2 admin admin] PATH_INFO: `/v3/services/image` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:01.600172 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5470f9c-c29c-4ed1-8ced-1e4c0085c5a2 admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:24:01.601978 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5470f9c-c29c-4ed1-8ced-1e4c0085c5a2 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:24:01.613770 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: WARNING keystone.server.flask.application [None req-c5470f9c-c29c-4ed1-8ced-1e4c0085c5a2 admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jan 25 02:24:01.615400 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 492/971] 10.222.0.117 () {56 vars in 1131 bytes} [Tue Jan 25 02:24:01 2022] GET /identity/v3/services/image => generated 86 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:24:01.622884 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33e4a7b-d5d5-42b2-8908-c16373a07fc1 None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:24:01.632993 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33e4a7b-d5d5-42b2-8908-c16373a07fc1 None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:24:01.639101 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e505ddf-6479-4978-bee0-b35e4f048a5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:24:01.640231 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e505ddf-6479-4978-bee0-b35e4f048a5c admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:01.640836 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e505ddf-6479-4978-bee0-b35e4f048a5c admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:01.641360 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e505ddf-6479-4978-bee0-b35e4f048a5c admin admin] PATH_INFO: `/v3/services` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:01.642338 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e505ddf-6479-4978-bee0-b35e4f048a5c admin admin] RBAC: Adding query filter params (name=image) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:24:01.642865 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e505ddf-6479-4978-bee0-b35e4f048a5c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:24:01.644843 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e505ddf-6479-4978-bee0-b35e4f048a5c admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:24:01.651617 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 480/972] 10.222.0.117 () {56 vars in 1134 bytes} [Tue Jan 25 02:24:01 2022] GET /identity/v3/services?name=image => generated 123 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 02:24:01.657894 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5470f9c-c29c-4ed1-8ced-1e4c0085c5a2 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:24:01.669163 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5470f9c-c29c-4ed1-8ced-1e4c0085c5a2 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:24:01.680009 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea73e31-225a-4c91-a94b-ad1dedb353fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:24:01.680953 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea73e31-225a-4c91-a94b-ad1dedb353fd admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:01.681461 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea73e31-225a-4c91-a94b-ad1dedb353fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:01.681973 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea73e31-225a-4c91-a94b-ad1dedb353fd admin admin] PATH_INFO: `/v3/services` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:01.682989 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea73e31-225a-4c91-a94b-ad1dedb353fd admin admin] RBAC: Adding query filter params (type=image) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:24:01.683524 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea73e31-225a-4c91-a94b-ad1dedb353fd admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:24:01.685340 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea73e31-225a-4c91-a94b-ad1dedb353fd admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:24:01.690759 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 493/973] 10.222.0.117 () {56 vars in 1134 bytes} [Tue Jan 25 02:24:01 2022] GET /identity/v3/services?type=image => generated 123 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:24:01.890034 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198339b8-dae2-44ef-83e5-0d2fbdee080f None None] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:01.890686 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198339b8-dae2-44ef-83e5-0d2fbdee080f None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:01.891171 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198339b8-dae2-44ef-83e5-0d2fbdee080f None None] PATH_INFO: `/` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:01.893489 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 481/974] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:24:01 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:24:01.900160 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44407f61-6daf-4763-8345-ec1df579a34e None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:01.900602 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44407f61-6daf-4763-8345-ec1df579a34e None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:01.901550 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44407f61-6daf-4763-8345-ec1df579a34e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:01.924960 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-44407f61-6daf-4763-8345-ec1df579a34e None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:24:01.926331 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-44407f61-6daf-4763-8345-ec1df579a34e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:24:01.935104 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 494/975] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:24:01 2022] POST /identity/v3/auth/tokens => generated 2333 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:24:01.958582 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198339b8-dae2-44ef-83e5-0d2fbdee080f None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:24:01.971868 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198339b8-dae2-44ef-83e5-0d2fbdee080f None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:24:01.976563 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e2bcec-c0ef-4ad7-b920-b1d6b33faf3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:24:01.977482 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e2bcec-c0ef-4ad7-b920-b1d6b33faf3e admin admin] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:01.977981 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e2bcec-c0ef-4ad7-b920-b1d6b33faf3e admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:01.978447 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e2bcec-c0ef-4ad7-b920-b1d6b33faf3e admin admin] PATH_INFO: `/v3/projects` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:01.979995 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e2bcec-c0ef-4ad7-b920-b1d6b33faf3e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:24:01.982247 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e2bcec-c0ef-4ad7-b920-b1d6b33faf3e admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:24:01.983835 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: WARNING keystone.server.flask.common [None req-b0e2bcec-c0ef-4ad7-b920-b1d6b33faf3e admin admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jan 25 02:24:02.002755 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.sql.core [None req-b0e2bcec-c0ef-4ad7-b920-b1d6b33faf3e admin admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jan 25 02:24:02.002755 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jan 25 02:24:02.002755 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [parameters: {'id': '3ec4072a995448269436fcefbe904686', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jan 25 02:24:02.002755 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79120) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jan 25 02:24:02.019755 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: WARNING keystone.server.flask.application [None req-b0e2bcec-c0ef-4ad7-b920-b1d6b33faf3e admin admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 3ec4072a995448269436fcefbe904686.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 3ec4072a995448269436fcefbe904686. Jan 25 02:24:02.027455 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 482/976] 10.222.0.117 () {60 vars in 1166 bytes} [Tue Jan 25 02:24:01 2022] POST /identity/v3/projects => generated 262 bytes in 64 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:24:02.029109 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44407f61-6daf-4763-8345-ec1df579a34e None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:24:02.038796 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44407f61-6daf-4763-8345-ec1df579a34e None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:24:02.044500 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11416e95-27a7-4541-9220-f0fe5900bc23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:24:02.045524 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11416e95-27a7-4541-9220-f0fe5900bc23 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:02.046026 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11416e95-27a7-4541-9220-f0fe5900bc23 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:02.046498 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11416e95-27a7-4541-9220-f0fe5900bc23 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:02.054147 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11416e95-27a7-4541-9220-f0fe5900bc23 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:24:02.056449 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11416e95-27a7-4541-9220-f0fe5900bc23 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:24:02.070796 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: WARNING keystone.server.flask.application [None req-11416e95-27a7-4541-9220-f0fe5900bc23 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 25 02:24:02.077156 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 495/977] 10.222.0.117 () {56 vars in 1137 bytes} [Tue Jan 25 02:24:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:24:02.079804 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e2bcec-c0ef-4ad7-b920-b1d6b33faf3e admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:24:02.092605 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e2bcec-c0ef-4ad7-b920-b1d6b33faf3e admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:24:02.097885 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1b8330-bcc9-4eca-96eb-fb08b7e6767e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:24:02.098790 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1b8330-bcc9-4eca-96eb-fb08b7e6767e admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:02.099316 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1b8330-bcc9-4eca-96eb-fb08b7e6767e admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:02.099820 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1b8330-bcc9-4eca-96eb-fb08b7e6767e admin admin] PATH_INFO: `/v3/projects` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:02.100879 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1b8330-bcc9-4eca-96eb-fb08b7e6767e admin admin] RBAC: Adding query filter params (name=service) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:24:02.101460 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1b8330-bcc9-4eca-96eb-fb08b7e6767e admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:24:02.104167 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1b8330-bcc9-4eca-96eb-fb08b7e6767e admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:24:02.131851 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 483/978] 10.222.0.117 () {56 vars in 1138 bytes} [Tue Jan 25 02:24:02 2022] GET /identity/v3/projects?name=service => generated 413 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:24:02.524689 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa6fc01-205d-4d46-b999-b4a4b31731ad None None] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:02.525208 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa6fc01-205d-4d46-b999-b4a4b31731ad None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:02.525285 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa6fc01-205d-4d46-b999-b4a4b31731ad None None] PATH_INFO: `/` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:02.528147 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 496/979] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:24:02 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:24:02.534694 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c3feb6-8f90-4641-bfc8-34eb115814aa None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:02.535174 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c3feb6-8f90-4641-bfc8-34eb115814aa None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:02.535387 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c3feb6-8f90-4641-bfc8-34eb115814aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:02.554591 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-88c3feb6-8f90-4641-bfc8-34eb115814aa None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:24:02.556475 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-88c3feb6-8f90-4641-bfc8-34eb115814aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:24:02.565163 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 484/980] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:24:02 2022] POST /identity/v3/auth/tokens => generated 2333 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:24:02.587600 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa6fc01-205d-4d46-b999-b4a4b31731ad None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:24:02.601431 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa6fc01-205d-4d46-b999-b4a4b31731ad None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:24:02.606705 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac45359-64e4-46f1-99fc-5e2319b5fee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:24:02.607411 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac45359-64e4-46f1-99fc-5e2319b5fee9 admin admin] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:02.607721 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac45359-64e4-46f1-99fc-5e2319b5fee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:02.608011 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac45359-64e4-46f1-99fc-5e2319b5fee9 admin admin] PATH_INFO: `/v3/services` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:02.608818 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac45359-64e4-46f1-99fc-5e2319b5fee9 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:24:02.610422 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac45359-64e4-46f1-99fc-5e2319b5fee9 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:24:02.626366 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 497/981] 10.222.0.117 () {60 vars in 1167 bytes} [Tue Jan 25 02:24:02 2022] POST /identity/v3/services => generated 243 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 02:24:03.839663 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2978e9-238e-4eb6-9dad-25521a5f67ac None None] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:03.840714 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2978e9-238e-4eb6-9dad-25521a5f67ac None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:03.841201 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2978e9-238e-4eb6-9dad-25521a5f67ac None None] PATH_INFO: `/` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:03.843449 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 485/982] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:24:03 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:24:03.849500 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798947b2-e31f-4058-aab4-1a42f00bd846 None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:03.850312 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798947b2-e31f-4058-aab4-1a42f00bd846 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:03.850787 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798947b2-e31f-4058-aab4-1a42f00bd846 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:03.868772 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-798947b2-e31f-4058-aab4-1a42f00bd846 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:24:03.871105 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-798947b2-e31f-4058-aab4-1a42f00bd846 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:24:03.898410 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 498/983] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:24:03 2022] POST /identity/v3/auth/tokens => generated 2429 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:24:03.921064 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2978e9-238e-4eb6-9dad-25521a5f67ac None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:24:03.935965 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2978e9-238e-4eb6-9dad-25521a5f67ac None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:24:03.941510 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a110a44e-c936-45e4-be1e-a98a54ccfe70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:24:03.942576 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a110a44e-c936-45e4-be1e-a98a54ccfe70 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:03.943158 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a110a44e-c936-45e4-be1e-a98a54ccfe70 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:03.943631 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a110a44e-c936-45e4-be1e-a98a54ccfe70 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:03.944531 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a110a44e-c936-45e4-be1e-a98a54ccfe70 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:24:03.946324 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a110a44e-c936-45e4-be1e-a98a54ccfe70 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:24:03.959063 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: WARNING keystone.server.flask.application [None req-a110a44e-c936-45e4-be1e-a98a54ccfe70 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jan 25 02:24:03.965654 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 486/984] 10.222.0.117 () {56 vars in 1152 bytes} [Tue Jan 25 02:24:03 2022] GET /identity/v3/services/object-store => generated 93 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:24:03.967219 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798947b2-e31f-4058-aab4-1a42f00bd846 None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:24:03.976779 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798947b2-e31f-4058-aab4-1a42f00bd846 None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:24:03.981880 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc28ca51-5d24-45fa-91dd-8e698386f217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:24:03.982775 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc28ca51-5d24-45fa-91dd-8e698386f217 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:03.983285 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc28ca51-5d24-45fa-91dd-8e698386f217 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:03.983838 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc28ca51-5d24-45fa-91dd-8e698386f217 admin admin] PATH_INFO: `/v3/services` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:03.984757 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc28ca51-5d24-45fa-91dd-8e698386f217 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:24:03.985277 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc28ca51-5d24-45fa-91dd-8e698386f217 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:24:03.987087 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc28ca51-5d24-45fa-91dd-8e698386f217 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:24:03.997823 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 499/985] 10.222.0.117 () {56 vars in 1148 bytes} [Tue Jan 25 02:24:03 2022] GET /identity/v3/services?name=object-store => generated 130 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:24:03.999393 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a110a44e-c936-45e4-be1e-a98a54ccfe70 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:24:04.009458 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a110a44e-c936-45e4-be1e-a98a54ccfe70 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:24:04.014184 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b438a1f-5f5c-44c3-b28b-6f588741ba38 None None] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:04.014722 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b438a1f-5f5c-44c3-b28b-6f588741ba38 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:04.015224 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b438a1f-5f5c-44c3-b28b-6f588741ba38 None None] PATH_INFO: `/` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:04.015328 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3cae1a-cba9-4427-aee0-ce7f31bc8095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:24:04.015947 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3cae1a-cba9-4427-aee0-ce7f31bc8095 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:04.016232 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3cae1a-cba9-4427-aee0-ce7f31bc8095 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:04.016510 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3cae1a-cba9-4427-aee0-ce7f31bc8095 admin admin] PATH_INFO: `/v3/services` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:04.017233 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3cae1a-cba9-4427-aee0-ce7f31bc8095 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:24:04.017537 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3cae1a-cba9-4427-aee0-ce7f31bc8095 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:24:04.018839 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 500/986] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:24:04 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jan 25 02:24:04.019735 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3cae1a-cba9-4427-aee0-ce7f31bc8095 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:24:04.024140 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbea591-6ec6-43cf-92fc-04d241e6d81b None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:04.024661 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbea591-6ec6-43cf-92fc-04d241e6d81b None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:04.025135 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbea591-6ec6-43cf-92fc-04d241e6d81b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:04.027028 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 487/987] 10.222.0.117 () {56 vars in 1148 bytes} [Tue Jan 25 02:24:03 2022] GET /identity/v3/services?type=object-store => generated 358 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:24:04.030837 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3cae1a-cba9-4427-aee0-ce7f31bc8095 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:24:04.042930 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3cae1a-cba9-4427-aee0-ce7f31bc8095 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:24:04.047772 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d107cf8-04b8-4f53-975a-ae5b80a1aeed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:24:04.048574 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d107cf8-04b8-4f53-975a-ae5b80a1aeed admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:04.049002 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d107cf8-04b8-4f53-975a-ae5b80a1aeed admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:04.049424 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d107cf8-04b8-4f53-975a-ae5b80a1aeed admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:04.050359 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d107cf8-04b8-4f53-975a-ae5b80a1aeed admin admin] RBAC: Adding query filter params (interface=admin, service_id=82bbe8b8a7e14a6d97f926197028e573, region_id=RegionOne) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:24:04.050906 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d107cf8-04b8-4f53-975a-ae5b80a1aeed admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:24:04.051104 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-1dbea591-6ec6-43cf-92fc-04d241e6d81b None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:24:04.052477 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-1dbea591-6ec6-43cf-92fc-04d241e6d81b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:24:04.053007 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d107cf8-04b8-4f53-975a-ae5b80a1aeed admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:24:04.059455 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 488/988] 10.222.0.117 () {56 vars in 1275 bytes} [Tue Jan 25 02:24:04 2022] GET /identity/v3/endpoints?service_id=82bbe8b8a7e14a6d97f926197028e573&interface=admin®ion_id=RegionOne => generated 194 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:24:04.064941 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d107cf8-04b8-4f53-975a-ae5b80a1aeed admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:24:04.068117 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 501/989] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:24:04 2022] POST /identity/v3/auth/tokens => generated 2429 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:24:04.077966 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d107cf8-04b8-4f53-975a-ae5b80a1aeed admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:24:04.082941 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04d173b-3014-4ba1-9bd2-9e564caedea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:24:04.083870 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04d173b-3014-4ba1-9bd2-9e564caedea4 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:04.084377 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04d173b-3014-4ba1-9bd2-9e564caedea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:04.084860 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04d173b-3014-4ba1-9bd2-9e564caedea4 admin admin] PATH_INFO: `/v3/services` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:04.085808 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04d173b-3014-4ba1-9bd2-9e564caedea4 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:24:04.087681 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04d173b-3014-4ba1-9bd2-9e564caedea4 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:24:04.091857 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbea591-6ec6-43cf-92fc-04d241e6d81b None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:24:04.099842 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 489/990] 10.222.0.117 () {56 vars in 1113 bytes} [Tue Jan 25 02:24:04 2022] GET /identity/v3/services => generated 1735 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 02:24:04.101358 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbea591-6ec6-43cf-92fc-04d241e6d81b None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:24:04.106894 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c596cfdb-ed9f-4fdc-be42-54abd51ab302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:24:04.107576 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c596cfdb-ed9f-4fdc-be42-54abd51ab302 admin admin] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:04.107910 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c596cfdb-ed9f-4fdc-be42-54abd51ab302 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:04.108185 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c596cfdb-ed9f-4fdc-be42-54abd51ab302 admin admin] PATH_INFO: `/v3/services` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:04.108941 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c596cfdb-ed9f-4fdc-be42-54abd51ab302 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:24:04.110579 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c596cfdb-ed9f-4fdc-be42-54abd51ab302 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:24:04.127987 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 502/991] 10.222.0.117 () {60 vars in 1167 bytes} [Tue Jan 25 02:24:04 2022] POST /identity/v3/services => generated 243 bytes in 36 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 25 02:24:04.501318 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f40190-4312-4137-80b7-1c49c3f6f769 None None] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:04.501724 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f40190-4312-4137-80b7-1c49c3f6f769 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:04.501905 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f40190-4312-4137-80b7-1c49c3f6f769 None None] PATH_INFO: `/` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:04.503947 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 490/992] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:24:04 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:24:04.509320 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba6ef2a-e8ae-462a-a6a7-bc9e85d19190 None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:04.509604 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba6ef2a-e8ae-462a-a6a7-bc9e85d19190 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:04.509937 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba6ef2a-e8ae-462a-a6a7-bc9e85d19190 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:04.529794 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-0ba6ef2a-e8ae-462a-a6a7-bc9e85d19190 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:24:04.530977 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-0ba6ef2a-e8ae-462a-a6a7-bc9e85d19190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:24:04.549283 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 503/993] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:24:04 2022] POST /identity/v3/auth/tokens => generated 2525 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 25 02:24:04.575140 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f40190-4312-4137-80b7-1c49c3f6f769 None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:24:04.587459 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f40190-4312-4137-80b7-1c49c3f6f769 None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:24:04.594165 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ea20ca-ab7f-4c0b-a325-843d18c8c3ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:24:04.595094 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ea20ca-ab7f-4c0b-a325-843d18c8c3ec admin admin] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:04.595372 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ea20ca-ab7f-4c0b-a325-843d18c8c3ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:04.595642 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ea20ca-ab7f-4c0b-a325-843d18c8c3ec admin admin] PATH_INFO: `/v3/users` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:04.596442 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ea20ca-ab7f-4c0b-a325-843d18c8c3ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:24:04.598277 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ea20ca-ab7f-4c0b-a325-843d18c8c3ec admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:24:04.613285 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.sql.core [None req-49ea20ca-ab7f-4c0b-a325-843d18c8c3ec admin admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jan 25 02:24:04.613285 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jan 25 02:24:04.613285 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [parameters: {'user_id': 'f0cc7df2c94a4ef2a5b322b765096929', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jan 25 02:24:04.613285 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79120) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jan 25 02:24:04.619903 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: WARNING keystone.server.flask.application [None req-49ea20ca-ab7f-4c0b-a325-843d18c8c3ec admin admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jan 25 02:24:04.621450 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 491/994] 10.222.0.117 () {60 vars in 1157 bytes} [Tue Jan 25 02:24:04 2022] POST /identity/v3/users => generated 160 bytes in 47 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:24:04.627290 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba6ef2a-e8ae-462a-a6a7-bc9e85d19190 None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:24:04.637243 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba6ef2a-e8ae-462a-a6a7-bc9e85d19190 None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:24:04.641854 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63a1404-05c7-48f9-82e2-cb3f2612e466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:24:04.642682 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63a1404-05c7-48f9-82e2-cb3f2612e466 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:04.642962 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63a1404-05c7-48f9-82e2-cb3f2612e466 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:04.643229 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63a1404-05c7-48f9-82e2-cb3f2612e466 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:04.651749 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63a1404-05c7-48f9-82e2-cb3f2612e466 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:24:04.653835 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63a1404-05c7-48f9-82e2-cb3f2612e466 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:24:04.668639 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: WARNING keystone.server.flask.application [None req-d63a1404-05c7-48f9-82e2-cb3f2612e466 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jan 25 02:24:04.670110 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 504/995] 10.222.0.117 () {56 vars in 1125 bytes} [Tue Jan 25 02:24:04 2022] GET /identity/v3/users/cinder => generated 84 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:24:04.676575 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ea20ca-ab7f-4c0b-a325-843d18c8c3ec admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:24:04.688743 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ea20ca-ab7f-4c0b-a325-843d18c8c3ec admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:24:04.693665 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2622e64-be17-4941-9bdb-436c31c1cf88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:24:04.694356 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2622e64-be17-4941-9bdb-436c31c1cf88 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:04.694690 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2622e64-be17-4941-9bdb-436c31c1cf88 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:04.694961 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2622e64-be17-4941-9bdb-436c31c1cf88 admin admin] PATH_INFO: `/v3/users` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:04.695889 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2622e64-be17-4941-9bdb-436c31c1cf88 admin admin] RBAC: Adding query filter params (name=cinder) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:24:04.696246 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2622e64-be17-4941-9bdb-436c31c1cf88 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:24:04.699936 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2622e64-be17-4941-9bdb-436c31c1cf88 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:24:04.745233 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 492/996] 10.222.0.117 () {56 vars in 1127 bytes} [Tue Jan 25 02:24:04 2022] GET /identity/v3/users?name=cinder => generated 356 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:24:04.950091 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8052a2a8-247a-4106-a0a5-496ee878a8af None None] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:04.950698 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8052a2a8-247a-4106-a0a5-496ee878a8af None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:04.950698 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8052a2a8-247a-4106-a0a5-496ee878a8af None None] PATH_INFO: `/` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:04.952848 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 505/997] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:24:04 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:24:04.958211 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f6ebc9-c3a9-4038-9887-7b0c4df46a62 None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:04.958736 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f6ebc9-c3a9-4038-9887-7b0c4df46a62 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:04.958736 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f6ebc9-c3a9-4038-9887-7b0c4df46a62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:04.980434 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-91f6ebc9-c3a9-4038-9887-7b0c4df46a62 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:24:04.981972 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-91f6ebc9-c3a9-4038-9887-7b0c4df46a62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:24:04.992247 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 493/998] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:24:04 2022] POST /identity/v3/auth/tokens => generated 2525 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:24:05.017375 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8052a2a8-247a-4106-a0a5-496ee878a8af None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:24:05.030843 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8052a2a8-247a-4106-a0a5-496ee878a8af None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:24:05.035187 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfd1a3c-11a7-41d4-a69b-02283620fb6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:24:05.036002 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfd1a3c-11a7-41d4-a69b-02283620fb6f admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:05.036287 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfd1a3c-11a7-41d4-a69b-02283620fb6f admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:05.036563 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfd1a3c-11a7-41d4-a69b-02283620fb6f admin admin] PATH_INFO: `/v3/services/compute` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:05.037234 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfd1a3c-11a7-41d4-a69b-02283620fb6f admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:24:05.038854 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfd1a3c-11a7-41d4-a69b-02283620fb6f admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:24:05.050772 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: WARNING keystone.server.flask.application [None req-5bfd1a3c-11a7-41d4-a69b-02283620fb6f admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jan 25 02:24:05.052174 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 506/999] 10.222.0.117 () {56 vars in 1137 bytes} [Tue Jan 25 02:24:05 2022] GET /identity/v3/services/compute => generated 88 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:24:05.058729 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f6ebc9-c3a9-4038-9887-7b0c4df46a62 None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:24:05.067667 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f6ebc9-c3a9-4038-9887-7b0c4df46a62 None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:24:05.072151 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe5b014-08b1-4391-830f-5af52156e02e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:24:05.073026 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe5b014-08b1-4391-830f-5af52156e02e admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:05.073318 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe5b014-08b1-4391-830f-5af52156e02e admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:05.073594 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe5b014-08b1-4391-830f-5af52156e02e admin admin] PATH_INFO: `/v3/services` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:05.074316 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe5b014-08b1-4391-830f-5af52156e02e admin admin] RBAC: Adding query filter params (name=compute) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:24:05.074620 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe5b014-08b1-4391-830f-5af52156e02e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:24:05.076255 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe5b014-08b1-4391-830f-5af52156e02e admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:24:05.081458 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 494/1000] 10.222.0.117 () {56 vars in 1138 bytes} [Tue Jan 25 02:24:05 2022] GET /identity/v3/services?name=compute => generated 125 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 02:24:05.086802 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfd1a3c-11a7-41d4-a69b-02283620fb6f admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:24:05.096694 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfd1a3c-11a7-41d4-a69b-02283620fb6f admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:24:05.101126 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab861d9-7371-42dc-a6f7-ea3aa7efc323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:24:05.101778 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab861d9-7371-42dc-a6f7-ea3aa7efc323 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:05.102064 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab861d9-7371-42dc-a6f7-ea3aa7efc323 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:05.102339 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab861d9-7371-42dc-a6f7-ea3aa7efc323 admin admin] PATH_INFO: `/v3/services` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:05.103063 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab861d9-7371-42dc-a6f7-ea3aa7efc323 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:24:05.103368 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab861d9-7371-42dc-a6f7-ea3aa7efc323 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:24:05.105680 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab861d9-7371-42dc-a6f7-ea3aa7efc323 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:24:05.110630 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 507/1001] 10.222.0.117 () {56 vars in 1138 bytes} [Tue Jan 25 02:24:05 2022] GET /identity/v3/services?type=compute => generated 354 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:24:05.116136 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe5b014-08b1-4391-830f-5af52156e02e admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:24:05.126403 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe5b014-08b1-4391-830f-5af52156e02e admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:24:05.130812 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f01905-0587-4192-96bd-e67a35fb0785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:24:05.131454 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f01905-0587-4192-96bd-e67a35fb0785 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:05.131767 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f01905-0587-4192-96bd-e67a35fb0785 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:05.132066 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f01905-0587-4192-96bd-e67a35fb0785 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:05.132869 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f01905-0587-4192-96bd-e67a35fb0785 admin admin] RBAC: Adding query filter params (interface=public, service_id=1e09e048981e4df9850b33196d856657, region_id=RegionOne) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:24:05.133180 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f01905-0587-4192-96bd-e67a35fb0785 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:24:05.135294 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f01905-0587-4192-96bd-e67a35fb0785 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:24:05.140474 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 495/1002] 10.222.0.117 () {56 vars in 1277 bytes} [Tue Jan 25 02:24:05 2022] GET /identity/v3/endpoints?service_id=1e09e048981e4df9850b33196d856657&interface=public®ion_id=RegionOne => generated 195 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:24:05.145567 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab861d9-7371-42dc-a6f7-ea3aa7efc323 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:24:05.156978 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab861d9-7371-42dc-a6f7-ea3aa7efc323 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:24:05.161463 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1eccb49-914c-4f57-8899-028ab4f6bb93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:24:05.162113 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eccb49-914c-4f57-8899-028ab4f6bb93 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:05.162399 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eccb49-914c-4f57-8899-028ab4f6bb93 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:05.162675 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eccb49-914c-4f57-8899-028ab4f6bb93 admin admin] PATH_INFO: `/v3/services` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:05.163367 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1eccb49-914c-4f57-8899-028ab4f6bb93 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:24:05.165014 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1eccb49-914c-4f57-8899-028ab4f6bb93 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:24:05.172388 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 508/1003] 10.222.0.117 () {56 vars in 1113 bytes} [Tue Jan 25 02:24:05 2022] GET /identity/v3/services => generated 1966 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 02:24:06.428648 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053c2792-21b7-46c3-bdae-b8b8b36e1f4a None None] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:06.429214 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053c2792-21b7-46c3-bdae-b8b8b36e1f4a None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:06.429214 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053c2792-21b7-46c3-bdae-b8b8b36e1f4a None None] PATH_INFO: `/` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:06.431120 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 496/1004] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:24:06 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:24:06.436544 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b0664a-0e33-4c32-9217-0a2c1d32e20e None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:06.436944 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b0664a-0e33-4c32-9217-0a2c1d32e20e None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:06.437123 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b0664a-0e33-4c32-9217-0a2c1d32e20e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:06.456646 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-72b0664a-0e33-4c32-9217-0a2c1d32e20e None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:24:06.457919 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-72b0664a-0e33-4c32-9217-0a2c1d32e20e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:24:06.459295 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94325be-781a-4657-937d-b1e95a5e3090 None None] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:06.459573 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94325be-781a-4657-937d-b1e95a5e3090 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:06.459881 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94325be-781a-4657-937d-b1e95a5e3090 None None] PATH_INFO: `/` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:06.461749 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 497/1005] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:24:06 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jan 25 02:24:06.467038 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0c84ef-cf13-48e8-807d-d62d55628b3f None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:06.467329 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0c84ef-cf13-48e8-807d-d62d55628b3f None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:06.467560 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 509/1006] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:24:06 2022] POST /identity/v3/auth/tokens => generated 2525 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:24:06.467662 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0c84ef-cf13-48e8-807d-d62d55628b3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:06.485190 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-6f0c84ef-cf13-48e8-807d-d62d55628b3f None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:24:06.486359 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-6f0c84ef-cf13-48e8-807d-d62d55628b3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:24:06.489762 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b0664a-0e33-4c32-9217-0a2c1d32e20e None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:24:06.496780 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 498/1007] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:24:06 2022] POST /identity/v3/auth/tokens => generated 2525 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 25 02:24:06.498992 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b0664a-0e33-4c32-9217-0a2c1d32e20e None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:24:06.503364 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad822766-a911-4d83-961f-3832ccd9d7e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:24:06.504176 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad822766-a911-4d83-961f-3832ccd9d7e1 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:06.504460 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad822766-a911-4d83-961f-3832ccd9d7e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:06.504729 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad822766-a911-4d83-961f-3832ccd9d7e1 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:06.505385 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad822766-a911-4d83-961f-3832ccd9d7e1 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:24:06.506977 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad822766-a911-4d83-961f-3832ccd9d7e1 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:24:06.517538 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0c84ef-cf13-48e8-807d-d62d55628b3f None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:24:06.518723 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: WARNING keystone.server.flask.application [None req-ad822766-a911-4d83-961f-3832ccd9d7e1 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jan 25 02:24:06.520020 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 510/1008] 10.222.0.117 () {56 vars in 1152 bytes} [Tue Jan 25 02:24:06 2022] GET /identity/v3/services/object-store => generated 93 bytes in 31 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 25 02:24:06.526317 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad822766-a911-4d83-961f-3832ccd9d7e1 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:24:06.531109 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0c84ef-cf13-48e8-807d-d62d55628b3f None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:24:06.535487 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad822766-a911-4d83-961f-3832ccd9d7e1 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:24:06.535616 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64073b24-f36d-4589-8745-639509a451da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:24:06.536350 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64073b24-f36d-4589-8745-639509a451da admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:06.536632 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64073b24-f36d-4589-8745-639509a451da admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:06.536905 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64073b24-f36d-4589-8745-639509a451da admin admin] PATH_INFO: `/v3/services/image` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:06.537562 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64073b24-f36d-4589-8745-639509a451da admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:24:06.539144 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64073b24-f36d-4589-8745-639509a451da admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:24:06.540207 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fca8440-3561-43e3-a60a-6076e775be68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:24:06.540841 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fca8440-3561-43e3-a60a-6076e775be68 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:06.541225 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fca8440-3561-43e3-a60a-6076e775be68 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:06.541503 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fca8440-3561-43e3-a60a-6076e775be68 admin admin] PATH_INFO: `/v3/services` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:06.542216 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fca8440-3561-43e3-a60a-6076e775be68 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:24:06.542520 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fca8440-3561-43e3-a60a-6076e775be68 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:24:06.544124 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fca8440-3561-43e3-a60a-6076e775be68 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:24:06.551495 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 511/1009] 10.222.0.117 () {56 vars in 1148 bytes} [Tue Jan 25 02:24:06 2022] GET /identity/v3/services?name=object-store => generated 130 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 02:24:06.551619 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: WARNING keystone.server.flask.application [None req-64073b24-f36d-4589-8745-639509a451da admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jan 25 02:24:06.551619 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 499/1010] 10.222.0.117 () {56 vars in 1131 bytes} [Tue Jan 25 02:24:06 2022] GET /identity/v3/services/image => generated 86 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 25 02:24:06.556889 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fca8440-3561-43e3-a60a-6076e775be68 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:24:06.557086 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64073b24-f36d-4589-8745-639509a451da admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:24:06.566292 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64073b24-f36d-4589-8745-639509a451da admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:24:06.566498 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fca8440-3561-43e3-a60a-6076e775be68 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:24:06.570772 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eb07ec-8c17-4363-85fe-db108f974c2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:24:06.570892 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb8429c-4801-4867-9cbb-270ad00452cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:24:06.571404 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eb07ec-8c17-4363-85fe-db108f974c2b admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:06.571505 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb8429c-4801-4867-9cbb-270ad00452cd admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:06.571684 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eb07ec-8c17-4363-85fe-db108f974c2b admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:06.571807 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb8429c-4801-4867-9cbb-270ad00452cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:06.571978 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eb07ec-8c17-4363-85fe-db108f974c2b admin admin] PATH_INFO: `/v3/services` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:06.572086 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb8429c-4801-4867-9cbb-270ad00452cd admin admin] PATH_INFO: `/v3/services` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:06.573242 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73eb07ec-8c17-4363-85fe-db108f974c2b admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:24:06.573343 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb8429c-4801-4867-9cbb-270ad00452cd admin admin] RBAC: Adding query filter params (name=image) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:24:06.573539 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73eb07ec-8c17-4363-85fe-db108f974c2b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:24:06.573633 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb8429c-4801-4867-9cbb-270ad00452cd admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:24:06.575101 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73eb07ec-8c17-4363-85fe-db108f974c2b admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:24:06.575204 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb8429c-4801-4867-9cbb-270ad00452cd admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:24:06.580040 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 500/1011] 10.222.0.117 () {56 vars in 1134 bytes} [Tue Jan 25 02:24:06 2022] GET /identity/v3/services?name=image => generated 123 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:24:06.583842 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 512/1012] 10.222.0.117 () {56 vars in 1148 bytes} [Tue Jan 25 02:24:06 2022] GET /identity/v3/services?type=object-store => generated 358 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:24:06.585541 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb8429c-4801-4867-9cbb-270ad00452cd admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:24:06.585987 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eb07ec-8c17-4363-85fe-db108f974c2b admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:24:06.596911 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb8429c-4801-4867-9cbb-270ad00452cd admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:24:06.597200 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eb07ec-8c17-4363-85fe-db108f974c2b admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:24:06.601712 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b12abc-89eb-4f76-8b41-bf42c890a9cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:24:06.602115 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5954e59-a35d-4367-9e85-de2eba78555d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:24:06.602351 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b12abc-89eb-4f76-8b41-bf42c890a9cd admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:06.602630 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b12abc-89eb-4f76-8b41-bf42c890a9cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:06.602790 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5954e59-a35d-4367-9e85-de2eba78555d admin admin] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:06.602938 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b12abc-89eb-4f76-8b41-bf42c890a9cd admin admin] PATH_INFO: `/v3/services` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:06.603028 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5954e59-a35d-4367-9e85-de2eba78555d admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:06.603297 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5954e59-a35d-4367-9e85-de2eba78555d admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:06.603721 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b12abc-89eb-4f76-8b41-bf42c890a9cd admin admin] RBAC: Adding query filter params (type=image) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:24:06.604229 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b12abc-89eb-4f76-8b41-bf42c890a9cd admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:24:06.604384 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5954e59-a35d-4367-9e85-de2eba78555d admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:24:06.605796 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b12abc-89eb-4f76-8b41-bf42c890a9cd admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:24:06.605965 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5954e59-a35d-4367-9e85-de2eba78555d admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:24:06.610926 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 501/1013] 10.222.0.117 () {56 vars in 1134 bytes} [Tue Jan 25 02:24:06 2022] GET /identity/v3/services?type=image => generated 352 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:24:06.616678 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b12abc-89eb-4f76-8b41-bf42c890a9cd admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:24:06.632124 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 513/1014] 10.222.0.117 () {60 vars in 1170 bytes} [Tue Jan 25 02:24:06 2022] POST /identity/v3/endpoints => generated 327 bytes in 36 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 25 02:24:06.632331 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b12abc-89eb-4f76-8b41-bf42c890a9cd admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:24:06.648036 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e15f436-bcb6-4286-b36f-0f56b0750112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:24:06.648691 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e15f436-bcb6-4286-b36f-0f56b0750112 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:06.648972 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e15f436-bcb6-4286-b36f-0f56b0750112 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:06.649246 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e15f436-bcb6-4286-b36f-0f56b0750112 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:06.650055 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e15f436-bcb6-4286-b36f-0f56b0750112 admin admin] RBAC: Adding query filter params (interface=public, service_id=c61255712c1f454487c5f46a4fe8efe4, region_id=RegionOne) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:24:06.650426 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e15f436-bcb6-4286-b36f-0f56b0750112 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:24:06.652776 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e15f436-bcb6-4286-b36f-0f56b0750112 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:24:06.658514 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 502/1015] 10.222.0.117 () {56 vars in 1277 bytes} [Tue Jan 25 02:24:06 2022] GET /identity/v3/endpoints?service_id=c61255712c1f454487c5f46a4fe8efe4&interface=public®ion_id=RegionOne => generated 195 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:24:06.664206 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5954e59-a35d-4367-9e85-de2eba78555d admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:24:06.675741 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5954e59-a35d-4367-9e85-de2eba78555d admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:24:06.682716 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6841c2e7-d729-4421-acbf-0b593d013979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:24:06.683506 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6841c2e7-d729-4421-acbf-0b593d013979 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:06.683828 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6841c2e7-d729-4421-acbf-0b593d013979 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:06.684107 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6841c2e7-d729-4421-acbf-0b593d013979 admin admin] PATH_INFO: `/v3/services` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:06.684824 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6841c2e7-d729-4421-acbf-0b593d013979 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:24:06.686491 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6841c2e7-d729-4421-acbf-0b593d013979 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:24:06.700023 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 514/1016] 10.222.0.117 () {56 vars in 1113 bytes} [Tue Jan 25 02:24:06 2022] GET /identity/v3/services => generated 1966 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 25 02:24:07.471141 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5d460a-d7e9-4859-ab0a-67b258aaa83f None None] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:07.471684 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5d460a-d7e9-4859-ab0a-67b258aaa83f None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:07.471684 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5d460a-d7e9-4859-ab0a-67b258aaa83f None None] PATH_INFO: `/` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:07.473521 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 503/1017] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:24:07 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:24:07.478793 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52f01c9-a1db-442b-ac05-d57814e8e268 None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:07.479187 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52f01c9-a1db-442b-ac05-d57814e8e268 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:07.479347 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52f01c9-a1db-442b-ac05-d57814e8e268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:07.497280 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-e52f01c9-a1db-442b-ac05-d57814e8e268 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:24:07.498464 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-e52f01c9-a1db-442b-ac05-d57814e8e268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:24:07.506005 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 515/1018] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:24:07 2022] POST /identity/v3/auth/tokens => generated 2675 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:24:07.530714 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5d460a-d7e9-4859-ab0a-67b258aaa83f None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:24:07.543931 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5d460a-d7e9-4859-ab0a-67b258aaa83f None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:24:07.548281 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bdf2a9-cf90-4d52-8a0b-e7a0980b210d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:24:07.549080 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bdf2a9-cf90-4d52-8a0b-e7a0980b210d admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:07.549360 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bdf2a9-cf90-4d52-8a0b-e7a0980b210d admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:07.549627 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bdf2a9-cf90-4d52-8a0b-e7a0980b210d admin admin] PATH_INFO: `/v3/services/compute` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:07.550295 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bdf2a9-cf90-4d52-8a0b-e7a0980b210d admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:24:07.551903 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bdf2a9-cf90-4d52-8a0b-e7a0980b210d admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:24:07.563199 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: WARNING keystone.server.flask.application [None req-b3bdf2a9-cf90-4d52-8a0b-e7a0980b210d admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jan 25 02:24:07.569299 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 504/1019] 10.222.0.117 () {56 vars in 1137 bytes} [Tue Jan 25 02:24:07 2022] GET /identity/v3/services/compute => generated 88 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:24:07.570438 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52f01c9-a1db-442b-ac05-d57814e8e268 None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:24:07.579338 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52f01c9-a1db-442b-ac05-d57814e8e268 None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:24:07.583828 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a45fb4a-07cc-450a-9a69-1867c50e4073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:24:07.584474 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a45fb4a-07cc-450a-9a69-1867c50e4073 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:07.584753 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a45fb4a-07cc-450a-9a69-1867c50e4073 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:07.585025 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a45fb4a-07cc-450a-9a69-1867c50e4073 admin admin] PATH_INFO: `/v3/services` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:07.585738 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a45fb4a-07cc-450a-9a69-1867c50e4073 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:24:07.586039 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a45fb4a-07cc-450a-9a69-1867c50e4073 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:24:07.587634 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a45fb4a-07cc-450a-9a69-1867c50e4073 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:24:07.599901 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 516/1020] 10.222.0.117 () {56 vars in 1138 bytes} [Tue Jan 25 02:24:07 2022] GET /identity/v3/services?name=compute => generated 125 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:24:07.600992 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bdf2a9-cf90-4d52-8a0b-e7a0980b210d admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:24:07.611521 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bdf2a9-cf90-4d52-8a0b-e7a0980b210d admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:24:07.616183 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de70bd2c-3fe8-43cf-a5ed-7ccdca507477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:24:07.616829 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de70bd2c-3fe8-43cf-a5ed-7ccdca507477 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:07.617112 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de70bd2c-3fe8-43cf-a5ed-7ccdca507477 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:07.617391 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de70bd2c-3fe8-43cf-a5ed-7ccdca507477 admin admin] PATH_INFO: `/v3/services` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:07.618113 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de70bd2c-3fe8-43cf-a5ed-7ccdca507477 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:24:07.618587 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de70bd2c-3fe8-43cf-a5ed-7ccdca507477 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:24:07.620409 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de70bd2c-3fe8-43cf-a5ed-7ccdca507477 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:24:07.625426 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 505/1021] 10.222.0.117 () {56 vars in 1138 bytes} [Tue Jan 25 02:24:07 2022] GET /identity/v3/services?type=compute => generated 354 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:24:07.631077 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a45fb4a-07cc-450a-9a69-1867c50e4073 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:24:07.640860 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a45fb4a-07cc-450a-9a69-1867c50e4073 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:24:07.645431 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6922a505-439f-4f62-b340-09533def0804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:24:07.646073 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6922a505-439f-4f62-b340-09533def0804 admin admin] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:07.646354 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6922a505-439f-4f62-b340-09533def0804 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:07.646626 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6922a505-439f-4f62-b340-09533def0804 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:07.647374 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6922a505-439f-4f62-b340-09533def0804 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:24:07.649003 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6922a505-439f-4f62-b340-09533def0804 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:24:07.668183 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 517/1022] 10.222.0.117 () {60 vars in 1170 bytes} [Tue Jan 25 02:24:07 2022] POST /identity/v3/endpoints => generated 336 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 25 02:24:08.922179 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0341e1-9627-4b1a-a19a-c67a1aca9718 None None] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:08.922741 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0341e1-9627-4b1a-a19a-c67a1aca9718 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:08.922741 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0341e1-9627-4b1a-a19a-c67a1aca9718 None None] PATH_INFO: `/` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:08.924556 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 506/1023] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:24:08 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:24:08.930402 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4123128c-f39e-4572-8be6-9c9efb138c00 None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:08.930885 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4123128c-f39e-4572-8be6-9c9efb138c00 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:08.930885 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4123128c-f39e-4572-8be6-9c9efb138c00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:08.949835 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-4123128c-f39e-4572-8be6-9c9efb138c00 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:24:08.951014 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-4123128c-f39e-4572-8be6-9c9efb138c00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:24:08.968233 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 518/1024] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:24:08 2022] POST /identity/v3/auth/tokens => generated 2832 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:24:08.992720 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0341e1-9627-4b1a-a19a-c67a1aca9718 None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:24:09.005384 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0341e1-9627-4b1a-a19a-c67a1aca9718 None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:24:09.010229 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7381cb5c-616b-480b-b2b7-443cddb66d55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:24:09.011286 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7381cb5c-616b-480b-b2b7-443cddb66d55 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:09.011567 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7381cb5c-616b-480b-b2b7-443cddb66d55 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:09.011873 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7381cb5c-616b-480b-b2b7-443cddb66d55 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:09.013053 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7381cb5c-616b-480b-b2b7-443cddb66d55 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:24:09.014718 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7381cb5c-616b-480b-b2b7-443cddb66d55 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:24:09.016355 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 507/1025] 10.222.0.117 () {56 vars in 1134 bytes} [Tue Jan 25 02:24:08 2022] GET /identity/v3/domains/default => generated 200 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:24:09.018639 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e892737-b9b5-4973-a32f-a38fad14a891 None None] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:09.018935 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e892737-b9b5-4973-a32f-a38fad14a891 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:09.019217 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e892737-b9b5-4973-a32f-a38fad14a891 None None] PATH_INFO: `/` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:09.021242 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 519/1026] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:24:09 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:24:09.021935 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7381cb5c-616b-480b-b2b7-443cddb66d55 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:24:09.026080 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3dd806-a76b-4dde-863e-728f86476719 None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:09.026368 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3dd806-a76b-4dde-863e-728f86476719 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:09.026651 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3dd806-a76b-4dde-863e-728f86476719 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:09.031903 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7381cb5c-616b-480b-b2b7-443cddb66d55 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:24:09.036376 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be9feab-71de-452c-bb71-05e8b3f29afa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:24:09.037001 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be9feab-71de-452c-bb71-05e8b3f29afa admin admin] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:09.037278 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be9feab-71de-452c-bb71-05e8b3f29afa admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:09.037557 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be9feab-71de-452c-bb71-05e8b3f29afa admin admin] PATH_INFO: `/v3/projects` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:09.038263 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be9feab-71de-452c-bb71-05e8b3f29afa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:24:09.040153 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be9feab-71de-452c-bb71-05e8b3f29afa admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:24:09.044563 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-5e3dd806-a76b-4dde-863e-728f86476719 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:24:09.045755 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-5e3dd806-a76b-4dde-863e-728f86476719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:24:09.053735 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 520/1027] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:24:09 2022] POST /identity/v3/auth/tokens => generated 2832 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 25 02:24:09.069620 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 508/1028] 10.222.0.117 () {60 vars in 1167 bytes} [Tue Jan 25 02:24:09 2022] POST /identity/v3/projects => generated 312 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 25 02:24:09.078227 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3dd806-a76b-4dde-863e-728f86476719 None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:24:09.088414 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3dd806-a76b-4dde-863e-728f86476719 None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:24:09.149546 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c71a30-8a74-472a-9352-32cbb0394068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:24:09.150990 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c71a30-8a74-472a-9352-32cbb0394068 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:09.151282 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c71a30-8a74-472a-9352-32cbb0394068 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:09.151650 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c71a30-8a74-472a-9352-32cbb0394068 admin admin] PATH_INFO: `/v3/services/image` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:09.152362 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c71a30-8a74-472a-9352-32cbb0394068 admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:24:09.154073 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c71a30-8a74-472a-9352-32cbb0394068 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:24:09.165641 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: WARNING keystone.server.flask.application [None req-43c71a30-8a74-472a-9352-32cbb0394068 admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jan 25 02:24:09.168005 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 521/1029] 10.222.0.117 () {56 vars in 1131 bytes} [Tue Jan 25 02:24:09 2022] GET /identity/v3/services/image => generated 86 bytes in 90 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:24:09.174043 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be9feab-71de-452c-bb71-05e8b3f29afa admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:24:09.185369 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be9feab-71de-452c-bb71-05e8b3f29afa admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:24:09.190067 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf21996-1de8-438e-b9cf-958fb743c88d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:24:09.190849 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf21996-1de8-438e-b9cf-958fb743c88d admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:09.191205 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf21996-1de8-438e-b9cf-958fb743c88d admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:09.191553 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf21996-1de8-438e-b9cf-958fb743c88d admin admin] PATH_INFO: `/v3/services` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:09.192418 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf21996-1de8-438e-b9cf-958fb743c88d admin admin] RBAC: Adding query filter params (name=image) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:24:09.192796 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf21996-1de8-438e-b9cf-958fb743c88d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:24:09.194498 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf21996-1de8-438e-b9cf-958fb743c88d admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:24:09.201045 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 509/1030] 10.222.0.117 () {56 vars in 1134 bytes} [Tue Jan 25 02:24:09 2022] GET /identity/v3/services?name=image => generated 123 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 02:24:09.206975 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c71a30-8a74-472a-9352-32cbb0394068 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:24:09.218135 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c71a30-8a74-472a-9352-32cbb0394068 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:24:09.223182 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae79f71-9d21-4c1f-b0c2-0cee14f4a5c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:24:09.223899 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae79f71-9d21-4c1f-b0c2-0cee14f4a5c3 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:09.224187 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae79f71-9d21-4c1f-b0c2-0cee14f4a5c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:09.224464 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae79f71-9d21-4c1f-b0c2-0cee14f4a5c3 admin admin] PATH_INFO: `/v3/services` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:09.225200 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae79f71-9d21-4c1f-b0c2-0cee14f4a5c3 admin admin] RBAC: Adding query filter params (type=image) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:24:09.225509 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae79f71-9d21-4c1f-b0c2-0cee14f4a5c3 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:24:09.227130 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae79f71-9d21-4c1f-b0c2-0cee14f4a5c3 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:24:09.233477 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 522/1031] 10.222.0.117 () {56 vars in 1134 bytes} [Tue Jan 25 02:24:09 2022] GET /identity/v3/services?type=image => generated 352 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:24:09.239354 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf21996-1de8-438e-b9cf-958fb743c88d admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:24:09.249890 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf21996-1de8-438e-b9cf-958fb743c88d admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:24:09.254641 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aec74aa-503c-40e9-966a-92b7194d9497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:24:09.255360 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aec74aa-503c-40e9-966a-92b7194d9497 admin admin] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:09.255653 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aec74aa-503c-40e9-966a-92b7194d9497 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:09.255959 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aec74aa-503c-40e9-966a-92b7194d9497 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:09.256739 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aec74aa-503c-40e9-966a-92b7194d9497 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:24:09.258620 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aec74aa-503c-40e9-966a-92b7194d9497 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:24:09.281801 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 510/1032] 10.222.0.117 () {60 vars in 1170 bytes} [Tue Jan 25 02:24:09 2022] POST /identity/v3/endpoints => generated 329 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 02:24:10.036259 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c341de92-23b5-4dca-8a74-f288cf73d977 None None] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:10.036783 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c341de92-23b5-4dca-8a74-f288cf73d977 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:10.036783 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c341de92-23b5-4dca-8a74-f288cf73d977 None None] PATH_INFO: `/` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:10.038569 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 523/1033] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:24:10 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:24:10.044640 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0331b879-13e7-46a8-ada2-8e1216893b6e None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:10.045045 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0331b879-13e7-46a8-ada2-8e1216893b6e None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:10.045197 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0331b879-13e7-46a8-ada2-8e1216893b6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:10.063282 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-0331b879-13e7-46a8-ada2-8e1216893b6e None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:24:10.064792 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-0331b879-13e7-46a8-ada2-8e1216893b6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:24:10.087396 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 511/1034] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:24:10 2022] POST /identity/v3/auth/tokens => generated 2982 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:24:10.107916 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c341de92-23b5-4dca-8a74-f288cf73d977 None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:24:10.121037 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c341de92-23b5-4dca-8a74-f288cf73d977 None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:24:10.125648 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ad317c-240c-48cb-b185-077caddf9e02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:24:10.126663 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ad317c-240c-48cb-b185-077caddf9e02 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:10.127160 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ad317c-240c-48cb-b185-077caddf9e02 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:10.127628 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ad317c-240c-48cb-b185-077caddf9e02 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:10.138307 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ad317c-240c-48cb-b185-077caddf9e02 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 25 02:24:10.145816 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: WARNING keystone.server.flask.application [None req-35ad317c-240c-48cb-b185-077caddf9e02 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jan 25 02:24:10.147232 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 524/1035] 10.222.0.117 () {56 vars in 1146 bytes} [Tue Jan 25 02:24:10 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:24:10.153665 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0331b879-13e7-46a8-ada2-8e1216893b6e None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:24:10.162564 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0331b879-13e7-46a8-ada2-8e1216893b6e None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:24:10.167728 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e98bf6-fc58-448a-a3a7-74ec7495b6ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:24:10.168413 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e98bf6-fc58-448a-a3a7-74ec7495b6ea admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:10.168695 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e98bf6-fc58-448a-a3a7-74ec7495b6ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:10.168970 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e98bf6-fc58-448a-a3a7-74ec7495b6ea admin admin] PATH_INFO: `/v3/roles` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:10.169731 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e98bf6-fc58-448a-a3a7-74ec7495b6ea admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:24:10.170035 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e98bf6-fc58-448a-a3a7-74ec7495b6ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:24:10.171624 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e98bf6-fc58-448a-a3a7-74ec7495b6ea admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:24:10.184237 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 512/1036] 10.222.0.117 () {56 vars in 1141 bytes} [Tue Jan 25 02:24:10 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 340 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:24:10.186842 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ad317c-240c-48cb-b185-077caddf9e02 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:24:10.197400 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ad317c-240c-48cb-b185-077caddf9e02 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:24:10.201988 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835ce8f2-7112-4a81-82e4-a170c1463c21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:24:10.202767 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835ce8f2-7112-4a81-82e4-a170c1463c21 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:10.203051 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835ce8f2-7112-4a81-82e4-a170c1463c21 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:10.203324 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835ce8f2-7112-4a81-82e4-a170c1463c21 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:10.213626 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835ce8f2-7112-4a81-82e4-a170c1463c21 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:24:10.215465 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835ce8f2-7112-4a81-82e4-a170c1463c21 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:24:10.232736 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: WARNING keystone.server.flask.application [None req-835ce8f2-7112-4a81-82e4-a170c1463c21 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 25 02:24:10.238490 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 525/1037] 10.222.0.117 () {56 vars in 1134 bytes} [Tue Jan 25 02:24:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:24:10.240027 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e98bf6-fc58-448a-a3a7-74ec7495b6ea admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:24:10.251383 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e98bf6-fc58-448a-a3a7-74ec7495b6ea admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:24:10.256217 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a1841f-2a05-407e-9c0b-d2b34bfad397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:24:10.256889 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a1841f-2a05-407e-9c0b-d2b34bfad397 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:10.257172 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a1841f-2a05-407e-9c0b-d2b34bfad397 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:10.257500 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a1841f-2a05-407e-9c0b-d2b34bfad397 admin admin] PATH_INFO: `/v3/domains` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:10.258257 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a1841f-2a05-407e-9c0b-d2b34bfad397 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:24:10.258562 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a1841f-2a05-407e-9c0b-d2b34bfad397 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:24:10.260897 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a1841f-2a05-407e-9c0b-d2b34bfad397 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:24:10.273941 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 513/1038] 10.222.0.117 () {56 vars in 1135 bytes} [Tue Jan 25 02:24:10 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:24:10.280454 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835ce8f2-7112-4a81-82e4-a170c1463c21 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:24:10.290369 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835ce8f2-7112-4a81-82e4-a170c1463c21 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:24:10.295427 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea10d55-cacb-47dd-b0fd-4774708fc676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:24:10.296326 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea10d55-cacb-47dd-b0fd-4774708fc676 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:10.296680 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea10d55-cacb-47dd-b0fd-4774708fc676 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:10.297029 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea10d55-cacb-47dd-b0fd-4774708fc676 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:10.304452 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea10d55-cacb-47dd-b0fd-4774708fc676 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:24:10.306550 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea10d55-cacb-47dd-b0fd-4774708fc676 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:24:10.321282 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: WARNING keystone.server.flask.application [None req-eea10d55-cacb-47dd-b0fd-4774708fc676 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jan 25 02:24:10.323308 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 526/1039] 10.222.0.117 () {56 vars in 1119 bytes} [Tue Jan 25 02:24:10 2022] GET /identity/v3/users/nova => generated 82 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:24:10.328983 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a1841f-2a05-407e-9c0b-d2b34bfad397 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:24:10.339472 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a1841f-2a05-407e-9c0b-d2b34bfad397 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:24:10.344197 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5a2b3e-9e5f-4dc9-aa82-950f89caec61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:24:10.345207 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5a2b3e-9e5f-4dc9-aa82-950f89caec61 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:10.345556 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5a2b3e-9e5f-4dc9-aa82-950f89caec61 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:10.345894 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5a2b3e-9e5f-4dc9-aa82-950f89caec61 admin admin] PATH_INFO: `/v3/users` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:10.346809 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5a2b3e-9e5f-4dc9-aa82-950f89caec61 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:24:10.347181 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5a2b3e-9e5f-4dc9-aa82-950f89caec61 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:24:10.349123 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5a2b3e-9e5f-4dc9-aa82-950f89caec61 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:24:10.371398 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 514/1040] 10.222.0.117 () {56 vars in 1159 bytes} [Tue Jan 25 02:24:10 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 370 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 02:24:10.372942 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea10d55-cacb-47dd-b0fd-4774708fc676 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:24:10.382668 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea10d55-cacb-47dd-b0fd-4774708fc676 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:24:10.387828 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37141f5-3349-4bd1-b05c-d431fedf9a90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:24:10.388464 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37141f5-3349-4bd1-b05c-d431fedf9a90 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:10.388748 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37141f5-3349-4bd1-b05c-d431fedf9a90 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:10.389022 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37141f5-3349-4bd1-b05c-d431fedf9a90 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:10.396966 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37141f5-3349-4bd1-b05c-d431fedf9a90 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:24:10.398766 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37141f5-3349-4bd1-b05c-d431fedf9a90 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:24:10.408327 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 527/1041] 10.222.0.117 () {58 vars in 1329 bytes} [Tue Jan 25 02:24:10 2022] GET /identity/v3/auth/tokens => generated 2982 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:24:10.413934 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5a2b3e-9e5f-4dc9-aa82-950f89caec61 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:24:10.424286 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5a2b3e-9e5f-4dc9-aa82-950f89caec61 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:24:10.428784 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a41106b-b89b-406b-ba9a-ed00b8cc5d21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:24:10.429567 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a41106b-b89b-406b-ba9a-ed00b8cc5d21 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:10.429851 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a41106b-b89b-406b-ba9a-ed00b8cc5d21 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:10.430127 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a41106b-b89b-406b-ba9a-ed00b8cc5d21 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:10.443023 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a41106b-b89b-406b-ba9a-ed00b8cc5d21 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:24:10.444948 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a41106b-b89b-406b-ba9a-ed00b8cc5d21 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:24:10.463233 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: WARNING keystone.server.flask.application [None req-4a41106b-b89b-406b-ba9a-ed00b8cc5d21 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 25 02:24:10.464622 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 515/1042] 10.222.0.117 () {56 vars in 1134 bytes} [Tue Jan 25 02:24:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:24:10.470483 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37141f5-3349-4bd1-b05c-d431fedf9a90 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:24:10.479974 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37141f5-3349-4bd1-b05c-d431fedf9a90 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:24:10.484506 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63f1bf7-0559-41e9-9cfa-3171f4d84d84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:24:10.485150 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63f1bf7-0559-41e9-9cfa-3171f4d84d84 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:10.485432 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63f1bf7-0559-41e9-9cfa-3171f4d84d84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:10.485709 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63f1bf7-0559-41e9-9cfa-3171f4d84d84 admin admin] PATH_INFO: `/v3/domains` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:10.486446 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63f1bf7-0559-41e9-9cfa-3171f4d84d84 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:24:10.486751 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63f1bf7-0559-41e9-9cfa-3171f4d84d84 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:24:10.488393 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63f1bf7-0559-41e9-9cfa-3171f4d84d84 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:24:10.500717 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 528/1043] 10.222.0.117 () {56 vars in 1135 bytes} [Tue Jan 25 02:24:10 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:24:10.506215 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a41106b-b89b-406b-ba9a-ed00b8cc5d21 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:24:10.516967 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a41106b-b89b-406b-ba9a-ed00b8cc5d21 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:24:10.521764 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34ecbfc-3896-41bb-94a1-3d38f74f9e93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:24:10.522543 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34ecbfc-3896-41bb-94a1-3d38f74f9e93 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:10.522826 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34ecbfc-3896-41bb-94a1-3d38f74f9e93 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:10.523099 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34ecbfc-3896-41bb-94a1-3d38f74f9e93 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:10.530270 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34ecbfc-3896-41bb-94a1-3d38f74f9e93 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:24:10.532278 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34ecbfc-3896-41bb-94a1-3d38f74f9e93 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:24:10.545525 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: WARNING keystone.server.flask.application [None req-f34ecbfc-3896-41bb-94a1-3d38f74f9e93 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 25 02:24:10.551320 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 516/1044] 10.222.0.117 () {56 vars in 1137 bytes} [Tue Jan 25 02:24:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 25 02:24:10.552838 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63f1bf7-0559-41e9-9cfa-3171f4d84d84 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:24:10.563237 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63f1bf7-0559-41e9-9cfa-3171f4d84d84 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:24:10.567803 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e93321-6cfe-4cc1-a00f-79f453fb19f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:24:10.568517 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e93321-6cfe-4cc1-a00f-79f453fb19f9 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:10.568871 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e93321-6cfe-4cc1-a00f-79f453fb19f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:10.569235 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e93321-6cfe-4cc1-a00f-79f453fb19f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:10.570098 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e93321-6cfe-4cc1-a00f-79f453fb19f9 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:24:10.570472 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e93321-6cfe-4cc1-a00f-79f453fb19f9 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:24:10.572994 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e93321-6cfe-4cc1-a00f-79f453fb19f9 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:24:10.590588 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 529/1045] 10.222.0.117 () {56 vars in 1174 bytes} [Tue Jan 25 02:24:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:24:10.591848 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34ecbfc-3896-41bb-94a1-3d38f74f9e93 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:24:10.602351 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34ecbfc-3896-41bb-94a1-3d38f74f9e93 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:24:10.606891 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efebb42-27f1-46ac-a1a0-638eabb136ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:24:10.607520 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efebb42-27f1-46ac-a1a0-638eabb136ff admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:10.607833 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efebb42-27f1-46ac-a1a0-638eabb136ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:10.608106 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efebb42-27f1-46ac-a1a0-638eabb136ff admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:10.608937 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efebb42-27f1-46ac-a1a0-638eabb136ff admin admin] RBAC: Adding query filter params (role.id=06cf9f8251c94c588ee2dafb34cab2a8, scope.project.id=61a6fe9d4c914755bb0a64c392bd16aa, user.id=d9ad6269900346458050063c12cac299) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:24:10.609245 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efebb42-27f1-46ac-a1a0-638eabb136ff admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:24:10.611064 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efebb42-27f1-46ac-a1a0-638eabb136ff admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:24:10.616641 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 517/1046] 10.222.0.117 () {56 vars in 1400 bytes} [Tue Jan 25 02:24:10 2022] GET /identity/v3/role_assignments?user.id=d9ad6269900346458050063c12cac299&scope.project.id=61a6fe9d4c914755bb0a64c392bd16aa&role.id=06cf9f8251c94c588ee2dafb34cab2a8 => generated 260 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:24:11.362162 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8acb855-e4f5-40b1-90e0-722762edfd90 None None] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:11.362684 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8acb855-e4f5-40b1-90e0-722762edfd90 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:11.362760 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8acb855-e4f5-40b1-90e0-722762edfd90 None None] PATH_INFO: `/` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:11.364547 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 530/1047] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:24:11 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:24:11.370470 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac186ed3-bda1-4483-a98d-c5322e56668c None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:11.370905 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac186ed3-bda1-4483-a98d-c5322e56668c None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:11.371049 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac186ed3-bda1-4483-a98d-c5322e56668c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:11.389325 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-ac186ed3-bda1-4483-a98d-c5322e56668c None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:24:11.390516 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-ac186ed3-bda1-4483-a98d-c5322e56668c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:24:11.398447 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 518/1048] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:24:11 2022] POST /identity/v3/auth/tokens => generated 2982 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 25 02:24:11.424382 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8acb855-e4f5-40b1-90e0-722762edfd90 None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:24:11.436516 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8acb855-e4f5-40b1-90e0-722762edfd90 None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:24:11.440829 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e90076-b7a9-4295-8e0f-eeece2451da0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:24:11.441606 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e90076-b7a9-4295-8e0f-eeece2451da0 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:11.441887 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e90076-b7a9-4295-8e0f-eeece2451da0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:11.442162 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e90076-b7a9-4295-8e0f-eeece2451da0 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:11.443365 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e90076-b7a9-4295-8e0f-eeece2451da0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:24:11.445149 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e90076-b7a9-4295-8e0f-eeece2451da0 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:24:11.446863 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 531/1049] 10.222.0.117 () {56 vars in 1134 bytes} [Tue Jan 25 02:24:11 2022] GET /identity/v3/domains/default => generated 200 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:24:11.452559 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac186ed3-bda1-4483-a98d-c5322e56668c None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:24:11.461632 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac186ed3-bda1-4483-a98d-c5322e56668c None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:24:11.466904 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bfda8a-c17a-4543-9101-a6f6cb04c9a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:24:11.467664 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bfda8a-c17a-4543-9101-a6f6cb04c9a7 admin admin] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:11.468048 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bfda8a-c17a-4543-9101-a6f6cb04c9a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:11.468330 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bfda8a-c17a-4543-9101-a6f6cb04c9a7 admin admin] PATH_INFO: `/v3/users` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:11.469071 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bfda8a-c17a-4543-9101-a6f6cb04c9a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:24:11.471248 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bfda8a-c17a-4543-9101-a6f6cb04c9a7 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:24:11.495724 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 519/1050] 10.222.0.117 () {60 vars in 1158 bytes} [Tue Jan 25 02:24:11 2022] POST /identity/v3/users => generated 286 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 25 02:24:11.562686 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8176fd14-a2eb-4ad2-b313-0d3dd8a792b6 None None] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:11.563033 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8176fd14-a2eb-4ad2-b313-0d3dd8a792b6 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:11.563239 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8176fd14-a2eb-4ad2-b313-0d3dd8a792b6 None None] PATH_INFO: `/` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:11.565101 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 532/1051] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:24:11 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jan 25 02:24:11.570919 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907de61f-56c1-48af-89db-29858f97c029 None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:11.571198 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907de61f-56c1-48af-89db-29858f97c029 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:11.571475 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907de61f-56c1-48af-89db-29858f97c029 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:11.594757 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-907de61f-56c1-48af-89db-29858f97c029 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:24:11.596120 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-907de61f-56c1-48af-89db-29858f97c029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:24:11.604789 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 520/1052] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:24:11 2022] POST /identity/v3/auth/tokens => generated 2982 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:24:11.627784 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8176fd14-a2eb-4ad2-b313-0d3dd8a792b6 None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:24:11.641136 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8176fd14-a2eb-4ad2-b313-0d3dd8a792b6 None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:24:11.645788 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dabd13-2d6f-4138-b1e5-a2d959c6d325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:24:11.646449 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dabd13-2d6f-4138-b1e5-a2d959c6d325 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:11.646732 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dabd13-2d6f-4138-b1e5-a2d959c6d325 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:11.647008 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dabd13-2d6f-4138-b1e5-a2d959c6d325 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:11.656777 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dabd13-2d6f-4138-b1e5-a2d959c6d325 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:24:11.658568 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dabd13-2d6f-4138-b1e5-a2d959c6d325 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:24:11.668613 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 533/1053] 10.222.0.117 () {58 vars in 1329 bytes} [Tue Jan 25 02:24:11 2022] GET /identity/v3/auth/tokens => generated 2982 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:24:11.674607 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907de61f-56c1-48af-89db-29858f97c029 None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:24:11.685239 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907de61f-56c1-48af-89db-29858f97c029 None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:24:11.689931 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1a4d3d-f04e-4cb0-aa90-3dad7e74edc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:24:11.690722 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1a4d3d-f04e-4cb0-aa90-3dad7e74edc7 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:11.691010 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1a4d3d-f04e-4cb0-aa90-3dad7e74edc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:11.691283 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1a4d3d-f04e-4cb0-aa90-3dad7e74edc7 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:11.692535 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1a4d3d-f04e-4cb0-aa90-3dad7e74edc7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:24:11.694268 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1a4d3d-f04e-4cb0-aa90-3dad7e74edc7 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:24:11.696010 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 521/1054] 10.222.0.117 () {56 vars in 1134 bytes} [Tue Jan 25 02:24:11 2022] GET /identity/v3/domains/default => generated 200 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:24:12.841549 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8e067e-52e2-4e4c-9ed4-c2e49d07dc11 None None] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:12.842124 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8e067e-52e2-4e4c-9ed4-c2e49d07dc11 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:12.842124 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8e067e-52e2-4e4c-9ed4-c2e49d07dc11 None None] PATH_INFO: `/` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:12.843871 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 534/1055] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:24:12 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:24:12.849227 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a9e96b-fed7-48bd-8044-420eabf63bd6 None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:12.849646 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a9e96b-fed7-48bd-8044-420eabf63bd6 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:12.849772 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a9e96b-fed7-48bd-8044-420eabf63bd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:12.867315 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-46a9e96b-fed7-48bd-8044-420eabf63bd6 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:24:12.868503 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-46a9e96b-fed7-48bd-8044-420eabf63bd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:24:12.876944 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 522/1056] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:24:12 2022] POST /identity/v3/auth/tokens => generated 2982 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:24:12.900425 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8e067e-52e2-4e4c-9ed4-c2e49d07dc11 None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:24:12.912635 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8e067e-52e2-4e4c-9ed4-c2e49d07dc11 None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:24:12.917113 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5659da-657b-44e1-a036-dfe44c59c94d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:24:12.917899 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5659da-657b-44e1-a036-dfe44c59c94d admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:12.918181 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5659da-657b-44e1-a036-dfe44c59c94d admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:12.918577 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5659da-657b-44e1-a036-dfe44c59c94d admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:12.928658 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5659da-657b-44e1-a036-dfe44c59c94d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 25 02:24:12.936520 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: WARNING keystone.server.flask.application [None req-7d5659da-657b-44e1-a036-dfe44c59c94d admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jan 25 02:24:12.937667 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 535/1057] 10.222.0.117 () {56 vars in 1146 bytes} [Tue Jan 25 02:24:12 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:24:12.943392 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a9e96b-fed7-48bd-8044-420eabf63bd6 None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:24:12.953408 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a9e96b-fed7-48bd-8044-420eabf63bd6 None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:24:12.957894 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2561ea9e-5cc2-4bc3-b8b5-745ff35cd11b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:24:12.958606 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2561ea9e-5cc2-4bc3-b8b5-745ff35cd11b admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:12.958950 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2561ea9e-5cc2-4bc3-b8b5-745ff35cd11b admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:12.959287 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2561ea9e-5cc2-4bc3-b8b5-745ff35cd11b admin admin] PATH_INFO: `/v3/roles` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:12.960145 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2561ea9e-5cc2-4bc3-b8b5-745ff35cd11b admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:24:12.960451 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2561ea9e-5cc2-4bc3-b8b5-745ff35cd11b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:24:12.962029 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2561ea9e-5cc2-4bc3-b8b5-745ff35cd11b admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:24:12.970604 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 523/1058] 10.222.0.117 () {56 vars in 1141 bytes} [Tue Jan 25 02:24:12 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 340 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:24:12.975997 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5659da-657b-44e1-a036-dfe44c59c94d admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:24:12.986699 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5659da-657b-44e1-a036-dfe44c59c94d admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:24:12.991072 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b76837-80ba-421a-bcbe-e91852edd663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:24:12.991868 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b76837-80ba-421a-bcbe-e91852edd663 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:12.992146 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b76837-80ba-421a-bcbe-e91852edd663 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:12.992415 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b76837-80ba-421a-bcbe-e91852edd663 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:13.004456 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b76837-80ba-421a-bcbe-e91852edd663 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:24:13.007205 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b76837-80ba-421a-bcbe-e91852edd663 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:24:13.029335 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: WARNING keystone.server.flask.application [None req-b9b76837-80ba-421a-bcbe-e91852edd663 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 25 02:24:13.030809 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 536/1059] 10.222.0.117 () {56 vars in 1134 bytes} [Tue Jan 25 02:24:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 25 02:24:13.036272 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2561ea9e-5cc2-4bc3-b8b5-745ff35cd11b admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:24:13.046721 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2561ea9e-5cc2-4bc3-b8b5-745ff35cd11b admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:24:13.051206 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5d2f61-d6ab-45e1-935d-151724e76f25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:24:13.051876 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5d2f61-d6ab-45e1-935d-151724e76f25 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:13.052161 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5d2f61-d6ab-45e1-935d-151724e76f25 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:13.052445 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5d2f61-d6ab-45e1-935d-151724e76f25 admin admin] PATH_INFO: `/v3/domains` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:13.053173 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5d2f61-d6ab-45e1-935d-151724e76f25 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:24:13.053478 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5d2f61-d6ab-45e1-935d-151724e76f25 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:24:13.055056 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5d2f61-d6ab-45e1-935d-151724e76f25 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:24:13.066586 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 524/1060] 10.222.0.117 () {56 vars in 1135 bytes} [Tue Jan 25 02:24:13 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:24:13.072185 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b76837-80ba-421a-bcbe-e91852edd663 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:24:13.082049 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b76837-80ba-421a-bcbe-e91852edd663 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:24:13.086574 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec00d7d-5975-4342-a639-96939b42179a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:24:13.087330 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec00d7d-5975-4342-a639-96939b42179a admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:13.088144 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec00d7d-5975-4342-a639-96939b42179a admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:13.088681 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec00d7d-5975-4342-a639-96939b42179a admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:13.096352 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec00d7d-5975-4342-a639-96939b42179a admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:24:13.098362 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec00d7d-5975-4342-a639-96939b42179a admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:24:13.112785 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: WARNING keystone.server.flask.application [None req-eec00d7d-5975-4342-a639-96939b42179a admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jan 25 02:24:13.114125 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 537/1061] 10.222.0.117 () {56 vars in 1119 bytes} [Tue Jan 25 02:24:13 2022] GET /identity/v3/users/nova => generated 82 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 25 02:24:13.119548 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5d2f61-d6ab-45e1-935d-151724e76f25 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:24:13.129144 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5d2f61-d6ab-45e1-935d-151724e76f25 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:24:13.133666 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6426b2-cc0b-4e97-95c9-d8a0ca469d02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:24:13.134314 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6426b2-cc0b-4e97-95c9-d8a0ca469d02 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:13.135215 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6426b2-cc0b-4e97-95c9-d8a0ca469d02 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:13.135499 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6426b2-cc0b-4e97-95c9-d8a0ca469d02 admin admin] PATH_INFO: `/v3/users` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:13.136493 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6426b2-cc0b-4e97-95c9-d8a0ca469d02 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:24:13.136805 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6426b2-cc0b-4e97-95c9-d8a0ca469d02 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:24:13.138648 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6426b2-cc0b-4e97-95c9-d8a0ca469d02 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:24:13.156167 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 525/1062] 10.222.0.117 () {56 vars in 1159 bytes} [Tue Jan 25 02:24:13 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 370 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:24:13.161619 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec00d7d-5975-4342-a639-96939b42179a admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:24:13.171420 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec00d7d-5975-4342-a639-96939b42179a admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:24:13.176025 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747c7b29-efed-452a-952f-3983400b3505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:24:13.176795 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747c7b29-efed-452a-952f-3983400b3505 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:13.177073 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747c7b29-efed-452a-952f-3983400b3505 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:13.177344 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747c7b29-efed-452a-952f-3983400b3505 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:13.187382 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747c7b29-efed-452a-952f-3983400b3505 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:24:13.189193 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747c7b29-efed-452a-952f-3983400b3505 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:24:13.206853 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: WARNING keystone.server.flask.application [None req-747c7b29-efed-452a-952f-3983400b3505 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 25 02:24:13.208030 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 538/1063] 10.222.0.117 () {56 vars in 1134 bytes} [Tue Jan 25 02:24:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 25 02:24:13.214493 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6426b2-cc0b-4e97-95c9-d8a0ca469d02 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:24:13.224494 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6426b2-cc0b-4e97-95c9-d8a0ca469d02 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:24:13.229735 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179b3816-31f3-415d-b204-831fdaad43dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:24:13.230378 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179b3816-31f3-415d-b204-831fdaad43dd admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:13.230666 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179b3816-31f3-415d-b204-831fdaad43dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:13.230948 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179b3816-31f3-415d-b204-831fdaad43dd admin admin] PATH_INFO: `/v3/domains` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:13.231705 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179b3816-31f3-415d-b204-831fdaad43dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:24:13.232058 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179b3816-31f3-415d-b204-831fdaad43dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:24:13.233613 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179b3816-31f3-415d-b204-831fdaad43dd admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:24:13.245251 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 526/1064] 10.222.0.117 () {56 vars in 1135 bytes} [Tue Jan 25 02:24:13 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:24:13.250698 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747c7b29-efed-452a-952f-3983400b3505 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:24:13.260884 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747c7b29-efed-452a-952f-3983400b3505 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:24:13.265369 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11858cc1-5295-43ac-a069-0bd31de8b964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:24:13.266145 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11858cc1-5295-43ac-a069-0bd31de8b964 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:13.266429 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11858cc1-5295-43ac-a069-0bd31de8b964 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:13.266704 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11858cc1-5295-43ac-a069-0bd31de8b964 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:13.273487 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11858cc1-5295-43ac-a069-0bd31de8b964 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:24:13.276062 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11858cc1-5295-43ac-a069-0bd31de8b964 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:24:13.288828 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: WARNING keystone.server.flask.application [None req-11858cc1-5295-43ac-a069-0bd31de8b964 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 25 02:24:13.290001 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 539/1065] 10.222.0.117 () {56 vars in 1137 bytes} [Tue Jan 25 02:24:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 25 02:24:13.295835 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179b3816-31f3-415d-b204-831fdaad43dd admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:24:13.305569 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179b3816-31f3-415d-b204-831fdaad43dd admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:24:13.312232 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f75de05-29cf-45f0-85f1-2257f05435ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:24:13.312881 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f75de05-29cf-45f0-85f1-2257f05435ce admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:13.313161 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f75de05-29cf-45f0-85f1-2257f05435ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:13.315800 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f75de05-29cf-45f0-85f1-2257f05435ce admin admin] PATH_INFO: `/v3/projects` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:13.316619 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f75de05-29cf-45f0-85f1-2257f05435ce admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:24:13.316927 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f75de05-29cf-45f0-85f1-2257f05435ce admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:24:13.320485 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f75de05-29cf-45f0-85f1-2257f05435ce admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:24:13.333786 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 527/1066] 10.222.0.117 () {56 vars in 1174 bytes} [Tue Jan 25 02:24:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 02:24:13.340552 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11858cc1-5295-43ac-a069-0bd31de8b964 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:24:13.351000 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11858cc1-5295-43ac-a069-0bd31de8b964 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:24:13.356364 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e646347-a541-4cd4-8c4c-4e6e2dbbc2ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:24:13.357223 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e646347-a541-4cd4-8c4c-4e6e2dbbc2ae admin admin] REQUEST_METHOD: `PUT` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:13.357501 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e646347-a541-4cd4-8c4c-4e6e2dbbc2ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:13.357777 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e646347-a541-4cd4-8c4c-4e6e2dbbc2ae admin admin] PATH_INFO: `/v3/projects/61a6fe9d4c914755bb0a64c392bd16aa/users/d9ad6269900346458050063c12cac299/roles/06cf9f8251c94c588ee2dafb34cab2a8` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:13.360018 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e646347-a541-4cd4-8c4c-4e6e2dbbc2ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=61a6fe9d4c914755bb0a64c392bd16aa, user_id=d9ad6269900346458050063c12cac299, role_id=06cf9f8251c94c588ee2dafb34cab2a8)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:24:13.362624 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e646347-a541-4cd4-8c4c-4e6e2dbbc2ae admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:24:13.377958 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 540/1067] 10.222.0.117 () {58 vars in 1465 bytes} [Tue Jan 25 02:24:13 2022] PUT /identity/v3/projects/61a6fe9d4c914755bb0a64c392bd16aa/users/d9ad6269900346458050063c12cac299/roles/06cf9f8251c94c588ee2dafb34cab2a8 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:24:13.826433 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a08ef1-6351-4cd4-b2b7-26484e89ef35 None None] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:13.826721 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a08ef1-6351-4cd4-b2b7-26484e89ef35 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:13.827000 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a08ef1-6351-4cd4-b2b7-26484e89ef35 None None] PATH_INFO: `/` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:13.828837 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 528/1068] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:24:13 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:24:13.834203 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b07c450-6f25-4d1c-ba53-a3aba9f326f3 None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:13.834496 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b07c450-6f25-4d1c-ba53-a3aba9f326f3 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:13.834775 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b07c450-6f25-4d1c-ba53-a3aba9f326f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:13.851965 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-8b07c450-6f25-4d1c-ba53-a3aba9f326f3 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:24:13.853672 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-8b07c450-6f25-4d1c-ba53-a3aba9f326f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:24:13.908907 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 541/1069] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:24:13 2022] POST /identity/v3/auth/tokens => generated 2982 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:24:13.934078 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a08ef1-6351-4cd4-b2b7-26484e89ef35 None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:24:13.945962 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a08ef1-6351-4cd4-b2b7-26484e89ef35 None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:24:13.950527 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba9da16-873b-4379-bb3f-197e554422e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:24:13.951297 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba9da16-873b-4379-bb3f-197e554422e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:13.951581 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba9da16-873b-4379-bb3f-197e554422e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:13.951885 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba9da16-873b-4379-bb3f-197e554422e5 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:13.961695 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba9da16-873b-4379-bb3f-197e554422e5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 25 02:24:13.973073 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: WARNING keystone.server.flask.application [None req-5ba9da16-873b-4379-bb3f-197e554422e5 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 25 02:24:13.974255 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 529/1070] 10.222.0.117 () {56 vars in 1122 bytes} [Tue Jan 25 02:24:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:24:13.980918 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b07c450-6f25-4d1c-ba53-a3aba9f326f3 None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:24:13.989822 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b07c450-6f25-4d1c-ba53-a3aba9f326f3 None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:24:13.995005 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12463b95-6aab-483c-a359-cdfc9dfaf84d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:24:13.995654 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12463b95-6aab-483c-a359-cdfc9dfaf84d admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:13.995966 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12463b95-6aab-483c-a359-cdfc9dfaf84d admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:13.996241 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12463b95-6aab-483c-a359-cdfc9dfaf84d admin admin] PATH_INFO: `/v3/roles` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:13.997013 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12463b95-6aab-483c-a359-cdfc9dfaf84d admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:24:13.997321 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12463b95-6aab-483c-a359-cdfc9dfaf84d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:24:13.998933 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12463b95-6aab-483c-a359-cdfc9dfaf84d admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:24:14.007008 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 542/1071] 10.222.0.117 () {56 vars in 1125 bytes} [Tue Jan 25 02:24:13 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:24:14.013085 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba9da16-873b-4379-bb3f-197e554422e5 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:24:14.029263 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba9da16-873b-4379-bb3f-197e554422e5 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:24:14.034201 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cac0efc-5bf2-42c3-bb40-74e435bbcb1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:24:14.035683 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cac0efc-5bf2-42c3-bb40-74e435bbcb1d admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:14.036098 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cac0efc-5bf2-42c3-bb40-74e435bbcb1d admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:14.036377 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cac0efc-5bf2-42c3-bb40-74e435bbcb1d admin admin] PATH_INFO: `/v3/users/9278e7591c464326b9f87d4c0da4f261` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:14.052508 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cac0efc-5bf2-42c3-bb40-74e435bbcb1d admin admin] RBAC: Authorizing `identity:get_user(user_id=9278e7591c464326b9f87d4c0da4f261)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:24:14.054638 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cac0efc-5bf2-42c3-bb40-74e435bbcb1d admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:24:14.056390 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 530/1072] 10.222.0.117 () {56 vars in 1203 bytes} [Tue Jan 25 02:24:14 2022] GET /identity/v3/users/9278e7591c464326b9f87d4c0da4f261 => generated 286 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:24:14.061962 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12463b95-6aab-483c-a359-cdfc9dfaf84d admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:24:14.072766 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12463b95-6aab-483c-a359-cdfc9dfaf84d admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:24:14.077554 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d96e83-a15e-4799-bae0-b342d8d679a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:24:14.078191 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d96e83-a15e-4799-bae0-b342d8d679a6 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:14.078473 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d96e83-a15e-4799-bae0-b342d8d679a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:14.078747 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d96e83-a15e-4799-bae0-b342d8d679a6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:14.086988 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d96e83-a15e-4799-bae0-b342d8d679a6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:24:14.089580 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d96e83-a15e-4799-bae0-b342d8d679a6 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:24:14.098636 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 543/1073] 10.222.0.117 () {58 vars in 1329 bytes} [Tue Jan 25 02:24:14 2022] GET /identity/v3/auth/tokens => generated 2982 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 25 02:24:14.104431 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cac0efc-5bf2-42c3-bb40-74e435bbcb1d admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:24:14.113858 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cac0efc-5bf2-42c3-bb40-74e435bbcb1d admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:24:14.118344 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93551a54-ecdc-409d-9ef9-2d2e7e9749fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:24:14.119180 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93551a54-ecdc-409d-9ef9-2d2e7e9749fc admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:14.119461 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93551a54-ecdc-409d-9ef9-2d2e7e9749fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:14.119763 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93551a54-ecdc-409d-9ef9-2d2e7e9749fc admin admin] PATH_INFO: `/v3/projects/f8d7f6b3ce20422186e598702c457539` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:14.120934 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93551a54-ecdc-409d-9ef9-2d2e7e9749fc admin admin] RBAC: Authorizing `identity:get_project(project_id=f8d7f6b3ce20422186e598702c457539)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:24:14.122972 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93551a54-ecdc-409d-9ef9-2d2e7e9749fc admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:24:14.129319 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 531/1074] 10.222.0.117 () {56 vars in 1212 bytes} [Tue Jan 25 02:24:14 2022] GET /identity/v3/projects/f8d7f6b3ce20422186e598702c457539 => generated 312 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 02:24:14.130726 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d96e83-a15e-4799-bae0-b342d8d679a6 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:24:14.140044 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d96e83-a15e-4799-bae0-b342d8d679a6 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:24:14.144710 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bea5f4-155b-4e14-8f11-16beb62dc638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:24:14.145344 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bea5f4-155b-4e14-8f11-16beb62dc638 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:14.145626 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bea5f4-155b-4e14-8f11-16beb62dc638 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:14.145903 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bea5f4-155b-4e14-8f11-16beb62dc638 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:14.146740 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bea5f4-155b-4e14-8f11-16beb62dc638 admin admin] RBAC: Adding query filter params (role.id=d8dbc6d83d9d41d28c3feb8b3485b291, scope.project.id=f8d7f6b3ce20422186e598702c457539, user.id=9278e7591c464326b9f87d4c0da4f261) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:24:14.147048 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bea5f4-155b-4e14-8f11-16beb62dc638 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:24:14.148912 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bea5f4-155b-4e14-8f11-16beb62dc638 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:24:14.154941 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 544/1075] 10.222.0.117 () {56 vars in 1400 bytes} [Tue Jan 25 02:24:14 2022] GET /identity/v3/role_assignments?user.id=9278e7591c464326b9f87d4c0da4f261&scope.project.id=f8d7f6b3ce20422186e598702c457539&role.id=d8dbc6d83d9d41d28c3feb8b3485b291 => generated 260 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:24:15.655443 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf410c02-3f4e-46e5-a748-8ddca11e16e7 None None] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:15.656062 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf410c02-3f4e-46e5-a748-8ddca11e16e7 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:15.656062 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf410c02-3f4e-46e5-a748-8ddca11e16e7 None None] PATH_INFO: `/` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:15.657800 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 532/1076] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:24:15 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:24:15.663090 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591201c3-b3c7-468e-b2b2-4da32c9de67c None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:15.663525 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591201c3-b3c7-468e-b2b2-4da32c9de67c None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:15.663643 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591201c3-b3c7-468e-b2b2-4da32c9de67c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:15.682686 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-591201c3-b3c7-468e-b2b2-4da32c9de67c None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:24:15.683881 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-591201c3-b3c7-468e-b2b2-4da32c9de67c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:24:15.691588 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 545/1077] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:24:15 2022] POST /identity/v3/auth/tokens => generated 2982 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 25 02:24:15.716013 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf410c02-3f4e-46e5-a748-8ddca11e16e7 None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:24:15.729658 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf410c02-3f4e-46e5-a748-8ddca11e16e7 None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:24:15.734348 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd9dde3-0556-42f7-badd-364cf23a7479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:24:15.735155 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd9dde3-0556-42f7-badd-364cf23a7479 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:15.735436 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd9dde3-0556-42f7-badd-364cf23a7479 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:15.735733 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd9dde3-0556-42f7-badd-364cf23a7479 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:15.746137 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd9dde3-0556-42f7-badd-364cf23a7479 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 25 02:24:15.753478 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: WARNING keystone.server.flask.application [None req-bbd9dde3-0556-42f7-badd-364cf23a7479 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jan 25 02:24:15.754790 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 533/1078] 10.222.0.117 () {56 vars in 1146 bytes} [Tue Jan 25 02:24:15 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:24:15.760941 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591201c3-b3c7-468e-b2b2-4da32c9de67c None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:24:15.769854 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591201c3-b3c7-468e-b2b2-4da32c9de67c None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:24:15.774341 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ba84d4-3699-4acf-a811-90133878aa9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:24:15.775537 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ba84d4-3699-4acf-a811-90133878aa9b admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:15.775938 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ba84d4-3699-4acf-a811-90133878aa9b admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:15.776213 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ba84d4-3699-4acf-a811-90133878aa9b admin admin] PATH_INFO: `/v3/roles` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:15.776964 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ba84d4-3699-4acf-a811-90133878aa9b admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:24:15.777266 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ba84d4-3699-4acf-a811-90133878aa9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:24:15.778872 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ba84d4-3699-4acf-a811-90133878aa9b admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:24:15.786918 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 546/1079] 10.222.0.117 () {56 vars in 1141 bytes} [Tue Jan 25 02:24:15 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 340 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:24:15.793473 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd9dde3-0556-42f7-badd-364cf23a7479 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:24:15.922048 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd9dde3-0556-42f7-badd-364cf23a7479 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:24:15.926703 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abbff27-93a4-46f9-b01e-fb405e96ee69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:24:15.927462 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abbff27-93a4-46f9-b01e-fb405e96ee69 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:15.927763 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abbff27-93a4-46f9-b01e-fb405e96ee69 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:15.928035 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abbff27-93a4-46f9-b01e-fb405e96ee69 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:15.938823 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abbff27-93a4-46f9-b01e-fb405e96ee69 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:24:15.940675 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abbff27-93a4-46f9-b01e-fb405e96ee69 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:24:15.956573 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: WARNING keystone.server.flask.application [None req-6abbff27-93a4-46f9-b01e-fb405e96ee69 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 25 02:24:15.957939 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 534/1080] 10.222.0.117 () {56 vars in 1134 bytes} [Tue Jan 25 02:24:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:24:15.963913 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ba84d4-3699-4acf-a811-90133878aa9b admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:24:15.973867 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ba84d4-3699-4acf-a811-90133878aa9b admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:24:15.979148 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cedb96-c2a4-446d-b87d-3953d2144aa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:24:15.980026 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cedb96-c2a4-446d-b87d-3953d2144aa0 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:15.980399 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cedb96-c2a4-446d-b87d-3953d2144aa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:15.980745 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cedb96-c2a4-446d-b87d-3953d2144aa0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:15.981560 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cedb96-c2a4-446d-b87d-3953d2144aa0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:24:15.981931 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cedb96-c2a4-446d-b87d-3953d2144aa0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:24:15.983606 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cedb96-c2a4-446d-b87d-3953d2144aa0 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:24:15.996202 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 547/1081] 10.222.0.117 () {56 vars in 1135 bytes} [Tue Jan 25 02:24:15 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:24:16.002353 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abbff27-93a4-46f9-b01e-fb405e96ee69 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:24:16.012856 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abbff27-93a4-46f9-b01e-fb405e96ee69 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:24:16.017311 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1855269-8cec-477f-acc6-524eeccf6a5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:24:16.018078 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1855269-8cec-477f-acc6-524eeccf6a5c admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:16.018357 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1855269-8cec-477f-acc6-524eeccf6a5c admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:16.018625 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1855269-8cec-477f-acc6-524eeccf6a5c admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:16.026638 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1855269-8cec-477f-acc6-524eeccf6a5c admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:24:16.028685 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1855269-8cec-477f-acc6-524eeccf6a5c admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:24:16.042202 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: WARNING keystone.server.flask.application [None req-a1855269-8cec-477f-acc6-524eeccf6a5c admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jan 25 02:24:16.043373 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 535/1082] 10.222.0.117 () {56 vars in 1119 bytes} [Tue Jan 25 02:24:16 2022] GET /identity/v3/users/nova => generated 82 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:24:16.049043 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cedb96-c2a4-446d-b87d-3953d2144aa0 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:24:16.059354 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cedb96-c2a4-446d-b87d-3953d2144aa0 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:24:16.063756 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2271e9-e686-4c6a-88b8-7eb83268f93d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:24:16.064400 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2271e9-e686-4c6a-88b8-7eb83268f93d admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:16.064675 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2271e9-e686-4c6a-88b8-7eb83268f93d admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:16.064945 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2271e9-e686-4c6a-88b8-7eb83268f93d admin admin] PATH_INFO: `/v3/users` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:16.065776 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2271e9-e686-4c6a-88b8-7eb83268f93d admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:24:16.066078 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2271e9-e686-4c6a-88b8-7eb83268f93d admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:24:16.067936 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2271e9-e686-4c6a-88b8-7eb83268f93d admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:24:16.085580 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 548/1083] 10.222.0.117 () {56 vars in 1159 bytes} [Tue Jan 25 02:24:16 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 370 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 02:24:16.091453 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1855269-8cec-477f-acc6-524eeccf6a5c admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:24:16.101140 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1855269-8cec-477f-acc6-524eeccf6a5c admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:24:16.106407 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f4f522-5b67-4f72-88a7-ea4dc4a46c51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:24:16.107026 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f4f522-5b67-4f72-88a7-ea4dc4a46c51 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:16.107302 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f4f522-5b67-4f72-88a7-ea4dc4a46c51 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:16.107569 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f4f522-5b67-4f72-88a7-ea4dc4a46c51 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:16.115200 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f4f522-5b67-4f72-88a7-ea4dc4a46c51 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:24:16.116970 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f4f522-5b67-4f72-88a7-ea4dc4a46c51 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:24:16.126207 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 536/1084] 10.222.0.117 () {58 vars in 1329 bytes} [Tue Jan 25 02:24:16 2022] GET /identity/v3/auth/tokens => generated 2982 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:24:16.132035 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2271e9-e686-4c6a-88b8-7eb83268f93d admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:24:16.143148 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2271e9-e686-4c6a-88b8-7eb83268f93d admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:24:16.147843 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfc7091-caf4-4d1f-8fdf-e9281d17297e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:24:16.148659 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfc7091-caf4-4d1f-8fdf-e9281d17297e admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:16.148938 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfc7091-caf4-4d1f-8fdf-e9281d17297e admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:16.149210 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfc7091-caf4-4d1f-8fdf-e9281d17297e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:16.161301 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfc7091-caf4-4d1f-8fdf-e9281d17297e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:24:16.163147 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfc7091-caf4-4d1f-8fdf-e9281d17297e admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:24:16.180542 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: WARNING keystone.server.flask.application [None req-2dfc7091-caf4-4d1f-8fdf-e9281d17297e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 25 02:24:16.182503 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 549/1085] 10.222.0.117 () {56 vars in 1134 bytes} [Tue Jan 25 02:24:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:24:16.188408 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f4f522-5b67-4f72-88a7-ea4dc4a46c51 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:24:16.197687 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f4f522-5b67-4f72-88a7-ea4dc4a46c51 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:24:16.202323 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515aefd6-3978-4d00-bd27-fd7f2e8377ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:24:16.202965 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515aefd6-3978-4d00-bd27-fd7f2e8377ab admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:16.203248 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515aefd6-3978-4d00-bd27-fd7f2e8377ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:16.203522 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515aefd6-3978-4d00-bd27-fd7f2e8377ab admin admin] PATH_INFO: `/v3/domains` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:16.204294 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515aefd6-3978-4d00-bd27-fd7f2e8377ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:24:16.204608 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515aefd6-3978-4d00-bd27-fd7f2e8377ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:24:16.206190 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515aefd6-3978-4d00-bd27-fd7f2e8377ab admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:24:16.218696 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 537/1086] 10.222.0.117 () {56 vars in 1135 bytes} [Tue Jan 25 02:24:16 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:24:16.224474 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfc7091-caf4-4d1f-8fdf-e9281d17297e admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:24:16.234712 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfc7091-caf4-4d1f-8fdf-e9281d17297e admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:24:16.239236 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64652f5-0e14-4393-99d5-d14be3c8fc1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:24:16.240036 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64652f5-0e14-4393-99d5-d14be3c8fc1b admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:16.240321 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64652f5-0e14-4393-99d5-d14be3c8fc1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:16.240593 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64652f5-0e14-4393-99d5-d14be3c8fc1b admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:16.248271 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64652f5-0e14-4393-99d5-d14be3c8fc1b admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:24:16.250236 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64652f5-0e14-4393-99d5-d14be3c8fc1b admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:24:16.263876 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: WARNING keystone.server.flask.application [None req-f64652f5-0e14-4393-99d5-d14be3c8fc1b admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 25 02:24:16.265034 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 550/1087] 10.222.0.117 () {56 vars in 1137 bytes} [Tue Jan 25 02:24:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 25 02:24:16.270754 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515aefd6-3978-4d00-bd27-fd7f2e8377ab admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:24:16.281129 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515aefd6-3978-4d00-bd27-fd7f2e8377ab admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:24:16.285557 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4184cf2c-8d34-4662-baec-277183ddbfa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:24:16.286187 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4184cf2c-8d34-4662-baec-277183ddbfa5 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:16.286462 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4184cf2c-8d34-4662-baec-277183ddbfa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:16.286729 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4184cf2c-8d34-4662-baec-277183ddbfa5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:16.287543 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4184cf2c-8d34-4662-baec-277183ddbfa5 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:24:16.287874 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4184cf2c-8d34-4662-baec-277183ddbfa5 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:24:16.289694 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4184cf2c-8d34-4662-baec-277183ddbfa5 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:24:16.301218 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 538/1088] 10.222.0.117 () {56 vars in 1174 bytes} [Tue Jan 25 02:24:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:24:16.307366 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64652f5-0e14-4393-99d5-d14be3c8fc1b admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:24:16.317660 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64652f5-0e14-4393-99d5-d14be3c8fc1b admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:24:16.322905 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e37e94-16bd-4f20-8369-682d98c0bc5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:24:16.323528 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e37e94-16bd-4f20-8369-682d98c0bc5d admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:16.323843 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e37e94-16bd-4f20-8369-682d98c0bc5d admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:16.324116 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e37e94-16bd-4f20-8369-682d98c0bc5d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:16.324953 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e37e94-16bd-4f20-8369-682d98c0bc5d admin admin] RBAC: Adding query filter params (role.id=06cf9f8251c94c588ee2dafb34cab2a8, scope.project.id=61a6fe9d4c914755bb0a64c392bd16aa, user.id=d9ad6269900346458050063c12cac299) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:24:16.325260 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e37e94-16bd-4f20-8369-682d98c0bc5d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:24:16.327179 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e37e94-16bd-4f20-8369-682d98c0bc5d admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:24:16.332984 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 551/1089] 10.222.0.117 () {56 vars in 1400 bytes} [Tue Jan 25 02:24:16 2022] GET /identity/v3/role_assignments?user.id=d9ad6269900346458050063c12cac299&scope.project.id=61a6fe9d4c914755bb0a64c392bd16aa&role.id=06cf9f8251c94c588ee2dafb34cab2a8 => generated 610 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:24:16.384501 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c504ef3e-648a-4085-93e8-b554d0853db4 None None] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:16.384793 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c504ef3e-648a-4085-93e8-b554d0853db4 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:16.385075 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c504ef3e-648a-4085-93e8-b554d0853db4 None None] PATH_INFO: `/` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:16.387175 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 539/1090] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:24:16 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:24:16.392862 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9233499-f65a-4a39-9ab3-3272be9efa04 None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:16.393150 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9233499-f65a-4a39-9ab3-3272be9efa04 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:16.393428 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9233499-f65a-4a39-9ab3-3272be9efa04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:16.411599 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-e9233499-f65a-4a39-9ab3-3272be9efa04 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:24:16.412852 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-e9233499-f65a-4a39-9ab3-3272be9efa04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:24:16.421482 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 552/1091] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:24:16 2022] POST /identity/v3/auth/tokens => generated 2982 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:24:16.445765 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c504ef3e-648a-4085-93e8-b554d0853db4 None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:24:16.459214 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c504ef3e-648a-4085-93e8-b554d0853db4 None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:24:16.464507 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a69b2ab-12a1-4c7c-ace8-fa15517df7f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:24:16.465309 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a69b2ab-12a1-4c7c-ace8-fa15517df7f8 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:16.465595 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a69b2ab-12a1-4c7c-ace8-fa15517df7f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:16.465868 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a69b2ab-12a1-4c7c-ace8-fa15517df7f8 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:16.477744 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a69b2ab-12a1-4c7c-ace8-fa15517df7f8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 25 02:24:16.485683 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: WARNING keystone.server.flask.application [None req-8a69b2ab-12a1-4c7c-ace8-fa15517df7f8 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 25 02:24:16.487155 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 540/1092] 10.222.0.117 () {56 vars in 1122 bytes} [Tue Jan 25 02:24:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:24:16.492919 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9233499-f65a-4a39-9ab3-3272be9efa04 None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:24:16.504446 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9233499-f65a-4a39-9ab3-3272be9efa04 None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:24:16.509085 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f394733f-c93a-43c0-856e-850b627f2795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:24:16.510350 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f394733f-c93a-43c0-856e-850b627f2795 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:16.510634 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f394733f-c93a-43c0-856e-850b627f2795 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:16.510907 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f394733f-c93a-43c0-856e-850b627f2795 admin admin] PATH_INFO: `/v3/roles` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:16.511673 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f394733f-c93a-43c0-856e-850b627f2795 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:24:16.512005 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f394733f-c93a-43c0-856e-850b627f2795 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:24:16.513637 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f394733f-c93a-43c0-856e-850b627f2795 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:24:16.522388 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 553/1093] 10.222.0.117 () {56 vars in 1125 bytes} [Tue Jan 25 02:24:16 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:24:16.529150 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a69b2ab-12a1-4c7c-ace8-fa15517df7f8 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:24:16.539110 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a69b2ab-12a1-4c7c-ace8-fa15517df7f8 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:24:16.545237 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5860046-5435-4549-92ea-4cd6bf2cf791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:24:16.545237 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5860046-5435-4549-92ea-4cd6bf2cf791 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:16.545541 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5860046-5435-4549-92ea-4cd6bf2cf791 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:16.545817 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5860046-5435-4549-92ea-4cd6bf2cf791 admin admin] PATH_INFO: `/v3/users/9278e7591c464326b9f87d4c0da4f261` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:16.547033 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5860046-5435-4549-92ea-4cd6bf2cf791 admin admin] RBAC: Authorizing `identity:get_user(user_id=9278e7591c464326b9f87d4c0da4f261)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:24:16.549264 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5860046-5435-4549-92ea-4cd6bf2cf791 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:24:16.550887 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 541/1094] 10.222.0.117 () {56 vars in 1203 bytes} [Tue Jan 25 02:24:16 2022] GET /identity/v3/users/9278e7591c464326b9f87d4c0da4f261 => generated 286 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:24:16.556763 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f394733f-c93a-43c0-856e-850b627f2795 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:24:16.566762 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f394733f-c93a-43c0-856e-850b627f2795 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:24:16.571311 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b07bfb-aefa-476c-9fee-8552031f1bc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:24:16.572417 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b07bfb-aefa-476c-9fee-8552031f1bc0 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:16.572702 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b07bfb-aefa-476c-9fee-8552031f1bc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:16.572983 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b07bfb-aefa-476c-9fee-8552031f1bc0 admin admin] PATH_INFO: `/v3/projects/f8d7f6b3ce20422186e598702c457539` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:16.574191 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b07bfb-aefa-476c-9fee-8552031f1bc0 admin admin] RBAC: Authorizing `identity:get_project(project_id=f8d7f6b3ce20422186e598702c457539)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:24:16.576287 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b07bfb-aefa-476c-9fee-8552031f1bc0 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:24:16.577949 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 554/1095] 10.222.0.117 () {56 vars in 1212 bytes} [Tue Jan 25 02:24:16 2022] GET /identity/v3/projects/f8d7f6b3ce20422186e598702c457539 => generated 312 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:24:16.583892 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5860046-5435-4549-92ea-4cd6bf2cf791 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:24:16.595734 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5860046-5435-4549-92ea-4cd6bf2cf791 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:24:16.602808 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de000c7-21a1-4d4e-a7ff-d22a3acfb98e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:24:16.604327 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de000c7-21a1-4d4e-a7ff-d22a3acfb98e admin admin] REQUEST_METHOD: `PUT` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:16.604596 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de000c7-21a1-4d4e-a7ff-d22a3acfb98e admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:16.604873 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de000c7-21a1-4d4e-a7ff-d22a3acfb98e admin admin] PATH_INFO: `/v3/projects/f8d7f6b3ce20422186e598702c457539/users/9278e7591c464326b9f87d4c0da4f261/roles/d8dbc6d83d9d41d28c3feb8b3485b291` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:16.607469 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de000c7-21a1-4d4e-a7ff-d22a3acfb98e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8d7f6b3ce20422186e598702c457539, user_id=9278e7591c464326b9f87d4c0da4f261, role_id=d8dbc6d83d9d41d28c3feb8b3485b291)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:24:16.610155 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de000c7-21a1-4d4e-a7ff-d22a3acfb98e admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:24:16.623840 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 542/1096] 10.222.0.117 () {58 vars in 1465 bytes} [Tue Jan 25 02:24:16 2022] PUT /identity/v3/projects/f8d7f6b3ce20422186e598702c457539/users/9278e7591c464326b9f87d4c0da4f261/roles/d8dbc6d83d9d41d28c3feb8b3485b291 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:24:18.829379 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b01563-043a-4acb-ac98-fe7d6e11c2bb None None] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:18.829940 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b01563-043a-4acb-ac98-fe7d6e11c2bb None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:18.829940 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b01563-043a-4acb-ac98-fe7d6e11c2bb None None] PATH_INFO: `/` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:18.831712 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 555/1097] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:24:18 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:24:18.836940 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969f47f7-1ac1-42ad-a895-dae924ca538a None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:18.837873 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969f47f7-1ac1-42ad-a895-dae924ca538a None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:18.838031 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969f47f7-1ac1-42ad-a895-dae924ca538a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:18.858243 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-969f47f7-1ac1-42ad-a895-dae924ca538a None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:24:18.859450 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-969f47f7-1ac1-42ad-a895-dae924ca538a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:24:18.915223 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 543/1098] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:24:18 2022] POST /identity/v3/auth/tokens => generated 2982 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 25 02:24:18.940553 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b01563-043a-4acb-ac98-fe7d6e11c2bb None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:24:18.953084 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b01563-043a-4acb-ac98-fe7d6e11c2bb None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:24:18.957440 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6077937e-1a69-40e7-8b74-285db3b032bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:24:18.958207 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6077937e-1a69-40e7-8b74-285db3b032bb admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:18.958489 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6077937e-1a69-40e7-8b74-285db3b032bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:18.958762 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6077937e-1a69-40e7-8b74-285db3b032bb admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:18.969239 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6077937e-1a69-40e7-8b74-285db3b032bb admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 25 02:24:18.976247 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: WARNING keystone.server.flask.application [None req-6077937e-1a69-40e7-8b74-285db3b032bb admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 25 02:24:18.977370 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 556/1099] 10.222.0.117 () {56 vars in 1122 bytes} [Tue Jan 25 02:24:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 25 02:24:18.983220 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969f47f7-1ac1-42ad-a895-dae924ca538a None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:24:18.991956 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969f47f7-1ac1-42ad-a895-dae924ca538a None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:24:18.997220 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5f34e1-cf3c-420e-a810-cc4aa177427d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:24:18.997862 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5f34e1-cf3c-420e-a810-cc4aa177427d admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:18.998149 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5f34e1-cf3c-420e-a810-cc4aa177427d admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:18.998424 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5f34e1-cf3c-420e-a810-cc4aa177427d admin admin] PATH_INFO: `/v3/roles` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:18.999181 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5f34e1-cf3c-420e-a810-cc4aa177427d admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:24:18.999488 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5f34e1-cf3c-420e-a810-cc4aa177427d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:24:19.001109 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5f34e1-cf3c-420e-a810-cc4aa177427d admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:24:19.009071 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 544/1100] 10.222.0.117 () {56 vars in 1125 bytes} [Tue Jan 25 02:24:18 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:24:19.015057 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6077937e-1a69-40e7-8b74-285db3b032bb admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:24:19.024400 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6077937e-1a69-40e7-8b74-285db3b032bb admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:24:19.028876 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122bac28-3cd3-4df4-a3b3-3d9e0e140072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:24:19.029732 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122bac28-3cd3-4df4-a3b3-3d9e0e140072 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:19.030015 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122bac28-3cd3-4df4-a3b3-3d9e0e140072 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:19.030290 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122bac28-3cd3-4df4-a3b3-3d9e0e140072 admin admin] PATH_INFO: `/v3/users/9278e7591c464326b9f87d4c0da4f261` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:19.031483 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122bac28-3cd3-4df4-a3b3-3d9e0e140072 admin admin] RBAC: Authorizing `identity:get_user(user_id=9278e7591c464326b9f87d4c0da4f261)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:24:19.033632 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122bac28-3cd3-4df4-a3b3-3d9e0e140072 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:24:19.035170 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 557/1101] 10.222.0.117 () {56 vars in 1203 bytes} [Tue Jan 25 02:24:19 2022] GET /identity/v3/users/9278e7591c464326b9f87d4c0da4f261 => generated 286 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:24:19.040479 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5f34e1-cf3c-420e-a810-cc4aa177427d admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:24:19.049856 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5f34e1-cf3c-420e-a810-cc4aa177427d admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:24:19.054329 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf7e991-c5e3-4afa-8e34-c74c045ac63c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:24:19.054942 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf7e991-c5e3-4afa-8e34-c74c045ac63c admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:19.055227 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf7e991-c5e3-4afa-8e34-c74c045ac63c admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:19.055505 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf7e991-c5e3-4afa-8e34-c74c045ac63c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:19.063968 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf7e991-c5e3-4afa-8e34-c74c045ac63c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:24:19.065712 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf7e991-c5e3-4afa-8e34-c74c045ac63c admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:24:19.075083 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 545/1102] 10.222.0.117 () {58 vars in 1329 bytes} [Tue Jan 25 02:24:19 2022] GET /identity/v3/auth/tokens => generated 2982 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:24:19.080628 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122bac28-3cd3-4df4-a3b3-3d9e0e140072 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:24:19.090623 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122bac28-3cd3-4df4-a3b3-3d9e0e140072 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:24:19.095388 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d48d9ea-f5ab-4868-8d6d-3f0c1595f5de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:24:19.096251 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d48d9ea-f5ab-4868-8d6d-3f0c1595f5de admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:19.096536 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d48d9ea-f5ab-4868-8d6d-3f0c1595f5de admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:19.096809 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d48d9ea-f5ab-4868-8d6d-3f0c1595f5de admin admin] PATH_INFO: `/v3/projects/f8d7f6b3ce20422186e598702c457539` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:19.097986 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d48d9ea-f5ab-4868-8d6d-3f0c1595f5de admin admin] RBAC: Authorizing `identity:get_project(project_id=f8d7f6b3ce20422186e598702c457539)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:24:19.100047 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d48d9ea-f5ab-4868-8d6d-3f0c1595f5de admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:24:19.101656 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 558/1103] 10.222.0.117 () {56 vars in 1212 bytes} [Tue Jan 25 02:24:19 2022] GET /identity/v3/projects/f8d7f6b3ce20422186e598702c457539 => generated 312 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:24:19.107644 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf7e991-c5e3-4afa-8e34-c74c045ac63c admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:24:19.116065 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf7e991-c5e3-4afa-8e34-c74c045ac63c admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:24:19.121453 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fda3dc-a936-4bea-b802-d26155a9334f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:24:19.122062 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fda3dc-a936-4bea-b802-d26155a9334f admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:19.122344 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fda3dc-a936-4bea-b802-d26155a9334f admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:19.122612 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fda3dc-a936-4bea-b802-d26155a9334f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:19.123422 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fda3dc-a936-4bea-b802-d26155a9334f admin admin] RBAC: Adding query filter params (role.id=d8dbc6d83d9d41d28c3feb8b3485b291, scope.project.id=f8d7f6b3ce20422186e598702c457539, user.id=9278e7591c464326b9f87d4c0da4f261) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:24:19.123748 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fda3dc-a936-4bea-b802-d26155a9334f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:24:19.125749 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fda3dc-a936-4bea-b802-d26155a9334f admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:24:19.132106 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 546/1104] 10.222.0.117 () {56 vars in 1400 bytes} [Tue Jan 25 02:24:19 2022] GET /identity/v3/role_assignments?user.id=9278e7591c464326b9f87d4c0da4f261&scope.project.id=f8d7f6b3ce20422186e598702c457539&role.id=d8dbc6d83d9d41d28c3feb8b3485b291 => generated 610 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:24:21.356236 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270601fe-cebc-4769-a830-3be4ab089155 None None] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:21.356813 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270601fe-cebc-4769-a830-3be4ab089155 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:21.356813 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270601fe-cebc-4769-a830-3be4ab089155 None None] PATH_INFO: `/` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:21.358557 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 559/1105] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:24:21 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:24:21.363889 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fb79b7-818d-4352-b79c-de2aeec4c8a5 None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:21.364277 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fb79b7-818d-4352-b79c-de2aeec4c8a5 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:21.364449 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fb79b7-818d-4352-b79c-de2aeec4c8a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:21.381888 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-99fb79b7-818d-4352-b79c-de2aeec4c8a5 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:24:21.383075 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-99fb79b7-818d-4352-b79c-de2aeec4c8a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:24:21.391225 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 547/1106] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:24:21 2022] POST /identity/v3/auth/tokens => generated 2982 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:24:21.416861 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270601fe-cebc-4769-a830-3be4ab089155 None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:24:21.428814 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270601fe-cebc-4769-a830-3be4ab089155 None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:24:21.433174 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad92537c-54c2-40a8-8876-36a2649d50d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:24:21.433939 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad92537c-54c2-40a8-8876-36a2649d50d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:21.434220 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad92537c-54c2-40a8-8876-36a2649d50d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:21.434496 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad92537c-54c2-40a8-8876-36a2649d50d0 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:21.435663 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad92537c-54c2-40a8-8876-36a2649d50d0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:24:21.437386 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad92537c-54c2-40a8-8876-36a2649d50d0 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:24:21.438931 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 560/1107] 10.222.0.117 () {56 vars in 1134 bytes} [Tue Jan 25 02:24:21 2022] GET /identity/v3/domains/default => generated 200 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:24:21.444209 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fb79b7-818d-4352-b79c-de2aeec4c8a5 None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:24:21.453829 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fb79b7-818d-4352-b79c-de2aeec4c8a5 None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:24:21.458350 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0308ef89-cb70-4d40-a691-adb9e166ef61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:24:21.459003 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0308ef89-cb70-4d40-a691-adb9e166ef61 admin admin] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:21.459288 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0308ef89-cb70-4d40-a691-adb9e166ef61 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:21.459561 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0308ef89-cb70-4d40-a691-adb9e166ef61 admin admin] PATH_INFO: `/v3/users` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:21.460335 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0308ef89-cb70-4d40-a691-adb9e166ef61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:24:21.462276 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0308ef89-cb70-4d40-a691-adb9e166ef61 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:24:21.481596 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 548/1108] 10.222.0.117 () {60 vars in 1158 bytes} [Tue Jan 25 02:24:21 2022] POST /identity/v3/users => generated 287 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 02:24:23.779078 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479661c7-83fe-4f44-960b-3e05bbde81e8 None None] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:23.779610 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479661c7-83fe-4f44-960b-3e05bbde81e8 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:23.779610 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479661c7-83fe-4f44-960b-3e05bbde81e8 None None] PATH_INFO: `/` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:23.781417 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 561/1109] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:24:23 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:24:23.786703 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe1ff4e-f770-4952-a098-2569c8ad3d1f None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:23.787127 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe1ff4e-f770-4952-a098-2569c8ad3d1f None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:23.787236 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe1ff4e-f770-4952-a098-2569c8ad3d1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:23.805226 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-6fe1ff4e-f770-4952-a098-2569c8ad3d1f None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:24:23.807259 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-6fe1ff4e-f770-4952-a098-2569c8ad3d1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:24:23.814733 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 549/1110] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:24:23 2022] POST /identity/v3/auth/tokens => generated 2982 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 25 02:24:23.838861 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479661c7-83fe-4f44-960b-3e05bbde81e8 None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:24:23.851008 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479661c7-83fe-4f44-960b-3e05bbde81e8 None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:24:23.855878 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35d9e97-e32d-40b5-8eb5-ef1771fbe43b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:24:23.856702 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35d9e97-e32d-40b5-8eb5-ef1771fbe43b admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:23.856982 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35d9e97-e32d-40b5-8eb5-ef1771fbe43b admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:23.857257 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35d9e97-e32d-40b5-8eb5-ef1771fbe43b admin admin] PATH_INFO: `/v3/roles/259d005f63d5455d8728277d6385bfba` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:23.858714 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35d9e97-e32d-40b5-8eb5-ef1771fbe43b admin admin] RBAC: Authorizing `identity:get_role(role_id=259d005f63d5455d8728277d6385bfba)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:24:23.859781 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: WARNING py.warnings [None req-d35d9e97-e32d-40b5-8eb5-ef1771fbe43b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 25 02:24:23.859781 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: warnings.warn(msg) Jan 25 02:24:23.859781 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: Jan 25 02:24:23.860643 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35d9e97-e32d-40b5-8eb5-ef1771fbe43b admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:24:23.861925 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 562/1111] 10.222.0.117 () {56 vars in 1203 bytes} [Tue Jan 25 02:24:23 2022] GET /identity/v3/roles/259d005f63d5455d8728277d6385bfba => generated 224 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:24:23.867187 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe1ff4e-f770-4952-a098-2569c8ad3d1f None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:24:23.876697 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe1ff4e-f770-4952-a098-2569c8ad3d1f None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:24:23.881191 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac10810-7b9d-4d5d-8c11-c17f6d3bb127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:24:23.882038 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac10810-7b9d-4d5d-8c11-c17f6d3bb127 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:23.882322 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac10810-7b9d-4d5d-8c11-c17f6d3bb127 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:23.882597 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac10810-7b9d-4d5d-8c11-c17f6d3bb127 admin admin] PATH_INFO: `/v3/users/79600ce970b24d869f57cd9221a34369` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:23.895588 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac10810-7b9d-4d5d-8c11-c17f6d3bb127 admin admin] RBAC: Authorizing `identity:get_user(user_id=79600ce970b24d869f57cd9221a34369)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:24:23.897728 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac10810-7b9d-4d5d-8c11-c17f6d3bb127 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:24:23.899335 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 550/1112] 10.222.0.117 () {56 vars in 1203 bytes} [Tue Jan 25 02:24:23 2022] GET /identity/v3/users/79600ce970b24d869f57cd9221a34369 => generated 287 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:24:23.905051 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35d9e97-e32d-40b5-8eb5-ef1771fbe43b admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:24:23.914415 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35d9e97-e32d-40b5-8eb5-ef1771fbe43b admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:24:23.919510 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b0a8dd-12bd-4bd3-8eba-c5e5d3c1f923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:24:23.920162 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b0a8dd-12bd-4bd3-8eba-c5e5d3c1f923 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:23.920445 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b0a8dd-12bd-4bd3-8eba-c5e5d3c1f923 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:23.920719 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b0a8dd-12bd-4bd3-8eba-c5e5d3c1f923 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:23.928332 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b0a8dd-12bd-4bd3-8eba-c5e5d3c1f923 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:24:23.930006 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b0a8dd-12bd-4bd3-8eba-c5e5d3c1f923 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:24:23.939267 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 563/1113] 10.222.0.117 () {58 vars in 1329 bytes} [Tue Jan 25 02:24:23 2022] GET /identity/v3/auth/tokens => generated 2982 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:24:23.944593 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac10810-7b9d-4d5d-8c11-c17f6d3bb127 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:24:23.953955 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac10810-7b9d-4d5d-8c11-c17f6d3bb127 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:24:23.958472 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7c65a1-f020-4f6b-848d-4f60d4be497d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:24:23.959297 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7c65a1-f020-4f6b-848d-4f60d4be497d admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:23.959580 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7c65a1-f020-4f6b-848d-4f60d4be497d admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:23.959889 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7c65a1-f020-4f6b-848d-4f60d4be497d admin admin] PATH_INFO: `/v3/projects/f8d7f6b3ce20422186e598702c457539` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:23.961069 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7c65a1-f020-4f6b-848d-4f60d4be497d admin admin] RBAC: Authorizing `identity:get_project(project_id=f8d7f6b3ce20422186e598702c457539)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:24:23.963754 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7c65a1-f020-4f6b-848d-4f60d4be497d admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:24:23.965373 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 551/1114] 10.222.0.117 () {56 vars in 1212 bytes} [Tue Jan 25 02:24:23 2022] GET /identity/v3/projects/f8d7f6b3ce20422186e598702c457539 => generated 312 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:24:23.971096 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b0a8dd-12bd-4bd3-8eba-c5e5d3c1f923 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:24:23.980335 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b0a8dd-12bd-4bd3-8eba-c5e5d3c1f923 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:24:23.984793 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a5ec95-3800-47a5-a9bd-009f97241f62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:24:23.985405 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a5ec95-3800-47a5-a9bd-009f97241f62 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:23.985686 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a5ec95-3800-47a5-a9bd-009f97241f62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:23.985960 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a5ec95-3800-47a5-a9bd-009f97241f62 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:23.986782 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a5ec95-3800-47a5-a9bd-009f97241f62 admin admin] RBAC: Adding query filter params (role.id=259d005f63d5455d8728277d6385bfba, scope.project.id=f8d7f6b3ce20422186e598702c457539, user.id=79600ce970b24d869f57cd9221a34369) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:24:23.987088 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a5ec95-3800-47a5-a9bd-009f97241f62 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:24:23.988979 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a5ec95-3800-47a5-a9bd-009f97241f62 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:24:23.994458 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 564/1115] 10.222.0.117 () {56 vars in 1400 bytes} [Tue Jan 25 02:24:23 2022] GET /identity/v3/role_assignments?user.id=79600ce970b24d869f57cd9221a34369&scope.project.id=f8d7f6b3ce20422186e598702c457539&role.id=259d005f63d5455d8728277d6385bfba => generated 260 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:24:26.158854 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992f78ff-953e-432b-9192-e74662350385 None None] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:26.159382 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992f78ff-953e-432b-9192-e74662350385 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:26.159493 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992f78ff-953e-432b-9192-e74662350385 None None] PATH_INFO: `/` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:26.161228 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 552/1116] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:24:26 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:24:26.166828 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b79c7a-c4f4-4a11-98ae-711b0872f1da None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:26.167219 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b79c7a-c4f4-4a11-98ae-711b0872f1da None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:26.167369 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b79c7a-c4f4-4a11-98ae-711b0872f1da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:26.185221 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-72b79c7a-c4f4-4a11-98ae-711b0872f1da None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:24:26.186405 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-72b79c7a-c4f4-4a11-98ae-711b0872f1da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:24:26.193945 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 565/1117] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:24:26 2022] POST /identity/v3/auth/tokens => generated 2982 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:24:26.217487 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992f78ff-953e-432b-9192-e74662350385 None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:24:26.230436 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992f78ff-953e-432b-9192-e74662350385 None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:24:26.234759 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8881a05-0d0f-46ec-983b-b09c0f1ab569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:24:26.235589 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8881a05-0d0f-46ec-983b-b09c0f1ab569 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:26.235907 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8881a05-0d0f-46ec-983b-b09c0f1ab569 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:26.236186 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8881a05-0d0f-46ec-983b-b09c0f1ab569 admin admin] PATH_INFO: `/v3/roles/259d005f63d5455d8728277d6385bfba` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:26.237663 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8881a05-0d0f-46ec-983b-b09c0f1ab569 admin admin] RBAC: Authorizing `identity:get_role(role_id=259d005f63d5455d8728277d6385bfba)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:24:26.238695 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: WARNING py.warnings [None req-e8881a05-0d0f-46ec-983b-b09c0f1ab569 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 25 02:24:26.238695 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: warnings.warn(msg) Jan 25 02:24:26.238695 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: Jan 25 02:24:26.239568 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8881a05-0d0f-46ec-983b-b09c0f1ab569 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:24:26.240913 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 553/1118] 10.222.0.117 () {56 vars in 1203 bytes} [Tue Jan 25 02:24:26 2022] GET /identity/v3/roles/259d005f63d5455d8728277d6385bfba => generated 224 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:24:26.246348 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b79c7a-c4f4-4a11-98ae-711b0872f1da None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:24:26.255083 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b79c7a-c4f4-4a11-98ae-711b0872f1da None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:24:26.259657 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a71f91-e99a-4370-a394-ba113eef1ad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:24:26.260521 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a71f91-e99a-4370-a394-ba113eef1ad9 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:26.260804 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a71f91-e99a-4370-a394-ba113eef1ad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:26.261074 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a71f91-e99a-4370-a394-ba113eef1ad9 admin admin] PATH_INFO: `/v3/users/79600ce970b24d869f57cd9221a34369` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:26.262271 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a71f91-e99a-4370-a394-ba113eef1ad9 admin admin] RBAC: Authorizing `identity:get_user(user_id=79600ce970b24d869f57cd9221a34369)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:24:26.264428 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a71f91-e99a-4370-a394-ba113eef1ad9 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:24:26.265968 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 566/1119] 10.222.0.117 () {56 vars in 1203 bytes} [Tue Jan 25 02:24:26 2022] GET /identity/v3/users/79600ce970b24d869f57cd9221a34369 => generated 287 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:24:26.271176 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8881a05-0d0f-46ec-983b-b09c0f1ab569 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:24:26.281181 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8881a05-0d0f-46ec-983b-b09c0f1ab569 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:24:26.285582 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47d6578-fa3c-47b8-a499-b45aa6aefbb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:24:26.286393 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47d6578-fa3c-47b8-a499-b45aa6aefbb8 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:26.286675 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47d6578-fa3c-47b8-a499-b45aa6aefbb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:26.286950 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47d6578-fa3c-47b8-a499-b45aa6aefbb8 admin admin] PATH_INFO: `/v3/projects/f8d7f6b3ce20422186e598702c457539` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:26.288140 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47d6578-fa3c-47b8-a499-b45aa6aefbb8 admin admin] RBAC: Authorizing `identity:get_project(project_id=f8d7f6b3ce20422186e598702c457539)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:24:26.290139 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47d6578-fa3c-47b8-a499-b45aa6aefbb8 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:24:26.292613 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 554/1120] 10.222.0.117 () {56 vars in 1212 bytes} [Tue Jan 25 02:24:26 2022] GET /identity/v3/projects/f8d7f6b3ce20422186e598702c457539 => generated 312 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:24:26.298040 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a71f91-e99a-4370-a394-ba113eef1ad9 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:24:26.307495 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a71f91-e99a-4370-a394-ba113eef1ad9 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:24:26.312011 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20832000-d517-4edc-bd07-e5d42fead22f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:24:26.312850 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20832000-d517-4edc-bd07-e5d42fead22f admin admin] REQUEST_METHOD: `PUT` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:26.313160 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20832000-d517-4edc-bd07-e5d42fead22f admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:26.313436 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20832000-d517-4edc-bd07-e5d42fead22f admin admin] PATH_INFO: `/v3/projects/f8d7f6b3ce20422186e598702c457539/users/79600ce970b24d869f57cd9221a34369/roles/259d005f63d5455d8728277d6385bfba` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:26.315627 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20832000-d517-4edc-bd07-e5d42fead22f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8d7f6b3ce20422186e598702c457539, user_id=79600ce970b24d869f57cd9221a34369, role_id=259d005f63d5455d8728277d6385bfba)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:24:26.318251 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20832000-d517-4edc-bd07-e5d42fead22f admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:24:26.330695 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 567/1121] 10.222.0.117 () {58 vars in 1465 bytes} [Tue Jan 25 02:24:26 2022] PUT /identity/v3/projects/f8d7f6b3ce20422186e598702c457539/users/79600ce970b24d869f57cd9221a34369/roles/259d005f63d5455d8728277d6385bfba => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:24:28.495159 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e891fdb9-8f0c-43e6-a477-4994629b25bf None None] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:28.495744 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e891fdb9-8f0c-43e6-a477-4994629b25bf None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:28.495744 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e891fdb9-8f0c-43e6-a477-4994629b25bf None None] PATH_INFO: `/` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:28.497490 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 555/1122] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:24:28 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:24:28.502677 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee803e5-cea6-4658-bfbc-3b3807a1ed39 None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:28.503068 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee803e5-cea6-4658-bfbc-3b3807a1ed39 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:28.503234 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee803e5-cea6-4658-bfbc-3b3807a1ed39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:28.521229 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-3ee803e5-cea6-4658-bfbc-3b3807a1ed39 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:24:28.522409 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-3ee803e5-cea6-4658-bfbc-3b3807a1ed39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:24:28.577249 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 568/1123] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:24:28 2022] POST /identity/v3/auth/tokens => generated 2982 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:24:28.602483 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e891fdb9-8f0c-43e6-a477-4994629b25bf None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:24:28.615462 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e891fdb9-8f0c-43e6-a477-4994629b25bf None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:24:28.620050 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895961ec-da8f-43ca-ae0c-77e4f4233508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:24:28.620888 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895961ec-da8f-43ca-ae0c-77e4f4233508 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:28.621169 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895961ec-da8f-43ca-ae0c-77e4f4233508 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:28.621446 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895961ec-da8f-43ca-ae0c-77e4f4233508 admin admin] PATH_INFO: `/v3/roles/259d005f63d5455d8728277d6385bfba` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:28.622918 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895961ec-da8f-43ca-ae0c-77e4f4233508 admin admin] RBAC: Authorizing `identity:get_role(role_id=259d005f63d5455d8728277d6385bfba)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:24:28.624539 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895961ec-da8f-43ca-ae0c-77e4f4233508 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:24:28.625874 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 556/1124] 10.222.0.117 () {56 vars in 1203 bytes} [Tue Jan 25 02:24:28 2022] GET /identity/v3/roles/259d005f63d5455d8728277d6385bfba => generated 224 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:24:28.631832 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee803e5-cea6-4658-bfbc-3b3807a1ed39 None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:24:28.641012 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee803e5-cea6-4658-bfbc-3b3807a1ed39 None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:24:28.645544 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d1a8f6-6491-4425-835f-a7d6717d6e33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:24:28.646391 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d1a8f6-6491-4425-835f-a7d6717d6e33 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:28.646674 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d1a8f6-6491-4425-835f-a7d6717d6e33 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:28.646947 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d1a8f6-6491-4425-835f-a7d6717d6e33 admin admin] PATH_INFO: `/v3/users/79600ce970b24d869f57cd9221a34369` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:28.648188 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d1a8f6-6491-4425-835f-a7d6717d6e33 admin admin] RBAC: Authorizing `identity:get_user(user_id=79600ce970b24d869f57cd9221a34369)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:24:28.650846 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d1a8f6-6491-4425-835f-a7d6717d6e33 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:24:28.652427 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 569/1125] 10.222.0.117 () {56 vars in 1203 bytes} [Tue Jan 25 02:24:28 2022] GET /identity/v3/users/79600ce970b24d869f57cd9221a34369 => generated 287 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:24:28.657603 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895961ec-da8f-43ca-ae0c-77e4f4233508 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:24:28.667770 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895961ec-da8f-43ca-ae0c-77e4f4233508 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:24:28.672250 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a3fdee-6f36-44fa-b674-8993c962df23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:24:28.672871 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a3fdee-6f36-44fa-b674-8993c962df23 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:28.673155 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a3fdee-6f36-44fa-b674-8993c962df23 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:28.673433 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a3fdee-6f36-44fa-b674-8993c962df23 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:28.681286 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a3fdee-6f36-44fa-b674-8993c962df23 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:24:28.682981 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a3fdee-6f36-44fa-b674-8993c962df23 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:24:28.691497 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 557/1126] 10.222.0.117 () {58 vars in 1329 bytes} [Tue Jan 25 02:24:28 2022] GET /identity/v3/auth/tokens => generated 2982 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:24:28.697283 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d1a8f6-6491-4425-835f-a7d6717d6e33 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:24:28.706677 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d1a8f6-6491-4425-835f-a7d6717d6e33 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:24:28.711110 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d366d959-7e40-443d-b256-307544532544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:24:28.711973 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d366d959-7e40-443d-b256-307544532544 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:28.713006 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d366d959-7e40-443d-b256-307544532544 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:28.713159 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d366d959-7e40-443d-b256-307544532544 admin admin] PATH_INFO: `/v3/projects/f8d7f6b3ce20422186e598702c457539` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:28.714337 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d366d959-7e40-443d-b256-307544532544 admin admin] RBAC: Authorizing `identity:get_project(project_id=f8d7f6b3ce20422186e598702c457539)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:24:28.716395 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d366d959-7e40-443d-b256-307544532544 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:24:28.718007 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 570/1127] 10.222.0.117 () {56 vars in 1212 bytes} [Tue Jan 25 02:24:28 2022] GET /identity/v3/projects/f8d7f6b3ce20422186e598702c457539 => generated 312 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:24:28.723858 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a3fdee-6f36-44fa-b674-8993c962df23 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:24:28.733198 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a3fdee-6f36-44fa-b674-8993c962df23 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:24:28.737664 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a338a16-0767-41ef-b8a3-76065df28743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:24:28.738302 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a338a16-0767-41ef-b8a3-76065df28743 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:28.738580 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a338a16-0767-41ef-b8a3-76065df28743 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:28.738850 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a338a16-0767-41ef-b8a3-76065df28743 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:28.739717 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a338a16-0767-41ef-b8a3-76065df28743 admin admin] RBAC: Adding query filter params (role.id=259d005f63d5455d8728277d6385bfba, scope.project.id=f8d7f6b3ce20422186e598702c457539, user.id=79600ce970b24d869f57cd9221a34369) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:24:28.740026 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a338a16-0767-41ef-b8a3-76065df28743 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:24:28.741819 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a338a16-0767-41ef-b8a3-76065df28743 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:24:28.748315 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 558/1128] 10.222.0.117 () {56 vars in 1400 bytes} [Tue Jan 25 02:24:28 2022] GET /identity/v3/role_assignments?user.id=79600ce970b24d869f57cd9221a34369&scope.project.id=f8d7f6b3ce20422186e598702c457539&role.id=259d005f63d5455d8728277d6385bfba => generated 610 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 02:24:31.035928 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b1e4b5-7388-493f-a937-74e9f83eaef2 None None] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:31.036446 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b1e4b5-7388-493f-a937-74e9f83eaef2 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:31.036537 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b1e4b5-7388-493f-a937-74e9f83eaef2 None None] PATH_INFO: `/` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:31.038249 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 571/1129] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:24:31 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:24:31.043843 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e8dedc-2174-409a-ac4a-d058d8a1b72c None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:31.044248 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e8dedc-2174-409a-ac4a-d058d8a1b72c None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:31.044405 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e8dedc-2174-409a-ac4a-d058d8a1b72c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:31.062359 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-84e8dedc-2174-409a-ac4a-d058d8a1b72c None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:24:31.063552 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-84e8dedc-2174-409a-ac4a-d058d8a1b72c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:24:31.071210 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 559/1130] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:24:31 2022] POST /identity/v3/auth/tokens => generated 2982 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:24:31.096849 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b1e4b5-7388-493f-a937-74e9f83eaef2 None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:24:31.109512 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b1e4b5-7388-493f-a937-74e9f83eaef2 None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:24:31.113878 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c9bc78-7d1f-48f9-b8ff-d9ba7187a32f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:24:31.114644 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c9bc78-7d1f-48f9-b8ff-d9ba7187a32f admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:31.114924 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c9bc78-7d1f-48f9-b8ff-d9ba7187a32f admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:31.115193 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c9bc78-7d1f-48f9-b8ff-d9ba7187a32f admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:31.116384 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c9bc78-7d1f-48f9-b8ff-d9ba7187a32f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:24:31.118057 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c9bc78-7d1f-48f9-b8ff-d9ba7187a32f admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:24:31.121080 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 572/1131] 10.222.0.117 () {56 vars in 1134 bytes} [Tue Jan 25 02:24:31 2022] GET /identity/v3/domains/default => generated 200 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:24:31.126330 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e8dedc-2174-409a-ac4a-d058d8a1b72c None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:24:31.136007 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e8dedc-2174-409a-ac4a-d058d8a1b72c None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:24:31.140666 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf3a974-84df-4fe1-a23a-02329ac11b32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:24:31.141315 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf3a974-84df-4fe1-a23a-02329ac11b32 admin admin] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:31.141603 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf3a974-84df-4fe1-a23a-02329ac11b32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:31.141882 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf3a974-84df-4fe1-a23a-02329ac11b32 admin admin] PATH_INFO: `/v3/projects` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:31.142621 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf3a974-84df-4fe1-a23a-02329ac11b32 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:24:31.144565 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf3a974-84df-4fe1-a23a-02329ac11b32 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:24:31.170449 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 560/1132] 10.222.0.117 () {60 vars in 1167 bytes} [Tue Jan 25 02:24:31 2022] POST /identity/v3/projects => generated 312 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 02:24:33.421056 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9047435-5aba-4250-a73d-143b725cfe36 None None] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:33.421613 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9047435-5aba-4250-a73d-143b725cfe36 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:33.421730 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9047435-5aba-4250-a73d-143b725cfe36 None None] PATH_INFO: `/` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:33.423513 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 573/1133] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:24:33 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:24:33.428919 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f1678a-5d01-4e7b-9bcd-bece307b2d77 None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:33.429343 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f1678a-5d01-4e7b-9bcd-bece307b2d77 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:33.429456 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f1678a-5d01-4e7b-9bcd-bece307b2d77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:33.447633 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-71f1678a-5d01-4e7b-9bcd-bece307b2d77 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:24:33.448825 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-71f1678a-5d01-4e7b-9bcd-bece307b2d77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:24:33.504830 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 561/1134] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:24:33 2022] POST /identity/v3/auth/tokens => generated 2982 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:24:33.531419 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9047435-5aba-4250-a73d-143b725cfe36 None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:24:33.543351 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9047435-5aba-4250-a73d-143b725cfe36 None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:24:33.547610 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0fcd40-58ec-43ec-95c6-33b0375da008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:24:33.548400 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0fcd40-58ec-43ec-95c6-33b0375da008 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:33.548679 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0fcd40-58ec-43ec-95c6-33b0375da008 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:33.548948 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0fcd40-58ec-43ec-95c6-33b0375da008 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:33.550125 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0fcd40-58ec-43ec-95c6-33b0375da008 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:24:33.551832 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0fcd40-58ec-43ec-95c6-33b0375da008 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:24:33.553359 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 574/1135] 10.222.0.117 () {56 vars in 1134 bytes} [Tue Jan 25 02:24:33 2022] GET /identity/v3/domains/default => generated 200 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:24:33.558829 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f1678a-5d01-4e7b-9bcd-bece307b2d77 None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:24:33.567552 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f1678a-5d01-4e7b-9bcd-bece307b2d77 None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:24:33.572688 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e868a2f3-5071-4dd5-aadc-9700032db66a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:24:33.573329 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e868a2f3-5071-4dd5-aadc-9700032db66a admin admin] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:33.573613 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e868a2f3-5071-4dd5-aadc-9700032db66a admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:33.573892 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e868a2f3-5071-4dd5-aadc-9700032db66a admin admin] PATH_INFO: `/v3/users` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:33.574614 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e868a2f3-5071-4dd5-aadc-9700032db66a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:24:33.576561 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e868a2f3-5071-4dd5-aadc-9700032db66a admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:24:33.597417 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 562/1136] 10.222.0.117 () {60 vars in 1158 bytes} [Tue Jan 25 02:24:33 2022] POST /identity/v3/users => generated 287 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 02:24:35.942463 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630fe0b6-f854-41cc-bc07-0a133d660f98 None None] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:35.942988 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630fe0b6-f854-41cc-bc07-0a133d660f98 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:35.942988 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630fe0b6-f854-41cc-bc07-0a133d660f98 None None] PATH_INFO: `/` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:35.944721 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 575/1137] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:24:35 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:24:35.950638 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e16e49e-410e-4bcb-9d02-e34a134b4ae7 None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:35.951029 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e16e49e-410e-4bcb-9d02-e34a134b4ae7 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:35.951204 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e16e49e-410e-4bcb-9d02-e34a134b4ae7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:35.973980 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-2e16e49e-410e-4bcb-9d02-e34a134b4ae7 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:24:35.975184 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-2e16e49e-410e-4bcb-9d02-e34a134b4ae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:24:35.982876 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 563/1138] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:24:35 2022] POST /identity/v3/auth/tokens => generated 2982 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:24:36.007156 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630fe0b6-f854-41cc-bc07-0a133d660f98 None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:24:36.019810 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630fe0b6-f854-41cc-bc07-0a133d660f98 None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:24:36.024121 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0b6e65-cea2-4455-848f-c8791ed0a305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:24:36.025430 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0b6e65-cea2-4455-848f-c8791ed0a305 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:36.025707 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0b6e65-cea2-4455-848f-c8791ed0a305 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:36.025980 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0b6e65-cea2-4455-848f-c8791ed0a305 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:36.035880 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0b6e65-cea2-4455-848f-c8791ed0a305 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 25 02:24:36.043119 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: WARNING keystone.server.flask.application [None req-db0b6e65-cea2-4455-848f-c8791ed0a305 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 25 02:24:36.044269 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 576/1139] 10.222.0.117 () {56 vars in 1122 bytes} [Tue Jan 25 02:24:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:24:36.050101 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e16e49e-410e-4bcb-9d02-e34a134b4ae7 None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:24:36.058878 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e16e49e-410e-4bcb-9d02-e34a134b4ae7 None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:24:36.063347 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe2abcf-1c0a-4dec-be50-776079372090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:24:36.064033 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe2abcf-1c0a-4dec-be50-776079372090 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:36.064318 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe2abcf-1c0a-4dec-be50-776079372090 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:36.064594 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe2abcf-1c0a-4dec-be50-776079372090 admin admin] PATH_INFO: `/v3/roles` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:36.065356 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe2abcf-1c0a-4dec-be50-776079372090 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:24:36.065664 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe2abcf-1c0a-4dec-be50-776079372090 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:24:36.067255 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe2abcf-1c0a-4dec-be50-776079372090 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:24:36.075443 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 564/1140] 10.222.0.117 () {56 vars in 1125 bytes} [Tue Jan 25 02:24:36 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:24:36.080762 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0b6e65-cea2-4455-848f-c8791ed0a305 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:24:36.092142 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0b6e65-cea2-4455-848f-c8791ed0a305 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:24:36.096815 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc035f39-071b-4da0-bdb6-6757adaba426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:24:36.097633 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc035f39-071b-4da0-bdb6-6757adaba426 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:36.097939 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc035f39-071b-4da0-bdb6-6757adaba426 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:36.098211 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc035f39-071b-4da0-bdb6-6757adaba426 admin admin] PATH_INFO: `/v3/users/48ef237f30d14054b1015f9a78de88ba` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:36.111266 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc035f39-071b-4da0-bdb6-6757adaba426 admin admin] RBAC: Authorizing `identity:get_user(user_id=48ef237f30d14054b1015f9a78de88ba)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:24:36.113414 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc035f39-071b-4da0-bdb6-6757adaba426 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:24:36.114981 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 577/1141] 10.222.0.117 () {56 vars in 1203 bytes} [Tue Jan 25 02:24:36 2022] GET /identity/v3/users/48ef237f30d14054b1015f9a78de88ba => generated 287 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:24:36.120599 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe2abcf-1c0a-4dec-be50-776079372090 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:24:36.129887 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe2abcf-1c0a-4dec-be50-776079372090 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:24:36.134547 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83066c61-2e9f-4035-ad35-a3adb4c595e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:24:36.135157 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83066c61-2e9f-4035-ad35-a3adb4c595e7 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:36.135439 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83066c61-2e9f-4035-ad35-a3adb4c595e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:36.135738 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83066c61-2e9f-4035-ad35-a3adb4c595e7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:36.143218 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83066c61-2e9f-4035-ad35-a3adb4c595e7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:24:36.144987 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83066c61-2e9f-4035-ad35-a3adb4c595e7 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:24:36.154333 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 565/1142] 10.222.0.117 () {58 vars in 1329 bytes} [Tue Jan 25 02:24:36 2022] GET /identity/v3/auth/tokens => generated 2982 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:24:36.159776 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc035f39-071b-4da0-bdb6-6757adaba426 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:24:36.169639 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc035f39-071b-4da0-bdb6-6757adaba426 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:24:36.174011 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00087be5-08cb-4533-ada7-4123ad56f232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:24:36.174816 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00087be5-08cb-4533-ada7-4123ad56f232 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:36.175096 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00087be5-08cb-4533-ada7-4123ad56f232 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:36.175367 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00087be5-08cb-4533-ada7-4123ad56f232 admin admin] PATH_INFO: `/v3/projects/f5262ec94a2045dfa66a5b5cd8094e1d` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:36.176550 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00087be5-08cb-4533-ada7-4123ad56f232 admin admin] RBAC: Authorizing `identity:get_project(project_id=f5262ec94a2045dfa66a5b5cd8094e1d)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:24:36.178549 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00087be5-08cb-4533-ada7-4123ad56f232 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:24:36.180165 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 578/1143] 10.222.0.117 () {56 vars in 1212 bytes} [Tue Jan 25 02:24:36 2022] GET /identity/v3/projects/f5262ec94a2045dfa66a5b5cd8094e1d => generated 312 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:24:36.185516 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83066c61-2e9f-4035-ad35-a3adb4c595e7 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:24:36.193899 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83066c61-2e9f-4035-ad35-a3adb4c595e7 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:24:36.198495 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e40189b-f6af-4aa5-a88a-2c9906c838f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:24:36.199102 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e40189b-f6af-4aa5-a88a-2c9906c838f0 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:36.199383 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e40189b-f6af-4aa5-a88a-2c9906c838f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:36.199658 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e40189b-f6af-4aa5-a88a-2c9906c838f0 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:36.200504 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e40189b-f6af-4aa5-a88a-2c9906c838f0 admin admin] RBAC: Adding query filter params (role.id=d8dbc6d83d9d41d28c3feb8b3485b291, scope.project.id=f5262ec94a2045dfa66a5b5cd8094e1d, user.id=48ef237f30d14054b1015f9a78de88ba) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:24:36.200812 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e40189b-f6af-4aa5-a88a-2c9906c838f0 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:24:36.202595 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e40189b-f6af-4aa5-a88a-2c9906c838f0 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:24:36.207800 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 566/1144] 10.222.0.117 () {56 vars in 1400 bytes} [Tue Jan 25 02:24:36 2022] GET /identity/v3/role_assignments?user.id=48ef237f30d14054b1015f9a78de88ba&scope.project.id=f5262ec94a2045dfa66a5b5cd8094e1d&role.id=d8dbc6d83d9d41d28c3feb8b3485b291 => generated 260 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:24:38.411256 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0fcda3-68a8-4feb-a95e-002422d733e3 None None] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:38.411854 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0fcda3-68a8-4feb-a95e-002422d733e3 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:38.411854 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0fcda3-68a8-4feb-a95e-002422d733e3 None None] PATH_INFO: `/` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:38.413633 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 579/1145] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:24:38 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:24:38.418867 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8f45c4-7b79-4ff3-afca-0b70622bb772 None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:38.419271 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8f45c4-7b79-4ff3-afca-0b70622bb772 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:38.419425 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8f45c4-7b79-4ff3-afca-0b70622bb772 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:38.437423 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-cb8f45c4-7b79-4ff3-afca-0b70622bb772 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:24:38.438613 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-cb8f45c4-7b79-4ff3-afca-0b70622bb772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:24:38.446838 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 567/1146] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:24:38 2022] POST /identity/v3/auth/tokens => generated 2982 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:24:38.469902 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0fcda3-68a8-4feb-a95e-002422d733e3 None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:24:38.481903 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0fcda3-68a8-4feb-a95e-002422d733e3 None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:24:38.486162 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd6ba60-1340-4bba-8482-fee46cd28eae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:24:38.486923 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd6ba60-1340-4bba-8482-fee46cd28eae admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:38.487200 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd6ba60-1340-4bba-8482-fee46cd28eae admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:38.487468 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd6ba60-1340-4bba-8482-fee46cd28eae admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:38.498129 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd6ba60-1340-4bba-8482-fee46cd28eae admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 25 02:24:38.504829 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: WARNING keystone.server.flask.application [None req-6cd6ba60-1340-4bba-8482-fee46cd28eae admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 25 02:24:38.505938 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 580/1147] 10.222.0.117 () {56 vars in 1122 bytes} [Tue Jan 25 02:24:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:24:38.512284 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8f45c4-7b79-4ff3-afca-0b70622bb772 None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:24:38.521020 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8f45c4-7b79-4ff3-afca-0b70622bb772 None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:24:38.525756 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4c2817-e1be-449d-a84d-a7efdc57ebe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:24:38.526401 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4c2817-e1be-449d-a84d-a7efdc57ebe5 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:38.526685 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4c2817-e1be-449d-a84d-a7efdc57ebe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:38.526966 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4c2817-e1be-449d-a84d-a7efdc57ebe5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:38.527747 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4c2817-e1be-449d-a84d-a7efdc57ebe5 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:24:38.528054 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4c2817-e1be-449d-a84d-a7efdc57ebe5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:24:38.529647 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4c2817-e1be-449d-a84d-a7efdc57ebe5 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:24:38.537639 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 568/1148] 10.222.0.117 () {56 vars in 1125 bytes} [Tue Jan 25 02:24:38 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:24:38.543397 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd6ba60-1340-4bba-8482-fee46cd28eae admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:24:38.553187 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd6ba60-1340-4bba-8482-fee46cd28eae admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:24:38.558379 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcffda12-b0d9-4d5f-88dd-6e2bd4b72198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:24:38.559199 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcffda12-b0d9-4d5f-88dd-6e2bd4b72198 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:38.559475 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcffda12-b0d9-4d5f-88dd-6e2bd4b72198 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:38.559778 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcffda12-b0d9-4d5f-88dd-6e2bd4b72198 admin admin] PATH_INFO: `/v3/users/48ef237f30d14054b1015f9a78de88ba` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:38.560955 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcffda12-b0d9-4d5f-88dd-6e2bd4b72198 admin admin] RBAC: Authorizing `identity:get_user(user_id=48ef237f30d14054b1015f9a78de88ba)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:24:38.563037 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcffda12-b0d9-4d5f-88dd-6e2bd4b72198 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:24:38.564579 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 581/1149] 10.222.0.117 () {56 vars in 1203 bytes} [Tue Jan 25 02:24:38 2022] GET /identity/v3/users/48ef237f30d14054b1015f9a78de88ba => generated 287 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:24:38.569620 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4c2817-e1be-449d-a84d-a7efdc57ebe5 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:24:38.579920 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4c2817-e1be-449d-a84d-a7efdc57ebe5 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:24:38.584416 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b19e731-d20b-46d6-826d-58eb1d4c0964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:24:38.585236 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b19e731-d20b-46d6-826d-58eb1d4c0964 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:38.585521 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b19e731-d20b-46d6-826d-58eb1d4c0964 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:38.585801 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b19e731-d20b-46d6-826d-58eb1d4c0964 admin admin] PATH_INFO: `/v3/projects/f5262ec94a2045dfa66a5b5cd8094e1d` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:38.587391 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b19e731-d20b-46d6-826d-58eb1d4c0964 admin admin] RBAC: Authorizing `identity:get_project(project_id=f5262ec94a2045dfa66a5b5cd8094e1d)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:24:38.589479 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b19e731-d20b-46d6-826d-58eb1d4c0964 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:24:38.591144 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 569/1150] 10.222.0.117 () {56 vars in 1212 bytes} [Tue Jan 25 02:24:38 2022] GET /identity/v3/projects/f5262ec94a2045dfa66a5b5cd8094e1d => generated 312 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:24:38.596946 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcffda12-b0d9-4d5f-88dd-6e2bd4b72198 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:24:38.607185 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcffda12-b0d9-4d5f-88dd-6e2bd4b72198 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:24:38.611633 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324833af-5f61-4948-bcf2-e18cf56c5ead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:24:38.612543 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324833af-5f61-4948-bcf2-e18cf56c5ead admin admin] REQUEST_METHOD: `PUT` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:38.612821 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324833af-5f61-4948-bcf2-e18cf56c5ead admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:38.613095 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324833af-5f61-4948-bcf2-e18cf56c5ead admin admin] PATH_INFO: `/v3/projects/f5262ec94a2045dfa66a5b5cd8094e1d/users/48ef237f30d14054b1015f9a78de88ba/roles/d8dbc6d83d9d41d28c3feb8b3485b291` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:38.615041 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324833af-5f61-4948-bcf2-e18cf56c5ead admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5262ec94a2045dfa66a5b5cd8094e1d, user_id=48ef237f30d14054b1015f9a78de88ba, role_id=d8dbc6d83d9d41d28c3feb8b3485b291)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:24:38.617685 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324833af-5f61-4948-bcf2-e18cf56c5ead admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:24:38.632069 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 582/1151] 10.222.0.117 () {58 vars in 1465 bytes} [Tue Jan 25 02:24:38 2022] PUT /identity/v3/projects/f5262ec94a2045dfa66a5b5cd8094e1d/users/48ef237f30d14054b1015f9a78de88ba/roles/d8dbc6d83d9d41d28c3feb8b3485b291 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:24:40.831268 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f534c12-7195-4a81-b1e6-2f5719141eaf None None] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:40.831804 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f534c12-7195-4a81-b1e6-2f5719141eaf None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:40.831897 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f534c12-7195-4a81-b1e6-2f5719141eaf None None] PATH_INFO: `/` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:40.833634 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 570/1152] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:24:40 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:24:40.839566 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9414cc6-8d27-4d16-a580-e4296319ad03 None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:40.840004 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9414cc6-8d27-4d16-a580-e4296319ad03 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:40.840150 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9414cc6-8d27-4d16-a580-e4296319ad03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:40.858472 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-d9414cc6-8d27-4d16-a580-e4296319ad03 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:24:40.859665 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-d9414cc6-8d27-4d16-a580-e4296319ad03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:24:40.914803 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 583/1153] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:24:40 2022] POST /identity/v3/auth/tokens => generated 2982 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:24:40.938265 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f534c12-7195-4a81-b1e6-2f5719141eaf None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:24:40.950976 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f534c12-7195-4a81-b1e6-2f5719141eaf None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:24:40.955261 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a6247d-8346-4459-96f0-69a823989dbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:24:40.956063 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a6247d-8346-4459-96f0-69a823989dbd admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:40.956343 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a6247d-8346-4459-96f0-69a823989dbd admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:40.956614 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a6247d-8346-4459-96f0-69a823989dbd admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:40.967195 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a6247d-8346-4459-96f0-69a823989dbd admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 25 02:24:40.974254 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: WARNING keystone.server.flask.application [None req-42a6247d-8346-4459-96f0-69a823989dbd admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 25 02:24:40.975390 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 571/1154] 10.222.0.117 () {56 vars in 1122 bytes} [Tue Jan 25 02:24:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:24:40.981236 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9414cc6-8d27-4d16-a580-e4296319ad03 None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:24:40.990014 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9414cc6-8d27-4d16-a580-e4296319ad03 None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:24:40.994712 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df14c1b4-4c76-4931-b807-ccdc3a9b0be7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:24:40.995356 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df14c1b4-4c76-4931-b807-ccdc3a9b0be7 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:40.995638 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df14c1b4-4c76-4931-b807-ccdc3a9b0be7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:40.995947 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df14c1b4-4c76-4931-b807-ccdc3a9b0be7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:40.996706 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df14c1b4-4c76-4931-b807-ccdc3a9b0be7 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:24:40.997013 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df14c1b4-4c76-4931-b807-ccdc3a9b0be7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:24:40.998612 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df14c1b4-4c76-4931-b807-ccdc3a9b0be7 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:24:41.006575 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 584/1155] 10.222.0.117 () {56 vars in 1125 bytes} [Tue Jan 25 02:24:40 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:24:41.012745 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a6247d-8346-4459-96f0-69a823989dbd admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:24:41.022504 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a6247d-8346-4459-96f0-69a823989dbd admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:24:41.027890 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8843cb4b-3553-44c9-9629-a9d059fa2a8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:24:41.028709 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8843cb4b-3553-44c9-9629-a9d059fa2a8a admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:41.028986 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8843cb4b-3553-44c9-9629-a9d059fa2a8a admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:41.029253 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8843cb4b-3553-44c9-9629-a9d059fa2a8a admin admin] PATH_INFO: `/v3/users/48ef237f30d14054b1015f9a78de88ba` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:41.030422 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8843cb4b-3553-44c9-9629-a9d059fa2a8a admin admin] RBAC: Authorizing `identity:get_user(user_id=48ef237f30d14054b1015f9a78de88ba)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:24:41.032541 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8843cb4b-3553-44c9-9629-a9d059fa2a8a admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:24:41.034064 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 572/1156] 10.222.0.117 () {56 vars in 1203 bytes} [Tue Jan 25 02:24:41 2022] GET /identity/v3/users/48ef237f30d14054b1015f9a78de88ba => generated 287 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:24:41.039194 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df14c1b4-4c76-4931-b807-ccdc3a9b0be7 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:24:41.048994 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df14c1b4-4c76-4931-b807-ccdc3a9b0be7 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:24:41.053476 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045871d7-cc15-437b-aaf7-b9c424e6b48f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:24:41.054092 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045871d7-cc15-437b-aaf7-b9c424e6b48f admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:41.054375 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045871d7-cc15-437b-aaf7-b9c424e6b48f admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:41.054648 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045871d7-cc15-437b-aaf7-b9c424e6b48f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:41.062895 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045871d7-cc15-437b-aaf7-b9c424e6b48f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:24:41.064667 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045871d7-cc15-437b-aaf7-b9c424e6b48f admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:24:41.073288 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 585/1157] 10.222.0.117 () {58 vars in 1329 bytes} [Tue Jan 25 02:24:41 2022] GET /identity/v3/auth/tokens => generated 2982 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:24:41.078590 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8843cb4b-3553-44c9-9629-a9d059fa2a8a admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:24:41.087903 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8843cb4b-3553-44c9-9629-a9d059fa2a8a admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:24:41.092371 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3887e947-f63b-4319-ab0f-3f9ebe791f0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:24:41.093180 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3887e947-f63b-4319-ab0f-3f9ebe791f0f admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:41.093461 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3887e947-f63b-4319-ab0f-3f9ebe791f0f admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:41.093735 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3887e947-f63b-4319-ab0f-3f9ebe791f0f admin admin] PATH_INFO: `/v3/projects/f5262ec94a2045dfa66a5b5cd8094e1d` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:41.095155 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3887e947-f63b-4319-ab0f-3f9ebe791f0f admin admin] RBAC: Authorizing `identity:get_project(project_id=f5262ec94a2045dfa66a5b5cd8094e1d)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:24:41.097195 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3887e947-f63b-4319-ab0f-3f9ebe791f0f admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:24:41.098907 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 573/1158] 10.222.0.117 () {56 vars in 1212 bytes} [Tue Jan 25 02:24:41 2022] GET /identity/v3/projects/f5262ec94a2045dfa66a5b5cd8094e1d => generated 312 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:24:41.104681 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045871d7-cc15-437b-aaf7-b9c424e6b48f admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:24:41.113134 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045871d7-cc15-437b-aaf7-b9c424e6b48f admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:24:41.117683 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3b6142-e62a-441f-950c-df60a9338a15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:24:41.118938 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3b6142-e62a-441f-950c-df60a9338a15 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:41.119220 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3b6142-e62a-441f-950c-df60a9338a15 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:41.119499 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3b6142-e62a-441f-950c-df60a9338a15 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:41.120352 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3b6142-e62a-441f-950c-df60a9338a15 admin admin] RBAC: Adding query filter params (role.id=d8dbc6d83d9d41d28c3feb8b3485b291, scope.project.id=f5262ec94a2045dfa66a5b5cd8094e1d, user.id=48ef237f30d14054b1015f9a78de88ba) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:24:41.120661 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3b6142-e62a-441f-950c-df60a9338a15 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:24:41.122478 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3b6142-e62a-441f-950c-df60a9338a15 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:24:41.128093 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 586/1159] 10.222.0.117 () {56 vars in 1400 bytes} [Tue Jan 25 02:24:41 2022] GET /identity/v3/role_assignments?user.id=48ef237f30d14054b1015f9a78de88ba&scope.project.id=f5262ec94a2045dfa66a5b5cd8094e1d&role.id=d8dbc6d83d9d41d28c3feb8b3485b291 => generated 610 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 02:24:43.353418 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03c3fb9-5e54-4a2e-9b06-450de7585379 None None] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:43.354006 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03c3fb9-5e54-4a2e-9b06-450de7585379 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:43.354006 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03c3fb9-5e54-4a2e-9b06-450de7585379 None None] PATH_INFO: `/` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:43.355873 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 574/1160] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:24:43 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:24:43.361198 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeabd94a-ed57-4762-8896-9909c654a9c9 None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:43.361705 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeabd94a-ed57-4762-8896-9909c654a9c9 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:43.361809 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeabd94a-ed57-4762-8896-9909c654a9c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:43.379574 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-aeabd94a-ed57-4762-8896-9909c654a9c9 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:24:43.380787 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-aeabd94a-ed57-4762-8896-9909c654a9c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:24:43.388480 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 587/1161] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:24:43 2022] POST /identity/v3/auth/tokens => generated 2982 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:24:43.411257 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03c3fb9-5e54-4a2e-9b06-450de7585379 None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:24:43.424123 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03c3fb9-5e54-4a2e-9b06-450de7585379 None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:24:43.428525 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf3f3ca-9207-467a-9c1a-7ee91d9aa158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:24:43.429156 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf3f3ca-9207-467a-9c1a-7ee91d9aa158 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:43.429439 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf3f3ca-9207-467a-9c1a-7ee91d9aa158 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:43.429714 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf3f3ca-9207-467a-9c1a-7ee91d9aa158 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:43.438038 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf3f3ca-9207-467a-9c1a-7ee91d9aa158 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:24:43.439856 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf3f3ca-9207-467a-9c1a-7ee91d9aa158 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:24:43.448672 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 575/1162] 10.222.0.117 () {58 vars in 1329 bytes} [Tue Jan 25 02:24:43 2022] GET /identity/v3/auth/tokens => generated 2982 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:24:43.454210 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeabd94a-ed57-4762-8896-9909c654a9c9 None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:24:43.463870 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeabd94a-ed57-4762-8896-9909c654a9c9 None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:24:43.468264 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35e5db7-fbcf-4bee-8b8c-cefdcd4078bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:24:43.469286 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35e5db7-fbcf-4bee-8b8c-cefdcd4078bd admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:43.469563 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35e5db7-fbcf-4bee-8b8c-cefdcd4078bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:43.469830 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35e5db7-fbcf-4bee-8b8c-cefdcd4078bd admin admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:43.476455 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35e5db7-fbcf-4bee-8b8c-cefdcd4078bd admin admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:24:43.479331 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35e5db7-fbcf-4bee-8b8c-cefdcd4078bd admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:24:43.494340 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: WARNING keystone.server.flask.application [None req-d35e5db7-fbcf-4bee-8b8c-cefdcd4078bd admin admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jan 25 02:24:43.495436 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 588/1163] 10.222.0.117 () {56 vars in 1143 bytes} [Tue Jan 25 02:24:43 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:24:43.501368 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf3f3ca-9207-467a-9c1a-7ee91d9aa158 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:24:43.510725 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf3f3ca-9207-467a-9c1a-7ee91d9aa158 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:24:43.515280 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a735b06-c4ee-4a85-967b-b335702f39b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:24:43.515935 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a735b06-c4ee-4a85-967b-b335702f39b1 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:43.516219 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a735b06-c4ee-4a85-967b-b335702f39b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:43.516495 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a735b06-c4ee-4a85-967b-b335702f39b1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:43.517221 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a735b06-c4ee-4a85-967b-b335702f39b1 admin admin] RBAC: Adding query filter params (name=swift_test) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:24:43.517525 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a735b06-c4ee-4a85-967b-b335702f39b1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:24:43.519092 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a735b06-c4ee-4a85-967b-b335702f39b1 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:24:43.526275 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 576/1164] 10.222.0.117 () {56 vars in 1141 bytes} [Tue Jan 25 02:24:43 2022] GET /identity/v3/domains?name=swift_test => generated 126 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:24:45.750238 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f804f9b-2163-44e1-bfde-2dee46a25f06 None None] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:45.750761 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f804f9b-2163-44e1-bfde-2dee46a25f06 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:45.750761 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f804f9b-2163-44e1-bfde-2dee46a25f06 None None] PATH_INFO: `/` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:45.752573 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 589/1165] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:24:45 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:24:45.757808 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd149613-c7cf-46ee-88b0-f6f0f16730db None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:45.758210 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd149613-c7cf-46ee-88b0-f6f0f16730db None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:45.758390 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd149613-c7cf-46ee-88b0-f6f0f16730db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:45.776323 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-cd149613-c7cf-46ee-88b0-f6f0f16730db None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:24:45.777510 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-cd149613-c7cf-46ee-88b0-f6f0f16730db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:24:45.785029 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 577/1166] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:24:45 2022] POST /identity/v3/auth/tokens => generated 2982 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:24:45.809778 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f804f9b-2163-44e1-bfde-2dee46a25f06 None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:24:45.822335 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f804f9b-2163-44e1-bfde-2dee46a25f06 None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:24:45.827457 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df10a87e-9735-4100-825e-f24ca1c4378d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:24:45.827714 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df10a87e-9735-4100-825e-f24ca1c4378d admin admin] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:45.828015 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df10a87e-9735-4100-825e-f24ca1c4378d admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:45.828285 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df10a87e-9735-4100-825e-f24ca1c4378d admin admin] PATH_INFO: `/v3/domains` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:45.829059 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df10a87e-9735-4100-825e-f24ca1c4378d admin admin] RBAC: Authorizing `identity:create_domain()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:24:45.830096 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: WARNING py.warnings [None req-df10a87e-9735-4100-825e-f24ca1c4378d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 25 02:24:45.830096 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: warnings.warn(msg) Jan 25 02:24:45.830096 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: Jan 25 02:24:45.830961 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df10a87e-9735-4100-825e-f24ca1c4378d admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:24:45.846579 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 590/1167] 10.222.0.117 () {60 vars in 1164 bytes} [Tue Jan 25 02:24:45 2022] POST /identity/v3/domains => generated 268 bytes in 37 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 25 02:24:48.076009 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f349eb7d-84d4-426c-9f76-839cc4eecc84 None None] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:48.076592 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f349eb7d-84d4-426c-9f76-839cc4eecc84 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:48.076592 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f349eb7d-84d4-426c-9f76-839cc4eecc84 None None] PATH_INFO: `/` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:48.078329 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 578/1168] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:24:48 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:24:48.083547 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6522fcd3-0a74-407b-826a-5d50664d898d None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:48.083964 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6522fcd3-0a74-407b-826a-5d50664d898d None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:48.084130 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6522fcd3-0a74-407b-826a-5d50664d898d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:48.103394 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-6522fcd3-0a74-407b-826a-5d50664d898d None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:24:48.104603 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-6522fcd3-0a74-407b-826a-5d50664d898d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:24:48.158433 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 591/1169] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:24:48 2022] POST /identity/v3/auth/tokens => generated 2982 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:24:48.182870 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f349eb7d-84d4-426c-9f76-839cc4eecc84 None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:24:48.194682 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f349eb7d-84d4-426c-9f76-839cc4eecc84 None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:24:48.199626 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe94a8ae-a2e4-442c-81ea-c56b127e8456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:24:48.200496 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe94a8ae-a2e4-442c-81ea-c56b127e8456 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:48.200778 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe94a8ae-a2e4-442c-81ea-c56b127e8456 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:48.201052 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe94a8ae-a2e4-442c-81ea-c56b127e8456 admin admin] PATH_INFO: `/v3/domains/0de99bff52014100a2d2fe02b78e7855` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:48.211271 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe94a8ae-a2e4-442c-81ea-c56b127e8456 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=0de99bff52014100a2d2fe02b78e7855)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:24:48.214126 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe94a8ae-a2e4-442c-81ea-c56b127e8456 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:24:48.215715 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 579/1170] 10.222.0.117 () {56 vars in 1209 bytes} [Tue Jan 25 02:24:48 2022] GET /identity/v3/domains/0de99bff52014100a2d2fe02b78e7855 => generated 268 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:24:48.221514 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6522fcd3-0a74-407b-826a-5d50664d898d None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:24:48.231093 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6522fcd3-0a74-407b-826a-5d50664d898d None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:24:48.235488 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4601d3e1-e9d1-4ae5-b51a-0490dcf6d619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:24:48.236148 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4601d3e1-e9d1-4ae5-b51a-0490dcf6d619 admin admin] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:48.236428 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4601d3e1-e9d1-4ae5-b51a-0490dcf6d619 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:48.236698 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4601d3e1-e9d1-4ae5-b51a-0490dcf6d619 admin admin] PATH_INFO: `/v3/projects` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:48.237405 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4601d3e1-e9d1-4ae5-b51a-0490dcf6d619 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:24:48.239286 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4601d3e1-e9d1-4ae5-b51a-0490dcf6d619 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:24:48.263386 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 592/1171] 10.222.0.117 () {60 vars in 1167 bytes} [Tue Jan 25 02:24:48 2022] POST /identity/v3/projects => generated 362 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 02:24:50.527521 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27938bf-c44d-4d2c-8956-3d2efdd75f15 None None] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:50.528110 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27938bf-c44d-4d2c-8956-3d2efdd75f15 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:50.528110 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27938bf-c44d-4d2c-8956-3d2efdd75f15 None None] PATH_INFO: `/` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:50.529895 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 580/1172] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:24:50 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:24:50.535108 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde411c0-6d23-4ccd-a372-6a7db1de8e7b None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:50.535494 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde411c0-6d23-4ccd-a372-6a7db1de8e7b None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:50.535664 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde411c0-6d23-4ccd-a372-6a7db1de8e7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:50.553243 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-dde411c0-6d23-4ccd-a372-6a7db1de8e7b None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:24:50.554409 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-dde411c0-6d23-4ccd-a372-6a7db1de8e7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:24:50.611205 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 593/1173] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:24:50 2022] POST /identity/v3/auth/tokens => generated 2982 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:24:50.637079 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27938bf-c44d-4d2c-8956-3d2efdd75f15 None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:24:50.649560 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27938bf-c44d-4d2c-8956-3d2efdd75f15 None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:24:50.653889 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44891832-fbef-41e6-9e1d-ed70753762ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:24:50.654732 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44891832-fbef-41e6-9e1d-ed70753762ce admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:50.655014 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44891832-fbef-41e6-9e1d-ed70753762ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:50.655289 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44891832-fbef-41e6-9e1d-ed70753762ce admin admin] PATH_INFO: `/v3/domains/0de99bff52014100a2d2fe02b78e7855` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:50.656473 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44891832-fbef-41e6-9e1d-ed70753762ce admin admin] RBAC: Authorizing `identity:get_domain(domain_id=0de99bff52014100a2d2fe02b78e7855)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:24:50.658410 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44891832-fbef-41e6-9e1d-ed70753762ce admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:24:50.660002 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 581/1174] 10.222.0.117 () {56 vars in 1209 bytes} [Tue Jan 25 02:24:50 2022] GET /identity/v3/domains/0de99bff52014100a2d2fe02b78e7855 => generated 268 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:24:50.665565 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde411c0-6d23-4ccd-a372-6a7db1de8e7b None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:24:50.674412 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde411c0-6d23-4ccd-a372-6a7db1de8e7b None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:24:50.678945 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa34495-d070-4162-b2c8-c0d3b7d8f5de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:24:50.679625 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa34495-d070-4162-b2c8-c0d3b7d8f5de admin admin] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:50.679938 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa34495-d070-4162-b2c8-c0d3b7d8f5de admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:50.680263 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa34495-d070-4162-b2c8-c0d3b7d8f5de admin admin] PATH_INFO: `/v3/users` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:50.680988 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa34495-d070-4162-b2c8-c0d3b7d8f5de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:24:50.682897 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa34495-d070-4162-b2c8-c0d3b7d8f5de admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:24:50.702773 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 594/1175] 10.222.0.117 () {60 vars in 1158 bytes} [Tue Jan 25 02:24:50 2022] POST /identity/v3/users => generated 312 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 02:24:52.956303 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77975a80-a808-4993-a136-55695afe0612 None None] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:52.956878 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77975a80-a808-4993-a136-55695afe0612 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:52.956878 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77975a80-a808-4993-a136-55695afe0612 None None] PATH_INFO: `/` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:52.958616 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 582/1176] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:24:52 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:24:52.964042 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e3a22f-b49c-4e1c-b99d-7739f2ac6c38 None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:52.964475 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e3a22f-b49c-4e1c-b99d-7739f2ac6c38 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:52.964582 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e3a22f-b49c-4e1c-b99d-7739f2ac6c38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:52.982736 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-27e3a22f-b49c-4e1c-b99d-7739f2ac6c38 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:24:52.983931 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-27e3a22f-b49c-4e1c-b99d-7739f2ac6c38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:24:52.991288 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 595/1177] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:24:52 2022] POST /identity/v3/auth/tokens => generated 2982 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:24:53.015253 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77975a80-a808-4993-a136-55695afe0612 None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:24:53.027283 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77975a80-a808-4993-a136-55695afe0612 None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:24:53.031538 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c72331-8ec4-486a-9b0c-816d63956892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:24:53.032351 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c72331-8ec4-486a-9b0c-816d63956892 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:53.032631 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c72331-8ec4-486a-9b0c-816d63956892 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:53.032901 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c72331-8ec4-486a-9b0c-816d63956892 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:53.043962 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c72331-8ec4-486a-9b0c-816d63956892 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 25 02:24:53.050728 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: WARNING keystone.server.flask.application [None req-62c72331-8ec4-486a-9b0c-816d63956892 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 25 02:24:53.051881 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 583/1178] 10.222.0.117 () {56 vars in 1122 bytes} [Tue Jan 25 02:24:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:24:53.058474 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e3a22f-b49c-4e1c-b99d-7739f2ac6c38 None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:24:53.067087 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e3a22f-b49c-4e1c-b99d-7739f2ac6c38 None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:24:53.072287 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221b8db7-0640-4c0e-b4d3-3109b32b390d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:24:53.072929 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221b8db7-0640-4c0e-b4d3-3109b32b390d admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:53.073208 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221b8db7-0640-4c0e-b4d3-3109b32b390d admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:53.073480 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221b8db7-0640-4c0e-b4d3-3109b32b390d admin admin] PATH_INFO: `/v3/roles` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:53.074227 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221b8db7-0640-4c0e-b4d3-3109b32b390d admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:24:53.074525 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221b8db7-0640-4c0e-b4d3-3109b32b390d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:24:53.076144 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221b8db7-0640-4c0e-b4d3-3109b32b390d admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:24:53.084223 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 596/1179] 10.222.0.117 () {56 vars in 1125 bytes} [Tue Jan 25 02:24:53 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:24:53.090037 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c72331-8ec4-486a-9b0c-816d63956892 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:24:53.099634 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c72331-8ec4-486a-9b0c-816d63956892 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:24:53.104225 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2cefec-5845-4f33-b02b-483e88fdeea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:24:53.105060 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2cefec-5845-4f33-b02b-483e88fdeea3 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:53.105345 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2cefec-5845-4f33-b02b-483e88fdeea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:53.105622 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2cefec-5845-4f33-b02b-483e88fdeea3 admin admin] PATH_INFO: `/v3/users/a083160ebb8347e493d15dfec30e5bdb` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:53.118795 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2cefec-5845-4f33-b02b-483e88fdeea3 admin admin] RBAC: Authorizing `identity:get_user(user_id=a083160ebb8347e493d15dfec30e5bdb)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:24:53.120972 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2cefec-5845-4f33-b02b-483e88fdeea3 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:24:53.122559 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 584/1180] 10.222.0.117 () {56 vars in 1203 bytes} [Tue Jan 25 02:24:53 2022] GET /identity/v3/users/a083160ebb8347e493d15dfec30e5bdb => generated 312 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:24:53.127942 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221b8db7-0640-4c0e-b4d3-3109b32b390d admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:24:53.147401 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221b8db7-0640-4c0e-b4d3-3109b32b390d admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:24:53.152639 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c48999e-8ded-462a-812a-6851e19a10cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:24:53.153261 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c48999e-8ded-462a-812a-6851e19a10cf admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:53.153542 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c48999e-8ded-462a-812a-6851e19a10cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:53.153817 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c48999e-8ded-462a-812a-6851e19a10cf admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:53.161400 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c48999e-8ded-462a-812a-6851e19a10cf admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:24:53.163125 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c48999e-8ded-462a-812a-6851e19a10cf admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:24:53.171933 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 597/1181] 10.222.0.117 () {58 vars in 1329 bytes} [Tue Jan 25 02:24:53 2022] GET /identity/v3/auth/tokens => generated 2982 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:24:53.177219 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2cefec-5845-4f33-b02b-483e88fdeea3 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:24:53.186640 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2cefec-5845-4f33-b02b-483e88fdeea3 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:24:53.191140 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0cf9ab-e956-4250-853b-38c1c42e348d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:24:53.192007 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0cf9ab-e956-4250-853b-38c1c42e348d admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:53.192292 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0cf9ab-e956-4250-853b-38c1c42e348d admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:53.192571 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0cf9ab-e956-4250-853b-38c1c42e348d admin admin] PATH_INFO: `/v3/projects/7d8ce80565304c02bd6c254fa8404868` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:53.193746 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0cf9ab-e956-4250-853b-38c1c42e348d admin admin] RBAC: Authorizing `identity:get_project(project_id=7d8ce80565304c02bd6c254fa8404868)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:24:53.196307 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0cf9ab-e956-4250-853b-38c1c42e348d admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:24:53.197922 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 585/1182] 10.222.0.117 () {56 vars in 1212 bytes} [Tue Jan 25 02:24:53 2022] GET /identity/v3/projects/7d8ce80565304c02bd6c254fa8404868 => generated 362 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:24:53.203394 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c48999e-8ded-462a-812a-6851e19a10cf admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:24:53.212474 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c48999e-8ded-462a-812a-6851e19a10cf admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:24:53.217008 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e18582-016b-4268-a88d-a859265b63e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:24:53.217624 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e18582-016b-4268-a88d-a859265b63e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:53.217908 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e18582-016b-4268-a88d-a859265b63e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:53.218182 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e18582-016b-4268-a88d-a859265b63e5 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:53.219319 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e18582-016b-4268-a88d-a859265b63e5 admin admin] RBAC: Adding query filter params (role.id=d8dbc6d83d9d41d28c3feb8b3485b291, scope.project.id=7d8ce80565304c02bd6c254fa8404868, user.id=a083160ebb8347e493d15dfec30e5bdb) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:24:53.219627 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e18582-016b-4268-a88d-a859265b63e5 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:24:53.221464 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e18582-016b-4268-a88d-a859265b63e5 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:24:53.226615 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 598/1183] 10.222.0.117 () {56 vars in 1400 bytes} [Tue Jan 25 02:24:53 2022] GET /identity/v3/role_assignments?user.id=a083160ebb8347e493d15dfec30e5bdb&scope.project.id=7d8ce80565304c02bd6c254fa8404868&role.id=d8dbc6d83d9d41d28c3feb8b3485b291 => generated 260 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:24:55.452941 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e58431-c5b5-40fd-a563-b0ecd2176c2c None None] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:55.453489 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e58431-c5b5-40fd-a563-b0ecd2176c2c None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:55.453489 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e58431-c5b5-40fd-a563-b0ecd2176c2c None None] PATH_INFO: `/` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:55.455221 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 586/1184] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:24:55 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:24:55.460329 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aa05d0-3e3c-46a9-96b8-f6ba1bbee1f8 None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:55.460731 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aa05d0-3e3c-46a9-96b8-f6ba1bbee1f8 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:55.460886 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aa05d0-3e3c-46a9-96b8-f6ba1bbee1f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:55.478894 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-49aa05d0-3e3c-46a9-96b8-f6ba1bbee1f8 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:24:55.480106 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-49aa05d0-3e3c-46a9-96b8-f6ba1bbee1f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:24:55.487536 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 599/1185] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:24:55 2022] POST /identity/v3/auth/tokens => generated 2982 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 25 02:24:55.511897 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e58431-c5b5-40fd-a563-b0ecd2176c2c None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:24:55.524235 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e58431-c5b5-40fd-a563-b0ecd2176c2c None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:24:55.528524 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b541fe-a07e-47a9-a84f-15ace20496aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:24:55.529287 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b541fe-a07e-47a9-a84f-15ace20496aa admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:55.529566 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b541fe-a07e-47a9-a84f-15ace20496aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:55.529842 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b541fe-a07e-47a9-a84f-15ace20496aa admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:55.540210 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b541fe-a07e-47a9-a84f-15ace20496aa admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 25 02:24:55.546925 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: WARNING keystone.server.flask.application [None req-e7b541fe-a07e-47a9-a84f-15ace20496aa admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 25 02:24:55.548068 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 587/1186] 10.222.0.117 () {56 vars in 1122 bytes} [Tue Jan 25 02:24:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:24:55.553668 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aa05d0-3e3c-46a9-96b8-f6ba1bbee1f8 None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:24:55.563101 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aa05d0-3e3c-46a9-96b8-f6ba1bbee1f8 None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:24:55.567504 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8453f3d5-390f-4ece-9770-3f4151db0625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:24:55.568184 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8453f3d5-390f-4ece-9770-3f4151db0625 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:55.568465 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8453f3d5-390f-4ece-9770-3f4151db0625 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:55.568738 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8453f3d5-390f-4ece-9770-3f4151db0625 admin admin] PATH_INFO: `/v3/roles` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:55.569487 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8453f3d5-390f-4ece-9770-3f4151db0625 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:24:55.569789 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8453f3d5-390f-4ece-9770-3f4151db0625 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:24:55.572127 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8453f3d5-390f-4ece-9770-3f4151db0625 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:24:55.580108 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 600/1187] 10.222.0.117 () {56 vars in 1125 bytes} [Tue Jan 25 02:24:55 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 02:24:55.585485 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b541fe-a07e-47a9-a84f-15ace20496aa admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:24:55.595749 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b541fe-a07e-47a9-a84f-15ace20496aa admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:24:55.600194 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bba782-3cac-4f32-b660-d7b194ff303a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:24:55.601031 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bba782-3cac-4f32-b660-d7b194ff303a admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:55.601312 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bba782-3cac-4f32-b660-d7b194ff303a admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:55.601586 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bba782-3cac-4f32-b660-d7b194ff303a admin admin] PATH_INFO: `/v3/users/a083160ebb8347e493d15dfec30e5bdb` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:55.603045 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bba782-3cac-4f32-b660-d7b194ff303a admin admin] RBAC: Authorizing `identity:get_user(user_id=a083160ebb8347e493d15dfec30e5bdb)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:24:55.605182 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bba782-3cac-4f32-b660-d7b194ff303a admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:24:55.606753 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 588/1188] 10.222.0.117 () {56 vars in 1203 bytes} [Tue Jan 25 02:24:55 2022] GET /identity/v3/users/a083160ebb8347e493d15dfec30e5bdb => generated 312 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:24:55.612069 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8453f3d5-390f-4ece-9770-3f4151db0625 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:24:55.622073 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8453f3d5-390f-4ece-9770-3f4151db0625 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:24:55.626524 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c86c8dc-ce1e-403a-8a91-512a9ef82f00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:24:55.627356 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c86c8dc-ce1e-403a-8a91-512a9ef82f00 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:55.627639 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c86c8dc-ce1e-403a-8a91-512a9ef82f00 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:55.627946 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c86c8dc-ce1e-403a-8a91-512a9ef82f00 admin admin] PATH_INFO: `/v3/projects/7d8ce80565304c02bd6c254fa8404868` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:55.629113 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c86c8dc-ce1e-403a-8a91-512a9ef82f00 admin admin] RBAC: Authorizing `identity:get_project(project_id=7d8ce80565304c02bd6c254fa8404868)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:24:55.631141 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c86c8dc-ce1e-403a-8a91-512a9ef82f00 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:24:55.632789 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 601/1189] 10.222.0.117 () {56 vars in 1212 bytes} [Tue Jan 25 02:24:55 2022] GET /identity/v3/projects/7d8ce80565304c02bd6c254fa8404868 => generated 362 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:24:55.638870 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bba782-3cac-4f32-b660-d7b194ff303a admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:24:55.648062 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bba782-3cac-4f32-b660-d7b194ff303a admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:24:55.652722 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba095531-dfb7-4f43-9feb-51f1ad0c6e01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:24:55.653568 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba095531-dfb7-4f43-9feb-51f1ad0c6e01 admin admin] REQUEST_METHOD: `PUT` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:55.653853 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba095531-dfb7-4f43-9feb-51f1ad0c6e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:55.654128 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba095531-dfb7-4f43-9feb-51f1ad0c6e01 admin admin] PATH_INFO: `/v3/projects/7d8ce80565304c02bd6c254fa8404868/users/a083160ebb8347e493d15dfec30e5bdb/roles/d8dbc6d83d9d41d28c3feb8b3485b291` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:55.656113 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba095531-dfb7-4f43-9feb-51f1ad0c6e01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d8ce80565304c02bd6c254fa8404868, user_id=a083160ebb8347e493d15dfec30e5bdb, role_id=d8dbc6d83d9d41d28c3feb8b3485b291)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:24:55.658715 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba095531-dfb7-4f43-9feb-51f1ad0c6e01 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:24:55.671730 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 589/1190] 10.222.0.117 () {58 vars in 1465 bytes} [Tue Jan 25 02:24:55 2022] PUT /identity/v3/projects/7d8ce80565304c02bd6c254fa8404868/users/a083160ebb8347e493d15dfec30e5bdb/roles/d8dbc6d83d9d41d28c3feb8b3485b291 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 25 02:24:57.859169 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eed5dcd-de52-4e19-a60b-cac6a87ad728 None None] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:57.859686 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eed5dcd-de52-4e19-a60b-cac6a87ad728 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:57.859686 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eed5dcd-de52-4e19-a60b-cac6a87ad728 None None] PATH_INFO: `/` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:57.861479 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 602/1191] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:24:57 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:24:57.866615 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e576b0b-8872-4456-b839-340758f008da None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:57.866994 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e576b0b-8872-4456-b839-340758f008da None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:57.867177 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e576b0b-8872-4456-b839-340758f008da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:57.885587 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-7e576b0b-8872-4456-b839-340758f008da None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:24:57.886767 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-7e576b0b-8872-4456-b839-340758f008da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:24:57.942184 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 590/1192] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:24:57 2022] POST /identity/v3/auth/tokens => generated 2982 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:24:57.966134 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eed5dcd-de52-4e19-a60b-cac6a87ad728 None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:24:57.979157 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eed5dcd-de52-4e19-a60b-cac6a87ad728 None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:24:57.983430 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b564f0e-b36c-48a2-b503-b8ab3fad2b41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:24:57.984230 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b564f0e-b36c-48a2-b503-b8ab3fad2b41 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:57.984517 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b564f0e-b36c-48a2-b503-b8ab3fad2b41 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:57.984793 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b564f0e-b36c-48a2-b503-b8ab3fad2b41 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:57.994987 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b564f0e-b36c-48a2-b503-b8ab3fad2b41 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 25 02:24:58.001753 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: WARNING keystone.server.flask.application [None req-7b564f0e-b36c-48a2-b503-b8ab3fad2b41 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 25 02:24:58.002880 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 603/1193] 10.222.0.117 () {56 vars in 1122 bytes} [Tue Jan 25 02:24:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:24:58.008808 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e576b0b-8872-4456-b839-340758f008da None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:24:58.017625 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e576b0b-8872-4456-b839-340758f008da None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:24:58.022289 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba51face-e465-4cdf-ae85-badea293d3cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:24:58.022950 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba51face-e465-4cdf-ae85-badea293d3cb admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:58.023232 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba51face-e465-4cdf-ae85-badea293d3cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:58.024038 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba51face-e465-4cdf-ae85-badea293d3cb admin admin] PATH_INFO: `/v3/roles` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:58.024804 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba51face-e465-4cdf-ae85-badea293d3cb admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:24:58.025108 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba51face-e465-4cdf-ae85-badea293d3cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:24:58.026696 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba51face-e465-4cdf-ae85-badea293d3cb admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:24:58.034761 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 591/1194] 10.222.0.117 () {56 vars in 1125 bytes} [Tue Jan 25 02:24:58 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:24:58.041029 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b564f0e-b36c-48a2-b503-b8ab3fad2b41 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:24:58.051799 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b564f0e-b36c-48a2-b503-b8ab3fad2b41 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:24:58.056368 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893e4446-49b6-467a-b19f-97a00b992b69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:24:58.057202 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893e4446-49b6-467a-b19f-97a00b992b69 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:58.057482 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893e4446-49b6-467a-b19f-97a00b992b69 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:58.057754 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893e4446-49b6-467a-b19f-97a00b992b69 admin admin] PATH_INFO: `/v3/users/a083160ebb8347e493d15dfec30e5bdb` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:58.058933 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893e4446-49b6-467a-b19f-97a00b992b69 admin admin] RBAC: Authorizing `identity:get_user(user_id=a083160ebb8347e493d15dfec30e5bdb)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:24:58.061074 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893e4446-49b6-467a-b19f-97a00b992b69 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:24:58.062601 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 604/1195] 10.222.0.117 () {56 vars in 1203 bytes} [Tue Jan 25 02:24:58 2022] GET /identity/v3/users/a083160ebb8347e493d15dfec30e5bdb => generated 312 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:24:58.067954 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba51face-e465-4cdf-ae85-badea293d3cb admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:24:58.077485 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba51face-e465-4cdf-ae85-badea293d3cb admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:24:58.081895 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1495c4-4e60-4e8d-b1e6-d8829370f3c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:24:58.082508 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1495c4-4e60-4e8d-b1e6-d8829370f3c4 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:58.082787 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1495c4-4e60-4e8d-b1e6-d8829370f3c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:58.083060 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1495c4-4e60-4e8d-b1e6-d8829370f3c4 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:58.091296 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1495c4-4e60-4e8d-b1e6-d8829370f3c4 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:24:58.093047 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1495c4-4e60-4e8d-b1e6-d8829370f3c4 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:24:58.102526 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 592/1196] 10.222.0.117 () {58 vars in 1329 bytes} [Tue Jan 25 02:24:58 2022] GET /identity/v3/auth/tokens => generated 2982 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:24:58.107795 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893e4446-49b6-467a-b19f-97a00b992b69 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:24:58.116974 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893e4446-49b6-467a-b19f-97a00b992b69 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:24:58.121693 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843948e7-c65b-4693-8c59-9d7e44ee1984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:24:58.122494 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843948e7-c65b-4693-8c59-9d7e44ee1984 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:58.122774 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843948e7-c65b-4693-8c59-9d7e44ee1984 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:58.123046 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843948e7-c65b-4693-8c59-9d7e44ee1984 admin admin] PATH_INFO: `/v3/projects/7d8ce80565304c02bd6c254fa8404868` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:58.124240 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843948e7-c65b-4693-8c59-9d7e44ee1984 admin admin] RBAC: Authorizing `identity:get_project(project_id=7d8ce80565304c02bd6c254fa8404868)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:24:58.126235 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843948e7-c65b-4693-8c59-9d7e44ee1984 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:24:58.127861 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 605/1197] 10.222.0.117 () {56 vars in 1212 bytes} [Tue Jan 25 02:24:58 2022] GET /identity/v3/projects/7d8ce80565304c02bd6c254fa8404868 => generated 362 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:24:58.133753 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1495c4-4e60-4e8d-b1e6-d8829370f3c4 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:24:58.142204 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1495c4-4e60-4e8d-b1e6-d8829370f3c4 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:24:58.146745 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1c3507-7ac4-4399-bf94-5e4e9dbfb05a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:24:58.147353 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1c3507-7ac4-4399-bf94-5e4e9dbfb05a admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:24:58.147637 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1c3507-7ac4-4399-bf94-5e4e9dbfb05a admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:24:58.147947 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1c3507-7ac4-4399-bf94-5e4e9dbfb05a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:24:58.149336 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1c3507-7ac4-4399-bf94-5e4e9dbfb05a admin admin] RBAC: Adding query filter params (role.id=d8dbc6d83d9d41d28c3feb8b3485b291, scope.project.id=7d8ce80565304c02bd6c254fa8404868, user.id=a083160ebb8347e493d15dfec30e5bdb) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:24:58.149642 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1c3507-7ac4-4399-bf94-5e4e9dbfb05a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:24:58.151449 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1c3507-7ac4-4399-bf94-5e4e9dbfb05a admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:24:58.157022 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 593/1198] 10.222.0.117 () {56 vars in 1400 bytes} [Tue Jan 25 02:24:58 2022] GET /identity/v3/role_assignments?user.id=a083160ebb8347e493d15dfec30e5bdb&scope.project.id=7d8ce80565304c02bd6c254fa8404868&role.id=d8dbc6d83d9d41d28c3feb8b3485b291 => generated 610 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 02:25:59.382411 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f58588-1253-44b5-80d6-3341cd5ea744 None None] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:25:59.383051 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f58588-1253-44b5-80d6-3341cd5ea744 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:25:59.383051 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f58588-1253-44b5-80d6-3341cd5ea744 None None] PATH_INFO: `/` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:25:59.385798 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 606/1199] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:25:59 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:25:59.390953 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1552c4d-77e3-4b56-892b-55e3947df4cd None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:25:59.391486 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1552c4d-77e3-4b56-892b-55e3947df4cd None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:25:59.391486 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1552c4d-77e3-4b56-892b-55e3947df4cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:25:59.412944 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-b1552c4d-77e3-4b56-892b-55e3947df4cd None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:25:59.414346 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-b1552c4d-77e3-4b56-892b-55e3947df4cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:25:59.427604 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 594/1200] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:25:59 2022] POST /identity/v3/auth/tokens => generated 2982 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:25:59.453330 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f58588-1253-44b5-80d6-3341cd5ea744 None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:25:59.468977 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f58588-1253-44b5-80d6-3341cd5ea744 None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:25:59.475403 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500156a3-2945-4415-9eb2-06f57e9cb80d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:25:59.476862 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500156a3-2945-4415-9eb2-06f57e9cb80d admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:25:59.477204 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500156a3-2945-4415-9eb2-06f57e9cb80d admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:25:59.477533 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500156a3-2945-4415-9eb2-06f57e9cb80d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:25:59.494889 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500156a3-2945-4415-9eb2-06f57e9cb80d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:25:59.496959 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500156a3-2945-4415-9eb2-06f57e9cb80d admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:25:59.515535 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: WARNING keystone.server.flask.application [None req-500156a3-2945-4415-9eb2-06f57e9cb80d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 25 02:25:59.521823 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 607/1201] 10.222.0.117 () {56 vars in 1134 bytes} [Tue Jan 25 02:25:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:25:59.524863 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1552c4d-77e3-4b56-892b-55e3947df4cd None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:25:59.534798 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1552c4d-77e3-4b56-892b-55e3947df4cd None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:25:59.544685 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2318ae-4f14-4840-b8c4-a05fb5edd52b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:25:59.545868 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2318ae-4f14-4840-b8c4-a05fb5edd52b admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:25:59.545868 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2318ae-4f14-4840-b8c4-a05fb5edd52b admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:25:59.545868 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2318ae-4f14-4840-b8c4-a05fb5edd52b admin admin] PATH_INFO: `/v3/domains` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:25:59.550147 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2318ae-4f14-4840-b8c4-a05fb5edd52b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:25:59.550147 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2318ae-4f14-4840-b8c4-a05fb5edd52b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:25:59.550147 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2318ae-4f14-4840-b8c4-a05fb5edd52b admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:25:59.568680 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 595/1202] 10.222.0.117 () {56 vars in 1135 bytes} [Tue Jan 25 02:25:59 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:25:59.573178 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500156a3-2945-4415-9eb2-06f57e9cb80d admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:25:59.586692 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500156a3-2945-4415-9eb2-06f57e9cb80d admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:25:59.594528 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3a89db-e8db-46b2-b9fe-781552de7f3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:25:59.595392 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3a89db-e8db-46b2-b9fe-781552de7f3d admin admin] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:25:59.595881 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3a89db-e8db-46b2-b9fe-781552de7f3d admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:25:59.596395 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3a89db-e8db-46b2-b9fe-781552de7f3d admin admin] PATH_INFO: `/v3/users` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:25:59.597423 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3a89db-e8db-46b2-b9fe-781552de7f3d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:25:59.600269 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3a89db-e8db-46b2-b9fe-781552de7f3d admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:25:59.635828 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 608/1203] 10.222.0.117 () {60 vars in 1158 bytes} [Tue Jan 25 02:25:59 2022] POST /identity/v3/users => generated 252 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 02:26:02.381234 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8f482d-5123-43b0-8299-437071a668c2 None None] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:26:02.381234 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8f482d-5123-43b0-8299-437071a668c2 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:26:02.381995 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8f482d-5123-43b0-8299-437071a668c2 None None] PATH_INFO: `/` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:26:02.383640 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 596/1204] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:26:02 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jan 25 02:26:02.389604 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38abccbc-1a74-4794-b4bc-81fec738447b None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:26:02.390979 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38abccbc-1a74-4794-b4bc-81fec738447b None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:26:02.390979 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38abccbc-1a74-4794-b4bc-81fec738447b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:26:02.415439 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-38abccbc-1a74-4794-b4bc-81fec738447b None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:26:02.416747 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-38abccbc-1a74-4794-b4bc-81fec738447b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:26:02.425556 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 609/1205] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:26:02 2022] POST /identity/v3/auth/tokens => generated 2982 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:26:02.450879 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8f482d-5123-43b0-8299-437071a668c2 None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:26:02.468811 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8f482d-5123-43b0-8299-437071a668c2 None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:26:02.475788 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd54949-9451-499a-8f3f-6351dfd7ceb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:26:02.476875 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd54949-9451-499a-8f3f-6351dfd7ceb0 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:26:02.477267 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd54949-9451-499a-8f3f-6351dfd7ceb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:26:02.477640 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd54949-9451-499a-8f3f-6351dfd7ceb0 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:26:02.493594 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd54949-9451-499a-8f3f-6351dfd7ceb0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 25 02:26:02.503055 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: WARNING keystone.server.flask.application [None req-9bd54949-9451-499a-8f3f-6351dfd7ceb0 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 25 02:26:02.507740 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 597/1206] 10.222.0.117 () {56 vars in 1128 bytes} [Tue Jan 25 02:26:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:26:02.510945 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38abccbc-1a74-4794-b4bc-81fec738447b None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:26:02.521441 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38abccbc-1a74-4794-b4bc-81fec738447b None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:26:02.526305 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd175d80-a7ce-41cd-99a1-ac986286dc88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:26:02.526968 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd175d80-a7ce-41cd-99a1-ac986286dc88 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:26:02.527253 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd175d80-a7ce-41cd-99a1-ac986286dc88 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:26:02.527526 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd175d80-a7ce-41cd-99a1-ac986286dc88 admin admin] PATH_INFO: `/v3/roles` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:26:02.528342 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd175d80-a7ce-41cd-99a1-ac986286dc88 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:26:02.528660 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd175d80-a7ce-41cd-99a1-ac986286dc88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:26:02.530280 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd175d80-a7ce-41cd-99a1-ac986286dc88 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:26:02.539472 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 610/1207] 10.222.0.117 () {56 vars in 1129 bytes} [Tue Jan 25 02:26:02 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 02:26:02.545745 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd54949-9451-499a-8f3f-6351dfd7ceb0 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:26:02.555996 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd54949-9451-499a-8f3f-6351dfd7ceb0 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:26:02.561386 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c959a2f-4a15-4a75-9ba8-e891b2eedf45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:26:02.562283 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c959a2f-4a15-4a75-9ba8-e891b2eedf45 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:26:02.562564 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c959a2f-4a15-4a75-9ba8-e891b2eedf45 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:26:02.563487 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c959a2f-4a15-4a75-9ba8-e891b2eedf45 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:26:02.575019 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c959a2f-4a15-4a75-9ba8-e891b2eedf45 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:26:02.577264 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c959a2f-4a15-4a75-9ba8-e891b2eedf45 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:26:02.601639 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: WARNING keystone.server.flask.application [None req-6c959a2f-4a15-4a75-9ba8-e891b2eedf45 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 25 02:26:02.602963 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 598/1208] 10.222.0.117 () {56 vars in 1134 bytes} [Tue Jan 25 02:26:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:26:02.608742 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd175d80-a7ce-41cd-99a1-ac986286dc88 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:26:02.619261 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd175d80-a7ce-41cd-99a1-ac986286dc88 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:26:02.624240 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f554a2c9-c249-4385-89cd-a1911d814f35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:26:02.624970 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f554a2c9-c249-4385-89cd-a1911d814f35 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:26:02.625327 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f554a2c9-c249-4385-89cd-a1911d814f35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:26:02.625677 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f554a2c9-c249-4385-89cd-a1911d814f35 admin admin] PATH_INFO: `/v3/domains` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:26:02.626495 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f554a2c9-c249-4385-89cd-a1911d814f35 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:26:02.626873 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f554a2c9-c249-4385-89cd-a1911d814f35 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:26:02.628596 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f554a2c9-c249-4385-89cd-a1911d814f35 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:26:02.641702 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 611/1209] 10.222.0.117 () {56 vars in 1135 bytes} [Tue Jan 25 02:26:02 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 02:26:02.648241 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c959a2f-4a15-4a75-9ba8-e891b2eedf45 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:26:02.658548 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c959a2f-4a15-4a75-9ba8-e891b2eedf45 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:26:02.665584 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac1c1f1-0b87-4972-aa3a-16719c16836b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:26:02.666384 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac1c1f1-0b87-4972-aa3a-16719c16836b admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:26:02.666664 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac1c1f1-0b87-4972-aa3a-16719c16836b admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:26:02.666939 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac1c1f1-0b87-4972-aa3a-16719c16836b admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:26:02.678909 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac1c1f1-0b87-4972-aa3a-16719c16836b admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:26:02.680309 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac1c1f1-0b87-4972-aa3a-16719c16836b admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:26:02.696216 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: WARNING keystone.server.flask.application [None req-bac1c1f1-0b87-4972-aa3a-16719c16836b admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jan 25 02:26:02.697410 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 599/1210] 10.222.0.117 () {56 vars in 1134 bytes} [Tue Jan 25 02:26:02 2022] GET /identity/v3/users/placement => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:26:02.703660 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f554a2c9-c249-4385-89cd-a1911d814f35 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:26:02.714596 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f554a2c9-c249-4385-89cd-a1911d814f35 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:26:02.719889 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0059642f-2610-43c7-80c9-d56d8bd72610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:26:02.720553 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0059642f-2610-43c7-80c9-d56d8bd72610 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:26:02.720835 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0059642f-2610-43c7-80c9-d56d8bd72610 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:26:02.721120 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0059642f-2610-43c7-80c9-d56d8bd72610 admin admin] PATH_INFO: `/v3/users` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:26:02.722033 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0059642f-2610-43c7-80c9-d56d8bd72610 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:26:02.722306 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0059642f-2610-43c7-80c9-d56d8bd72610 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:26:02.726168 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0059642f-2610-43c7-80c9-d56d8bd72610 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:26:02.743367 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 612/1211] 10.222.0.117 () {56 vars in 1169 bytes} [Tue Jan 25 02:26:02 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 380 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:26:02.749846 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac1c1f1-0b87-4972-aa3a-16719c16836b admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:26:02.762793 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac1c1f1-0b87-4972-aa3a-16719c16836b admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:26:02.769782 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd49fd5-8f73-477f-a2e2-ca65edf67440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:26:02.770890 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd49fd5-8f73-477f-a2e2-ca65edf67440 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:26:02.772006 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd49fd5-8f73-477f-a2e2-ca65edf67440 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:26:02.772686 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd49fd5-8f73-477f-a2e2-ca65edf67440 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:26:02.782016 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd49fd5-8f73-477f-a2e2-ca65edf67440 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:26:02.783866 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd49fd5-8f73-477f-a2e2-ca65edf67440 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:26:02.794198 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 600/1212] 10.222.0.117 () {58 vars in 1329 bytes} [Tue Jan 25 02:26:02 2022] GET /identity/v3/auth/tokens => generated 2982 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:26:02.800205 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0059642f-2610-43c7-80c9-d56d8bd72610 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:26:02.814487 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0059642f-2610-43c7-80c9-d56d8bd72610 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:26:02.822484 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d53767a-b137-4ba9-ac57-b0ff8d544374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:26:02.823857 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d53767a-b137-4ba9-ac57-b0ff8d544374 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:26:02.824350 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d53767a-b137-4ba9-ac57-b0ff8d544374 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:26:02.824826 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d53767a-b137-4ba9-ac57-b0ff8d544374 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:26:02.838997 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d53767a-b137-4ba9-ac57-b0ff8d544374 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:26:02.841048 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d53767a-b137-4ba9-ac57-b0ff8d544374 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:26:02.860813 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: WARNING keystone.server.flask.application [None req-3d53767a-b137-4ba9-ac57-b0ff8d544374 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 25 02:26:02.862182 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 613/1213] 10.222.0.117 () {56 vars in 1134 bytes} [Tue Jan 25 02:26:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:26:02.868862 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd49fd5-8f73-477f-a2e2-ca65edf67440 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:26:02.879116 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd49fd5-8f73-477f-a2e2-ca65edf67440 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:26:02.885207 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea17b65-7a1d-41c3-bd84-c89b025d765a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:26:02.885989 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea17b65-7a1d-41c3-bd84-c89b025d765a admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:26:02.887120 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea17b65-7a1d-41c3-bd84-c89b025d765a admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:26:02.887120 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea17b65-7a1d-41c3-bd84-c89b025d765a admin admin] PATH_INFO: `/v3/domains` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:26:02.887383 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea17b65-7a1d-41c3-bd84-c89b025d765a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:26:02.887636 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea17b65-7a1d-41c3-bd84-c89b025d765a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:26:02.889530 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea17b65-7a1d-41c3-bd84-c89b025d765a admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:26:02.903380 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 601/1214] 10.222.0.117 () {56 vars in 1135 bytes} [Tue Jan 25 02:26:02 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 02:26:02.909456 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d53767a-b137-4ba9-ac57-b0ff8d544374 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:26:02.921483 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d53767a-b137-4ba9-ac57-b0ff8d544374 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:26:02.927624 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f79cfb8-18ce-469a-a0b9-1a4bd2d95af7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:26:02.928760 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f79cfb8-18ce-469a-a0b9-1a4bd2d95af7 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:26:02.929081 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f79cfb8-18ce-469a-a0b9-1a4bd2d95af7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:26:02.929408 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f79cfb8-18ce-469a-a0b9-1a4bd2d95af7 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:26:02.938525 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f79cfb8-18ce-469a-a0b9-1a4bd2d95af7 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:26:02.940846 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f79cfb8-18ce-469a-a0b9-1a4bd2d95af7 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:26:02.956802 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: WARNING keystone.server.flask.application [None req-7f79cfb8-18ce-469a-a0b9-1a4bd2d95af7 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 25 02:26:02.958210 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 614/1215] 10.222.0.117 () {56 vars in 1137 bytes} [Tue Jan 25 02:26:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:26:02.964654 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea17b65-7a1d-41c3-bd84-c89b025d765a admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:26:02.976073 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea17b65-7a1d-41c3-bd84-c89b025d765a admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:26:02.981227 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90798b23-54f0-402a-ad8b-1211131ff4ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:26:02.981896 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90798b23-54f0-402a-ad8b-1211131ff4ac admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:26:02.982295 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90798b23-54f0-402a-ad8b-1211131ff4ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:26:02.982541 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90798b23-54f0-402a-ad8b-1211131ff4ac admin admin] PATH_INFO: `/v3/projects` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:26:02.983507 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90798b23-54f0-402a-ad8b-1211131ff4ac admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:26:02.983969 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90798b23-54f0-402a-ad8b-1211131ff4ac admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:26:02.985941 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90798b23-54f0-402a-ad8b-1211131ff4ac admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:26:03.008355 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 602/1216] 10.222.0.117 () {56 vars in 1174 bytes} [Tue Jan 25 02:26:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:26:03.009475 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f79cfb8-18ce-469a-a0b9-1a4bd2d95af7 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:26:03.022122 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f79cfb8-18ce-469a-a0b9-1a4bd2d95af7 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:26:03.027277 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94507bd3-dd52-4a46-bf78-817e58946d5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:26:03.028047 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94507bd3-dd52-4a46-bf78-817e58946d5d admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:26:03.028396 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94507bd3-dd52-4a46-bf78-817e58946d5d admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:26:03.028753 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94507bd3-dd52-4a46-bf78-817e58946d5d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:26:03.029657 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94507bd3-dd52-4a46-bf78-817e58946d5d admin admin] RBAC: Adding query filter params (role.id=8e4691cb5a4b4439b9712d27ef133c20, scope.project.id=61a6fe9d4c914755bb0a64c392bd16aa, user.id=890151a6bf2840f0a0a00f45dd2d38a4) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:26:03.029970 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94507bd3-dd52-4a46-bf78-817e58946d5d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:26:03.031852 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94507bd3-dd52-4a46-bf78-817e58946d5d admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:26:03.038605 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 615/1217] 10.222.0.117 () {56 vars in 1400 bytes} [Tue Jan 25 02:26:03 2022] GET /identity/v3/role_assignments?user.id=890151a6bf2840f0a0a00f45dd2d38a4&scope.project.id=61a6fe9d4c914755bb0a64c392bd16aa&role.id=8e4691cb5a4b4439b9712d27ef133c20 => generated 260 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 02:26:05.419497 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17709bb-9911-4d0f-a048-c705d9943123 None None] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:26:05.420075 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17709bb-9911-4d0f-a048-c705d9943123 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:26:05.420075 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17709bb-9911-4d0f-a048-c705d9943123 None None] PATH_INFO: `/` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:26:05.421989 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 603/1218] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:26:05 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:26:05.427009 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24b227e-17af-4dd1-a0e7-fcc278845abf None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:26:05.427445 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24b227e-17af-4dd1-a0e7-fcc278845abf None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:26:05.427620 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24b227e-17af-4dd1-a0e7-fcc278845abf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:26:05.445485 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-e24b227e-17af-4dd1-a0e7-fcc278845abf None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:26:05.446673 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-e24b227e-17af-4dd1-a0e7-fcc278845abf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:26:05.454542 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 616/1219] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:26:05 2022] POST /identity/v3/auth/tokens => generated 2982 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:26:05.479836 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17709bb-9911-4d0f-a048-c705d9943123 None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:26:05.492875 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17709bb-9911-4d0f-a048-c705d9943123 None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:26:05.497706 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2786e6-8d19-4da7-bfea-0202bfebdbb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:26:05.498567 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2786e6-8d19-4da7-bfea-0202bfebdbb8 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:26:05.498854 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2786e6-8d19-4da7-bfea-0202bfebdbb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:26:05.499132 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2786e6-8d19-4da7-bfea-0202bfebdbb8 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:26:05.510569 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2786e6-8d19-4da7-bfea-0202bfebdbb8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 25 02:26:05.518147 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: WARNING keystone.server.flask.application [None req-2a2786e6-8d19-4da7-bfea-0202bfebdbb8 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 25 02:26:05.523881 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 604/1220] 10.222.0.117 () {56 vars in 1128 bytes} [Tue Jan 25 02:26:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:26:05.526236 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24b227e-17af-4dd1-a0e7-fcc278845abf None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:26:05.536075 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24b227e-17af-4dd1-a0e7-fcc278845abf None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:26:05.542162 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31bbe26-1d44-4419-8fb4-040481717e0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:26:05.542938 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31bbe26-1d44-4419-8fb4-040481717e0f admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:26:05.543227 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31bbe26-1d44-4419-8fb4-040481717e0f admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:26:05.543518 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31bbe26-1d44-4419-8fb4-040481717e0f admin admin] PATH_INFO: `/v3/roles` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:26:05.544444 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31bbe26-1d44-4419-8fb4-040481717e0f admin admin] RBAC: Adding query filter params (name=service) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:26:05.544810 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31bbe26-1d44-4419-8fb4-040481717e0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:26:05.546559 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31bbe26-1d44-4419-8fb4-040481717e0f admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:26:05.555796 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 617/1221] 10.222.0.117 () {56 vars in 1129 bytes} [Tue Jan 25 02:26:05 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:26:05.562195 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2786e6-8d19-4da7-bfea-0202bfebdbb8 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:26:05.574611 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2786e6-8d19-4da7-bfea-0202bfebdbb8 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:26:05.579551 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f7c375-3421-43d1-8697-6fe638069a43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:26:05.580379 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f7c375-3421-43d1-8697-6fe638069a43 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:26:05.580711 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f7c375-3421-43d1-8697-6fe638069a43 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:26:05.580935 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f7c375-3421-43d1-8697-6fe638069a43 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:26:05.594158 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f7c375-3421-43d1-8697-6fe638069a43 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:26:05.596567 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f7c375-3421-43d1-8697-6fe638069a43 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:26:05.615332 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: WARNING keystone.server.flask.application [None req-17f7c375-3421-43d1-8697-6fe638069a43 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 25 02:26:05.616723 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 605/1222] 10.222.0.117 () {56 vars in 1134 bytes} [Tue Jan 25 02:26:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 25 02:26:05.622831 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31bbe26-1d44-4419-8fb4-040481717e0f admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:26:05.635337 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31bbe26-1d44-4419-8fb4-040481717e0f admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:26:05.640852 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea3eefa-ae17-4a14-91fa-a74cafe220f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:26:05.641581 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea3eefa-ae17-4a14-91fa-a74cafe220f9 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:26:05.641935 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea3eefa-ae17-4a14-91fa-a74cafe220f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:26:05.642288 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea3eefa-ae17-4a14-91fa-a74cafe220f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:26:05.643108 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea3eefa-ae17-4a14-91fa-a74cafe220f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:26:05.643417 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea3eefa-ae17-4a14-91fa-a74cafe220f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:26:05.645057 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea3eefa-ae17-4a14-91fa-a74cafe220f9 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:26:05.657578 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 618/1223] 10.222.0.117 () {56 vars in 1135 bytes} [Tue Jan 25 02:26:05 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 02:26:05.664144 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f7c375-3421-43d1-8697-6fe638069a43 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:26:05.675101 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f7c375-3421-43d1-8697-6fe638069a43 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:26:05.681285 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3823b3a0-93c8-4bdc-9e4c-376384d50982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:26:05.682207 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3823b3a0-93c8-4bdc-9e4c-376384d50982 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:26:05.682486 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3823b3a0-93c8-4bdc-9e4c-376384d50982 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:26:05.682749 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3823b3a0-93c8-4bdc-9e4c-376384d50982 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:26:05.692064 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3823b3a0-93c8-4bdc-9e4c-376384d50982 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:26:05.694572 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3823b3a0-93c8-4bdc-9e4c-376384d50982 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:26:05.709920 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: WARNING keystone.server.flask.application [None req-3823b3a0-93c8-4bdc-9e4c-376384d50982 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jan 25 02:26:05.711110 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 606/1224] 10.222.0.117 () {56 vars in 1134 bytes} [Tue Jan 25 02:26:05 2022] GET /identity/v3/users/placement => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:26:05.716925 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea3eefa-ae17-4a14-91fa-a74cafe220f9 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:26:05.728614 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea3eefa-ae17-4a14-91fa-a74cafe220f9 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:26:05.734197 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba30dbd-37d7-41ac-b014-eab71a63c6ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:26:05.734868 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba30dbd-37d7-41ac-b014-eab71a63c6ab admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:26:05.735203 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba30dbd-37d7-41ac-b014-eab71a63c6ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:26:05.735480 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba30dbd-37d7-41ac-b014-eab71a63c6ab admin admin] PATH_INFO: `/v3/users` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:26:05.736514 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba30dbd-37d7-41ac-b014-eab71a63c6ab admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:26:05.736880 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba30dbd-37d7-41ac-b014-eab71a63c6ab admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:26:05.739124 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba30dbd-37d7-41ac-b014-eab71a63c6ab admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:26:05.765540 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 619/1225] 10.222.0.117 () {56 vars in 1169 bytes} [Tue Jan 25 02:26:05 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 380 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:26:05.766901 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3823b3a0-93c8-4bdc-9e4c-376384d50982 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:26:05.778160 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3823b3a0-93c8-4bdc-9e4c-376384d50982 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:26:05.783866 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd445d7-e3d1-48c1-88bf-80a1e746b684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:26:05.784654 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd445d7-e3d1-48c1-88bf-80a1e746b684 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:26:05.784935 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd445d7-e3d1-48c1-88bf-80a1e746b684 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:26:05.785210 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd445d7-e3d1-48c1-88bf-80a1e746b684 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:26:05.796204 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd445d7-e3d1-48c1-88bf-80a1e746b684 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:26:05.798039 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd445d7-e3d1-48c1-88bf-80a1e746b684 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:26:05.815682 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: WARNING keystone.server.flask.application [None req-7fd445d7-e3d1-48c1-88bf-80a1e746b684 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 25 02:26:05.817103 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 607/1226] 10.222.0.117 () {56 vars in 1134 bytes} [Tue Jan 25 02:26:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:26:05.824258 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba30dbd-37d7-41ac-b014-eab71a63c6ab admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:26:05.836024 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba30dbd-37d7-41ac-b014-eab71a63c6ab admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:26:05.841345 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c061fe-0ec9-4a86-9b33-135d5dfcba63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:26:05.842917 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c061fe-0ec9-4a86-9b33-135d5dfcba63 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:26:05.843474 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c061fe-0ec9-4a86-9b33-135d5dfcba63 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:26:05.844237 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c061fe-0ec9-4a86-9b33-135d5dfcba63 admin admin] PATH_INFO: `/v3/domains` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:26:05.845609 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c061fe-0ec9-4a86-9b33-135d5dfcba63 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:26:05.846116 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c061fe-0ec9-4a86-9b33-135d5dfcba63 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:26:05.848050 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c061fe-0ec9-4a86-9b33-135d5dfcba63 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:26:05.862320 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 620/1227] 10.222.0.117 () {56 vars in 1135 bytes} [Tue Jan 25 02:26:05 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:26:05.868147 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd445d7-e3d1-48c1-88bf-80a1e746b684 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:26:05.879633 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd445d7-e3d1-48c1-88bf-80a1e746b684 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:26:05.887291 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b80eb3c-8a41-4a6e-9c11-4b54c42b7e13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:26:05.888218 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b80eb3c-8a41-4a6e-9c11-4b54c42b7e13 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:26:05.888562 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b80eb3c-8a41-4a6e-9c11-4b54c42b7e13 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:26:05.888868 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b80eb3c-8a41-4a6e-9c11-4b54c42b7e13 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:26:05.898655 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b80eb3c-8a41-4a6e-9c11-4b54c42b7e13 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:26:05.900698 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b80eb3c-8a41-4a6e-9c11-4b54c42b7e13 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:26:05.918418 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: WARNING keystone.server.flask.application [None req-0b80eb3c-8a41-4a6e-9c11-4b54c42b7e13 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 25 02:26:05.919779 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 608/1228] 10.222.0.117 () {56 vars in 1137 bytes} [Tue Jan 25 02:26:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:26:05.927091 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c061fe-0ec9-4a86-9b33-135d5dfcba63 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:26:05.939890 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c061fe-0ec9-4a86-9b33-135d5dfcba63 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:26:05.947733 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0464e05c-2458-4e32-b883-43ac98f35ae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:26:05.947733 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0464e05c-2458-4e32-b883-43ac98f35ae9 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:26:05.947733 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0464e05c-2458-4e32-b883-43ac98f35ae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:26:05.947733 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0464e05c-2458-4e32-b883-43ac98f35ae9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:26:05.948872 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0464e05c-2458-4e32-b883-43ac98f35ae9 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:26:05.949209 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0464e05c-2458-4e32-b883-43ac98f35ae9 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:26:05.951457 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0464e05c-2458-4e32-b883-43ac98f35ae9 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:26:05.966591 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 621/1229] 10.222.0.117 () {56 vars in 1174 bytes} [Tue Jan 25 02:26:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:26:05.979747 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b80eb3c-8a41-4a6e-9c11-4b54c42b7e13 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:26:05.985946 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b80eb3c-8a41-4a6e-9c11-4b54c42b7e13 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:26:05.992313 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbee5f0-16a8-4739-bb8d-c14d4313fa49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:26:05.993318 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbee5f0-16a8-4739-bb8d-c14d4313fa49 admin admin] REQUEST_METHOD: `PUT` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:26:05.993670 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbee5f0-16a8-4739-bb8d-c14d4313fa49 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:26:05.993979 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbee5f0-16a8-4739-bb8d-c14d4313fa49 admin admin] PATH_INFO: `/v3/projects/61a6fe9d4c914755bb0a64c392bd16aa/users/890151a6bf2840f0a0a00f45dd2d38a4/roles/8e4691cb5a4b4439b9712d27ef133c20` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:26:06.015362 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbee5f0-16a8-4739-bb8d-c14d4313fa49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=61a6fe9d4c914755bb0a64c392bd16aa, user_id=890151a6bf2840f0a0a00f45dd2d38a4, role_id=8e4691cb5a4b4439b9712d27ef133c20)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:26:06.019295 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbee5f0-16a8-4739-bb8d-c14d4313fa49 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:26:06.037324 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 609/1230] 10.222.0.117 () {58 vars in 1465 bytes} [Tue Jan 25 02:26:05 2022] PUT /identity/v3/projects/61a6fe9d4c914755bb0a64c392bd16aa/users/890151a6bf2840f0a0a00f45dd2d38a4/roles/8e4691cb5a4b4439b9712d27ef133c20 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:26:08.365908 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfedf47-7a03-459e-b755-0441fa6ff4ea None None] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:26:08.366533 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfedf47-7a03-459e-b755-0441fa6ff4ea None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:26:08.366618 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfedf47-7a03-459e-b755-0441fa6ff4ea None None] PATH_INFO: `/` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:26:08.368594 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 622/1231] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:26:08 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:26:08.375893 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6732febd-bb6e-4851-b939-83c090bcd7b5 None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:26:08.376476 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6732febd-bb6e-4851-b939-83c090bcd7b5 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:26:08.376476 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6732febd-bb6e-4851-b939-83c090bcd7b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:26:08.396876 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-6732febd-bb6e-4851-b939-83c090bcd7b5 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:26:08.398163 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-6732febd-bb6e-4851-b939-83c090bcd7b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:26:08.460705 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 610/1232] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:26:08 2022] POST /identity/v3/auth/tokens => generated 2982 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:26:08.487345 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfedf47-7a03-459e-b755-0441fa6ff4ea None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:26:08.501957 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfedf47-7a03-459e-b755-0441fa6ff4ea None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:26:08.508012 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201bba91-9302-4bd4-aaa4-4c5e9c97d046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:26:08.508800 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201bba91-9302-4bd4-aaa4-4c5e9c97d046 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:26:08.509084 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201bba91-9302-4bd4-aaa4-4c5e9c97d046 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:26:08.509359 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201bba91-9302-4bd4-aaa4-4c5e9c97d046 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:26:08.521606 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201bba91-9302-4bd4-aaa4-4c5e9c97d046 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 25 02:26:08.529447 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: WARNING keystone.server.flask.application [None req-201bba91-9302-4bd4-aaa4-4c5e9c97d046 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 25 02:26:08.531037 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 623/1233] 10.222.0.117 () {56 vars in 1128 bytes} [Tue Jan 25 02:26:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:26:08.538642 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6732febd-bb6e-4851-b939-83c090bcd7b5 None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:26:08.548926 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6732febd-bb6e-4851-b939-83c090bcd7b5 None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:26:08.554764 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ff297d-8f2c-4528-a303-fde755066f82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:26:08.555546 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ff297d-8f2c-4528-a303-fde755066f82 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:26:08.555918 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ff297d-8f2c-4528-a303-fde755066f82 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:26:08.556261 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ff297d-8f2c-4528-a303-fde755066f82 admin admin] PATH_INFO: `/v3/roles` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:26:08.557138 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ff297d-8f2c-4528-a303-fde755066f82 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:26:08.557554 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ff297d-8f2c-4528-a303-fde755066f82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:26:08.559327 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ff297d-8f2c-4528-a303-fde755066f82 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:26:08.568999 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 611/1234] 10.222.0.117 () {56 vars in 1129 bytes} [Tue Jan 25 02:26:08 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:26:08.575254 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201bba91-9302-4bd4-aaa4-4c5e9c97d046 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:26:08.587157 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201bba91-9302-4bd4-aaa4-4c5e9c97d046 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:26:08.592825 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f5bce6-7ae6-43bd-b3b7-efa997d21b71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:26:08.593605 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f5bce6-7ae6-43bd-b3b7-efa997d21b71 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:26:08.593892 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f5bce6-7ae6-43bd-b3b7-efa997d21b71 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:26:08.594164 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f5bce6-7ae6-43bd-b3b7-efa997d21b71 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:26:08.607060 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f5bce6-7ae6-43bd-b3b7-efa997d21b71 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:26:08.609185 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f5bce6-7ae6-43bd-b3b7-efa997d21b71 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:26:08.627516 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: WARNING keystone.server.flask.application [None req-74f5bce6-7ae6-43bd-b3b7-efa997d21b71 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 25 02:26:08.634151 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 624/1235] 10.222.0.117 () {56 vars in 1134 bytes} [Tue Jan 25 02:26:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 25 02:26:08.635354 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ff297d-8f2c-4528-a303-fde755066f82 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:26:08.645859 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ff297d-8f2c-4528-a303-fde755066f82 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:26:08.651495 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32a0cbe-d301-4e49-8671-bee7dd1798d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:26:08.652203 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32a0cbe-d301-4e49-8671-bee7dd1798d8 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:26:08.652537 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32a0cbe-d301-4e49-8671-bee7dd1798d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:26:08.652843 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32a0cbe-d301-4e49-8671-bee7dd1798d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:26:08.653702 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32a0cbe-d301-4e49-8671-bee7dd1798d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:26:08.654010 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32a0cbe-d301-4e49-8671-bee7dd1798d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:26:08.655645 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32a0cbe-d301-4e49-8671-bee7dd1798d8 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:26:08.668608 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 612/1236] 10.222.0.117 () {56 vars in 1135 bytes} [Tue Jan 25 02:26:08 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:26:08.676229 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f5bce6-7ae6-43bd-b3b7-efa997d21b71 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:26:08.688336 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f5bce6-7ae6-43bd-b3b7-efa997d21b71 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:26:08.694445 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29e6308-0652-4643-8227-1f641123caa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:26:08.695408 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29e6308-0652-4643-8227-1f641123caa9 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:26:08.695728 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29e6308-0652-4643-8227-1f641123caa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:26:08.696001 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29e6308-0652-4643-8227-1f641123caa9 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:26:08.704593 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29e6308-0652-4643-8227-1f641123caa9 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:26:08.706806 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29e6308-0652-4643-8227-1f641123caa9 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:26:08.724042 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: WARNING keystone.server.flask.application [None req-a29e6308-0652-4643-8227-1f641123caa9 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jan 25 02:26:08.725635 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 625/1237] 10.222.0.117 () {56 vars in 1134 bytes} [Tue Jan 25 02:26:08 2022] GET /identity/v3/users/placement => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:26:08.731803 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32a0cbe-d301-4e49-8671-bee7dd1798d8 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:26:08.742033 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32a0cbe-d301-4e49-8671-bee7dd1798d8 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:26:08.747205 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536c03be-5631-4ed8-b644-0b08e5f4047e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:26:08.747934 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536c03be-5631-4ed8-b644-0b08e5f4047e admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:26:08.748267 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536c03be-5631-4ed8-b644-0b08e5f4047e admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:26:08.748614 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536c03be-5631-4ed8-b644-0b08e5f4047e admin admin] PATH_INFO: `/v3/users` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:26:08.749644 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536c03be-5631-4ed8-b644-0b08e5f4047e admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:26:08.750010 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536c03be-5631-4ed8-b644-0b08e5f4047e admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:26:08.752091 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536c03be-5631-4ed8-b644-0b08e5f4047e admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:26:08.771533 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 613/1238] 10.222.0.117 () {56 vars in 1169 bytes} [Tue Jan 25 02:26:08 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 380 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:26:08.777766 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29e6308-0652-4643-8227-1f641123caa9 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:26:08.789520 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29e6308-0652-4643-8227-1f641123caa9 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:26:08.795118 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3bd400-e81d-4f78-8f0e-21292c5f23d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:26:08.795798 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3bd400-e81d-4f78-8f0e-21292c5f23d2 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:26:08.796251 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3bd400-e81d-4f78-8f0e-21292c5f23d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:26:08.796536 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3bd400-e81d-4f78-8f0e-21292c5f23d2 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:26:08.806172 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3bd400-e81d-4f78-8f0e-21292c5f23d2 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:26:08.808155 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3bd400-e81d-4f78-8f0e-21292c5f23d2 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:26:08.820743 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 626/1239] 10.222.0.117 () {58 vars in 1329 bytes} [Tue Jan 25 02:26:08 2022] GET /identity/v3/auth/tokens => generated 2982 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:26:08.826687 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536c03be-5631-4ed8-b644-0b08e5f4047e admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:26:08.837803 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536c03be-5631-4ed8-b644-0b08e5f4047e admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:26:08.843161 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b08f783-8ee4-4353-8490-9041148ea4a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:26:08.843983 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b08f783-8ee4-4353-8490-9041148ea4a0 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:26:08.844273 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b08f783-8ee4-4353-8490-9041148ea4a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:26:08.844550 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b08f783-8ee4-4353-8490-9041148ea4a0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:26:08.855234 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b08f783-8ee4-4353-8490-9041148ea4a0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:26:08.857103 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b08f783-8ee4-4353-8490-9041148ea4a0 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:26:08.875740 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: WARNING keystone.server.flask.application [None req-9b08f783-8ee4-4353-8490-9041148ea4a0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 25 02:26:08.876935 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 614/1240] 10.222.0.117 () {56 vars in 1134 bytes} [Tue Jan 25 02:26:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:26:08.883311 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3bd400-e81d-4f78-8f0e-21292c5f23d2 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:26:08.892245 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3bd400-e81d-4f78-8f0e-21292c5f23d2 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:26:08.897540 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7ff7d6-fc2d-4e69-87c3-c4626cd46714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:26:08.898202 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7ff7d6-fc2d-4e69-87c3-c4626cd46714 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:26:08.898486 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7ff7d6-fc2d-4e69-87c3-c4626cd46714 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:26:08.898763 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7ff7d6-fc2d-4e69-87c3-c4626cd46714 admin admin] PATH_INFO: `/v3/domains` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:26:08.899495 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7ff7d6-fc2d-4e69-87c3-c4626cd46714 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:26:08.899979 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7ff7d6-fc2d-4e69-87c3-c4626cd46714 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:26:08.901584 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7ff7d6-fc2d-4e69-87c3-c4626cd46714 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:26:08.913518 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 627/1241] 10.222.0.117 () {56 vars in 1135 bytes} [Tue Jan 25 02:26:08 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:26:08.919333 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b08f783-8ee4-4353-8490-9041148ea4a0 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:26:08.932165 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b08f783-8ee4-4353-8490-9041148ea4a0 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:26:08.938271 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9cf409-2f72-4f77-8656-be981952473a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:26:08.939078 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9cf409-2f72-4f77-8656-be981952473a admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:26:08.939456 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9cf409-2f72-4f77-8656-be981952473a admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:26:08.939844 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9cf409-2f72-4f77-8656-be981952473a admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:26:08.949785 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9cf409-2f72-4f77-8656-be981952473a admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:26:08.952058 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9cf409-2f72-4f77-8656-be981952473a admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:26:08.967234 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: WARNING keystone.server.flask.application [None req-cb9cf409-2f72-4f77-8656-be981952473a admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 25 02:26:08.968637 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 615/1242] 10.222.0.117 () {56 vars in 1137 bytes} [Tue Jan 25 02:26:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:26:08.975147 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7ff7d6-fc2d-4e69-87c3-c4626cd46714 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:26:08.985057 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7ff7d6-fc2d-4e69-87c3-c4626cd46714 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:26:08.991543 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be777bd-2bb2-413c-a004-7da2e7bdaf80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:26:08.992284 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be777bd-2bb2-413c-a004-7da2e7bdaf80 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:26:08.992643 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be777bd-2bb2-413c-a004-7da2e7bdaf80 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:26:08.993002 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be777bd-2bb2-413c-a004-7da2e7bdaf80 admin admin] PATH_INFO: `/v3/projects` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:26:08.993898 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be777bd-2bb2-413c-a004-7da2e7bdaf80 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:26:08.994273 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be777bd-2bb2-413c-a004-7da2e7bdaf80 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:26:08.996646 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be777bd-2bb2-413c-a004-7da2e7bdaf80 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:26:09.011233 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 628/1243] 10.222.0.117 () {56 vars in 1174 bytes} [Tue Jan 25 02:26:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:26:09.017403 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9cf409-2f72-4f77-8656-be981952473a admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:26:09.030136 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9cf409-2f72-4f77-8656-be981952473a admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:26:09.035367 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ccf471-e7a7-4754-9c61-cab0d7825696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:26:09.036087 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ccf471-e7a7-4754-9c61-cab0d7825696 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:26:09.036478 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ccf471-e7a7-4754-9c61-cab0d7825696 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:26:09.037407 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ccf471-e7a7-4754-9c61-cab0d7825696 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:26:09.038345 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ccf471-e7a7-4754-9c61-cab0d7825696 admin admin] RBAC: Adding query filter params (role.id=8e4691cb5a4b4439b9712d27ef133c20, scope.project.id=61a6fe9d4c914755bb0a64c392bd16aa, user.id=890151a6bf2840f0a0a00f45dd2d38a4) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:26:09.038678 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ccf471-e7a7-4754-9c61-cab0d7825696 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:26:09.040802 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ccf471-e7a7-4754-9c61-cab0d7825696 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:26:09.047199 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 616/1244] 10.222.0.117 () {56 vars in 1400 bytes} [Tue Jan 25 02:26:09 2022] GET /identity/v3/role_assignments?user.id=890151a6bf2840f0a0a00f45dd2d38a4&scope.project.id=61a6fe9d4c914755bb0a64c392bd16aa&role.id=8e4691cb5a4b4439b9712d27ef133c20 => generated 610 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:26:11.377737 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1df0b4-c8ba-46ef-ad8c-eb93ca7a202c None None] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:26:11.378291 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1df0b4-c8ba-46ef-ad8c-eb93ca7a202c None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:26:11.378399 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1df0b4-c8ba-46ef-ad8c-eb93ca7a202c None None] PATH_INFO: `/` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:26:11.380364 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 629/1245] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:26:11 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:26:11.388768 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1ae764-b732-42f9-8276-317409fad7ab None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:26:11.389403 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1ae764-b732-42f9-8276-317409fad7ab None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:26:11.389403 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1ae764-b732-42f9-8276-317409fad7ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:26:11.408713 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-5d1ae764-b732-42f9-8276-317409fad7ab None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:26:11.409971 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-5d1ae764-b732-42f9-8276-317409fad7ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:26:11.419112 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 617/1246] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:26:11 2022] POST /identity/v3/auth/tokens => generated 2982 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:26:11.445043 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1df0b4-c8ba-46ef-ad8c-eb93ca7a202c None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:26:11.459546 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1df0b4-c8ba-46ef-ad8c-eb93ca7a202c None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:26:11.464871 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a42508-658d-4b09-b728-95076dd68721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:26:11.465655 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a42508-658d-4b09-b728-95076dd68721 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:26:11.465937 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a42508-658d-4b09-b728-95076dd68721 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:26:11.466277 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a42508-658d-4b09-b728-95076dd68721 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:26:11.478865 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a42508-658d-4b09-b728-95076dd68721 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 25 02:26:11.486382 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: WARNING keystone.server.flask.application [None req-33a42508-658d-4b09-b728-95076dd68721 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 25 02:26:11.487752 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 630/1247] 10.222.0.117 () {56 vars in 1122 bytes} [Tue Jan 25 02:26:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:26:11.495399 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1ae764-b732-42f9-8276-317409fad7ab None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:26:11.505988 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1ae764-b732-42f9-8276-317409fad7ab None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:26:11.511621 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a56e717-43f3-472a-82e9-6e88d0f0e9f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:26:11.512810 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a56e717-43f3-472a-82e9-6e88d0f0e9f3 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:26:11.513158 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a56e717-43f3-472a-82e9-6e88d0f0e9f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:26:11.513507 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a56e717-43f3-472a-82e9-6e88d0f0e9f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:26:11.514342 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a56e717-43f3-472a-82e9-6e88d0f0e9f3 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:26:11.514646 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a56e717-43f3-472a-82e9-6e88d0f0e9f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:26:11.516979 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a56e717-43f3-472a-82e9-6e88d0f0e9f3 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:26:11.532550 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 618/1248] 10.222.0.117 () {56 vars in 1125 bytes} [Tue Jan 25 02:26:11 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 02:26:11.541998 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a42508-658d-4b09-b728-95076dd68721 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:26:11.557629 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a42508-658d-4b09-b728-95076dd68721 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:26:11.565565 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ff51a7-5c8c-4557-ab16-720f7ec8655a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:26:11.566548 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ff51a7-5c8c-4557-ab16-720f7ec8655a admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:26:11.566839 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ff51a7-5c8c-4557-ab16-720f7ec8655a admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:26:11.567336 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ff51a7-5c8c-4557-ab16-720f7ec8655a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:26:11.580341 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ff51a7-5c8c-4557-ab16-720f7ec8655a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:26:11.582427 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ff51a7-5c8c-4557-ab16-720f7ec8655a admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:26:11.603579 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: WARNING keystone.server.flask.application [None req-52ff51a7-5c8c-4557-ab16-720f7ec8655a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 25 02:26:11.604834 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 631/1249] 10.222.0.117 () {56 vars in 1134 bytes} [Tue Jan 25 02:26:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:26:11.611859 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a56e717-43f3-472a-82e9-6e88d0f0e9f3 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:26:11.621878 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a56e717-43f3-472a-82e9-6e88d0f0e9f3 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:26:11.626515 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83af9223-efbc-4e44-b3b9-d147ee2934a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:26:11.627134 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83af9223-efbc-4e44-b3b9-d147ee2934a5 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:26:11.627422 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83af9223-efbc-4e44-b3b9-d147ee2934a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:26:11.627891 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83af9223-efbc-4e44-b3b9-d147ee2934a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:26:11.628479 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83af9223-efbc-4e44-b3b9-d147ee2934a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:26:11.628783 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83af9223-efbc-4e44-b3b9-d147ee2934a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:26:11.630922 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83af9223-efbc-4e44-b3b9-d147ee2934a5 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:26:11.643253 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 619/1250] 10.222.0.117 () {56 vars in 1135 bytes} [Tue Jan 25 02:26:11 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 02:26:11.651252 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ff51a7-5c8c-4557-ab16-720f7ec8655a admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:26:11.664155 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ff51a7-5c8c-4557-ab16-720f7ec8655a admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:26:11.670833 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9774fbb-7143-4aaa-9859-bd2ebf4141f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:26:11.672095 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9774fbb-7143-4aaa-9859-bd2ebf4141f1 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:26:11.672555 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9774fbb-7143-4aaa-9859-bd2ebf4141f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:26:11.672862 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9774fbb-7143-4aaa-9859-bd2ebf4141f1 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:26:11.682866 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9774fbb-7143-4aaa-9859-bd2ebf4141f1 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:26:11.685580 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9774fbb-7143-4aaa-9859-bd2ebf4141f1 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:26:11.701808 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: WARNING keystone.server.flask.application [None req-f9774fbb-7143-4aaa-9859-bd2ebf4141f1 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jan 25 02:26:11.703239 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 632/1251] 10.222.0.117 () {56 vars in 1134 bytes} [Tue Jan 25 02:26:11 2022] GET /identity/v3/users/placement => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:26:11.710248 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83af9223-efbc-4e44-b3b9-d147ee2934a5 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:26:11.723457 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83af9223-efbc-4e44-b3b9-d147ee2934a5 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:26:11.729040 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa1448d-a7f7-4119-969c-584ff96448d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:26:11.729714 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa1448d-a7f7-4119-969c-584ff96448d2 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:26:11.729977 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa1448d-a7f7-4119-969c-584ff96448d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:26:11.730332 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa1448d-a7f7-4119-969c-584ff96448d2 admin admin] PATH_INFO: `/v3/users` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:26:11.731443 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa1448d-a7f7-4119-969c-584ff96448d2 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:26:11.731780 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa1448d-a7f7-4119-969c-584ff96448d2 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:26:11.733626 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa1448d-a7f7-4119-969c-584ff96448d2 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:26:11.754824 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 620/1252] 10.222.0.117 () {56 vars in 1169 bytes} [Tue Jan 25 02:26:11 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 380 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:26:11.761077 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9774fbb-7143-4aaa-9859-bd2ebf4141f1 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:26:11.771416 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9774fbb-7143-4aaa-9859-bd2ebf4141f1 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:26:11.777582 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291e5097-e395-4563-b4d2-a20953053fdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:26:11.778540 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291e5097-e395-4563-b4d2-a20953053fdb admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:26:11.778900 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291e5097-e395-4563-b4d2-a20953053fdb admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:26:11.779294 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291e5097-e395-4563-b4d2-a20953053fdb admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:26:11.790042 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291e5097-e395-4563-b4d2-a20953053fdb admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:26:11.792275 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291e5097-e395-4563-b4d2-a20953053fdb admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:26:11.804532 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 633/1253] 10.222.0.117 () {58 vars in 1329 bytes} [Tue Jan 25 02:26:11 2022] GET /identity/v3/auth/tokens => generated 2982 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:26:11.811878 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa1448d-a7f7-4119-969c-584ff96448d2 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:26:11.832058 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa1448d-a7f7-4119-969c-584ff96448d2 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:26:11.838519 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a48e6cc-fcd3-4c9a-9283-7bc001f665aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:26:11.839533 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a48e6cc-fcd3-4c9a-9283-7bc001f665aa admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:26:11.839893 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a48e6cc-fcd3-4c9a-9283-7bc001f665aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:26:11.840174 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a48e6cc-fcd3-4c9a-9283-7bc001f665aa admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:26:11.852804 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a48e6cc-fcd3-4c9a-9283-7bc001f665aa admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:26:11.854860 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a48e6cc-fcd3-4c9a-9283-7bc001f665aa admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:26:11.876259 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: WARNING keystone.server.flask.application [None req-4a48e6cc-fcd3-4c9a-9283-7bc001f665aa admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 25 02:26:11.877851 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 621/1254] 10.222.0.117 () {56 vars in 1134 bytes} [Tue Jan 25 02:26:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:26:11.885023 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291e5097-e395-4563-b4d2-a20953053fdb admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:26:11.895340 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291e5097-e395-4563-b4d2-a20953053fdb admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:26:11.900496 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da7eb31-9b76-4511-8900-3443629a12c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:26:11.901122 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da7eb31-9b76-4511-8900-3443629a12c7 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:26:11.901444 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da7eb31-9b76-4511-8900-3443629a12c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:26:11.901681 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da7eb31-9b76-4511-8900-3443629a12c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:26:11.902423 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da7eb31-9b76-4511-8900-3443629a12c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:26:11.902733 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da7eb31-9b76-4511-8900-3443629a12c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:26:11.904405 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da7eb31-9b76-4511-8900-3443629a12c7 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:26:11.918909 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 634/1255] 10.222.0.117 () {56 vars in 1135 bytes} [Tue Jan 25 02:26:11 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 02:26:11.924610 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a48e6cc-fcd3-4c9a-9283-7bc001f665aa admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:26:11.935923 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a48e6cc-fcd3-4c9a-9283-7bc001f665aa admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:26:11.941580 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3171efe7-46a9-44cd-982b-e29a7a79999b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:26:11.942403 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3171efe7-46a9-44cd-982b-e29a7a79999b admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:26:11.942695 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3171efe7-46a9-44cd-982b-e29a7a79999b admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:26:11.942995 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3171efe7-46a9-44cd-982b-e29a7a79999b admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:26:11.950465 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3171efe7-46a9-44cd-982b-e29a7a79999b admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:26:11.952490 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3171efe7-46a9-44cd-982b-e29a7a79999b admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:26:11.967230 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: WARNING keystone.server.flask.application [None req-3171efe7-46a9-44cd-982b-e29a7a79999b admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 25 02:26:11.968440 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 622/1256] 10.222.0.117 () {56 vars in 1137 bytes} [Tue Jan 25 02:26:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:26:11.975351 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da7eb31-9b76-4511-8900-3443629a12c7 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:26:11.985235 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da7eb31-9b76-4511-8900-3443629a12c7 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:26:11.990185 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebe176e-4913-4126-a92e-3a448e23a817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:26:11.990962 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebe176e-4913-4126-a92e-3a448e23a817 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:26:11.991248 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebe176e-4913-4126-a92e-3a448e23a817 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:26:11.991525 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebe176e-4913-4126-a92e-3a448e23a817 admin admin] PATH_INFO: `/v3/projects` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:26:11.992345 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebe176e-4913-4126-a92e-3a448e23a817 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:26:11.992656 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebe176e-4913-4126-a92e-3a448e23a817 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:26:11.994502 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebe176e-4913-4126-a92e-3a448e23a817 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:26:12.006590 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 635/1257] 10.222.0.117 () {56 vars in 1174 bytes} [Tue Jan 25 02:26:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:26:12.012650 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3171efe7-46a9-44cd-982b-e29a7a79999b admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:26:12.024077 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3171efe7-46a9-44cd-982b-e29a7a79999b admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:26:12.028970 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ac7e7c-16af-492c-91ca-a2790383d1ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:26:12.029792 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ac7e7c-16af-492c-91ca-a2790383d1ef admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:26:12.030074 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ac7e7c-16af-492c-91ca-a2790383d1ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:26:12.030349 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ac7e7c-16af-492c-91ca-a2790383d1ef admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:26:12.031201 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ac7e7c-16af-492c-91ca-a2790383d1ef admin admin] RBAC: Adding query filter params (role.id=d8dbc6d83d9d41d28c3feb8b3485b291, scope.project.id=61a6fe9d4c914755bb0a64c392bd16aa, user.id=890151a6bf2840f0a0a00f45dd2d38a4) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:26:12.031508 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ac7e7c-16af-492c-91ca-a2790383d1ef admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:26:12.033395 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ac7e7c-16af-492c-91ca-a2790383d1ef admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:26:12.040643 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 623/1258] 10.222.0.117 () {56 vars in 1400 bytes} [Tue Jan 25 02:26:12 2022] GET /identity/v3/role_assignments?user.id=890151a6bf2840f0a0a00f45dd2d38a4&scope.project.id=61a6fe9d4c914755bb0a64c392bd16aa&role.id=d8dbc6d83d9d41d28c3feb8b3485b291 => generated 260 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 02:26:14.421122 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3676b8-6d96-420f-8c30-594c31549416 None None] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:26:14.421679 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3676b8-6d96-420f-8c30-594c31549416 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:26:14.422080 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3676b8-6d96-420f-8c30-594c31549416 None None] PATH_INFO: `/` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:26:14.424335 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 636/1259] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:26:14 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:26:14.430206 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d2aa80-8191-4ec0-a235-7faf13ca0492 None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:26:14.430808 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d2aa80-8191-4ec0-a235-7faf13ca0492 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:26:14.430808 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d2aa80-8191-4ec0-a235-7faf13ca0492 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:26:14.449757 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-b4d2aa80-8191-4ec0-a235-7faf13ca0492 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:26:14.450972 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-b4d2aa80-8191-4ec0-a235-7faf13ca0492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:26:14.460721 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 624/1260] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:26:14 2022] POST /identity/v3/auth/tokens => generated 2982 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:26:14.488592 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3676b8-6d96-420f-8c30-594c31549416 None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:26:14.502427 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3676b8-6d96-420f-8c30-594c31549416 None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:26:14.513316 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92aa6a47-2aa8-4b40-8cd5-f39606aeb9c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:26:14.514104 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aa6a47-2aa8-4b40-8cd5-f39606aeb9c5 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:26:14.514387 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aa6a47-2aa8-4b40-8cd5-f39606aeb9c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:26:14.514662 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aa6a47-2aa8-4b40-8cd5-f39606aeb9c5 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:26:14.526380 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92aa6a47-2aa8-4b40-8cd5-f39606aeb9c5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 25 02:26:14.534647 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: WARNING keystone.server.flask.application [None req-92aa6a47-2aa8-4b40-8cd5-f39606aeb9c5 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 25 02:26:14.536037 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 637/1261] 10.222.0.117 () {56 vars in 1122 bytes} [Tue Jan 25 02:26:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:26:14.543155 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d2aa80-8191-4ec0-a235-7faf13ca0492 None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:26:14.553402 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d2aa80-8191-4ec0-a235-7faf13ca0492 None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:26:14.558596 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0917d0f8-2d33-4313-a8f8-aa12dccb580d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:26:14.559321 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0917d0f8-2d33-4313-a8f8-aa12dccb580d admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:26:14.559715 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0917d0f8-2d33-4313-a8f8-aa12dccb580d admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:26:14.560020 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0917d0f8-2d33-4313-a8f8-aa12dccb580d admin admin] PATH_INFO: `/v3/roles` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:26:14.561054 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0917d0f8-2d33-4313-a8f8-aa12dccb580d admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:26:14.561380 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0917d0f8-2d33-4313-a8f8-aa12dccb580d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:26:14.563202 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0917d0f8-2d33-4313-a8f8-aa12dccb580d admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:26:14.574427 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 625/1262] 10.222.0.117 () {56 vars in 1125 bytes} [Tue Jan 25 02:26:14 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:26:14.580582 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92aa6a47-2aa8-4b40-8cd5-f39606aeb9c5 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:26:14.592983 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92aa6a47-2aa8-4b40-8cd5-f39606aeb9c5 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:26:14.598320 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29194130-5469-4e99-a088-b91869fe1a9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:26:14.599855 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29194130-5469-4e99-a088-b91869fe1a9f admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:26:14.600149 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29194130-5469-4e99-a088-b91869fe1a9f admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:26:14.600439 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29194130-5469-4e99-a088-b91869fe1a9f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:26:14.613047 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29194130-5469-4e99-a088-b91869fe1a9f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:26:14.615297 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29194130-5469-4e99-a088-b91869fe1a9f admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:26:14.636500 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: WARNING keystone.server.flask.application [None req-29194130-5469-4e99-a088-b91869fe1a9f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 25 02:26:14.638019 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 638/1263] 10.222.0.117 () {56 vars in 1134 bytes} [Tue Jan 25 02:26:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:26:14.644484 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0917d0f8-2d33-4313-a8f8-aa12dccb580d admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:26:14.656100 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0917d0f8-2d33-4313-a8f8-aa12dccb580d admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:26:14.660962 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd789c0-2262-4b70-a9de-8485cf72593a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:26:14.662023 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd789c0-2262-4b70-a9de-8485cf72593a admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:26:14.662425 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd789c0-2262-4b70-a9de-8485cf72593a admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:26:14.662702 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd789c0-2262-4b70-a9de-8485cf72593a admin admin] PATH_INFO: `/v3/domains` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:26:14.663460 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd789c0-2262-4b70-a9de-8485cf72593a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:26:14.663810 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd789c0-2262-4b70-a9de-8485cf72593a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:26:14.665426 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd789c0-2262-4b70-a9de-8485cf72593a admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:26:14.679377 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 626/1264] 10.222.0.117 () {56 vars in 1135 bytes} [Tue Jan 25 02:26:14 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:26:14.685179 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29194130-5469-4e99-a088-b91869fe1a9f admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:26:14.696603 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29194130-5469-4e99-a088-b91869fe1a9f admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:26:14.701894 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d68b30-1429-48be-98e8-59e30f95996b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:26:14.702704 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d68b30-1429-48be-98e8-59e30f95996b admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:26:14.703016 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d68b30-1429-48be-98e8-59e30f95996b admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:26:14.703262 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d68b30-1429-48be-98e8-59e30f95996b admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:26:14.712797 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d68b30-1429-48be-98e8-59e30f95996b admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:26:14.714997 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d68b30-1429-48be-98e8-59e30f95996b admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:26:14.734225 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: WARNING keystone.server.flask.application [None req-52d68b30-1429-48be-98e8-59e30f95996b admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jan 25 02:26:14.735523 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 639/1265] 10.222.0.117 () {56 vars in 1134 bytes} [Tue Jan 25 02:26:14 2022] GET /identity/v3/users/placement => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:26:14.741997 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd789c0-2262-4b70-a9de-8485cf72593a admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:26:14.752191 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd789c0-2262-4b70-a9de-8485cf72593a admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:26:14.758180 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2e39a4-ed7e-471e-967c-e57f9a95ad2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:26:14.758849 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2e39a4-ed7e-471e-967c-e57f9a95ad2c admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:26:14.759131 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2e39a4-ed7e-471e-967c-e57f9a95ad2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:26:14.759407 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2e39a4-ed7e-471e-967c-e57f9a95ad2c admin admin] PATH_INFO: `/v3/users` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:26:14.760306 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2e39a4-ed7e-471e-967c-e57f9a95ad2c admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:26:14.760616 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2e39a4-ed7e-471e-967c-e57f9a95ad2c admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:26:14.762481 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2e39a4-ed7e-471e-967c-e57f9a95ad2c admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:26:14.781680 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 627/1266] 10.222.0.117 () {56 vars in 1169 bytes} [Tue Jan 25 02:26:14 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 380 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 02:26:14.787839 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d68b30-1429-48be-98e8-59e30f95996b admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:26:14.800594 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d68b30-1429-48be-98e8-59e30f95996b admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:26:14.805997 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a14f33b-09f3-4420-a4fc-fe328360613d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:26:14.806802 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a14f33b-09f3-4420-a4fc-fe328360613d admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:26:14.807116 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a14f33b-09f3-4420-a4fc-fe328360613d admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:26:14.807394 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a14f33b-09f3-4420-a4fc-fe328360613d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:26:14.820505 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a14f33b-09f3-4420-a4fc-fe328360613d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:26:14.822390 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a14f33b-09f3-4420-a4fc-fe328360613d admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:26:14.841640 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: WARNING keystone.server.flask.application [None req-1a14f33b-09f3-4420-a4fc-fe328360613d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 25 02:26:14.843183 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 640/1267] 10.222.0.117 () {56 vars in 1134 bytes} [Tue Jan 25 02:26:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:26:14.849472 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2e39a4-ed7e-471e-967c-e57f9a95ad2c admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:26:14.859606 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2e39a4-ed7e-471e-967c-e57f9a95ad2c admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:26:14.864394 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ed7699-04ec-4b05-a18d-9ff56e8b553c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:26:14.865074 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ed7699-04ec-4b05-a18d-9ff56e8b553c admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:26:14.865358 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ed7699-04ec-4b05-a18d-9ff56e8b553c admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:26:14.865633 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ed7699-04ec-4b05-a18d-9ff56e8b553c admin admin] PATH_INFO: `/v3/domains` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:26:14.866397 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ed7699-04ec-4b05-a18d-9ff56e8b553c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:26:14.866705 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ed7699-04ec-4b05-a18d-9ff56e8b553c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:26:14.868474 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ed7699-04ec-4b05-a18d-9ff56e8b553c admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:26:14.886473 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 628/1268] 10.222.0.117 () {56 vars in 1135 bytes} [Tue Jan 25 02:26:14 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:26:14.887846 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a14f33b-09f3-4420-a4fc-fe328360613d admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:26:14.898488 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a14f33b-09f3-4420-a4fc-fe328360613d admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:26:14.903204 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c795b2-30b7-4c9b-8086-e3375bc1388a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:26:14.904058 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c795b2-30b7-4c9b-8086-e3375bc1388a admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:26:14.904340 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c795b2-30b7-4c9b-8086-e3375bc1388a admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:26:14.904612 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c795b2-30b7-4c9b-8086-e3375bc1388a admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:26:14.914372 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c795b2-30b7-4c9b-8086-e3375bc1388a admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:26:14.916844 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c795b2-30b7-4c9b-8086-e3375bc1388a admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:26:14.934412 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: WARNING keystone.server.flask.application [None req-85c795b2-30b7-4c9b-8086-e3375bc1388a admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 25 02:26:14.935866 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 641/1269] 10.222.0.117 () {56 vars in 1137 bytes} [Tue Jan 25 02:26:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:26:14.942484 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ed7699-04ec-4b05-a18d-9ff56e8b553c admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:26:14.952597 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ed7699-04ec-4b05-a18d-9ff56e8b553c admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:26:14.957678 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570b1ef3-0967-4470-a3f3-e30012ae3ecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:26:14.958871 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570b1ef3-0967-4470-a3f3-e30012ae3ecf admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:26:14.959133 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570b1ef3-0967-4470-a3f3-e30012ae3ecf admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:26:14.959672 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570b1ef3-0967-4470-a3f3-e30012ae3ecf admin admin] PATH_INFO: `/v3/projects` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:26:14.960400 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570b1ef3-0967-4470-a3f3-e30012ae3ecf admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:26:14.960697 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570b1ef3-0967-4470-a3f3-e30012ae3ecf admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:26:14.962565 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570b1ef3-0967-4470-a3f3-e30012ae3ecf admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:26:14.976697 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 629/1270] 10.222.0.117 () {56 vars in 1174 bytes} [Tue Jan 25 02:26:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 02:26:14.982771 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c795b2-30b7-4c9b-8086-e3375bc1388a admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:26:14.994167 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c795b2-30b7-4c9b-8086-e3375bc1388a admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:26:14.999054 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0a4355-6338-40e2-a241-8b25cf3feccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:26:14.999938 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0a4355-6338-40e2-a241-8b25cf3feccb admin admin] REQUEST_METHOD: `PUT` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:26:15.000241 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0a4355-6338-40e2-a241-8b25cf3feccb admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:26:15.000572 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0a4355-6338-40e2-a241-8b25cf3feccb admin admin] PATH_INFO: `/v3/projects/61a6fe9d4c914755bb0a64c392bd16aa/users/890151a6bf2840f0a0a00f45dd2d38a4/roles/d8dbc6d83d9d41d28c3feb8b3485b291` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:26:15.002577 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0a4355-6338-40e2-a241-8b25cf3feccb admin admin] RBAC: Authorizing `identity:create_grant(project_id=61a6fe9d4c914755bb0a64c392bd16aa, user_id=890151a6bf2840f0a0a00f45dd2d38a4, role_id=d8dbc6d83d9d41d28c3feb8b3485b291)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:26:15.005466 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0a4355-6338-40e2-a241-8b25cf3feccb admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:26:15.019948 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 642/1271] 10.222.0.117 () {58 vars in 1465 bytes} [Tue Jan 25 02:26:14 2022] PUT /identity/v3/projects/61a6fe9d4c914755bb0a64c392bd16aa/users/890151a6bf2840f0a0a00f45dd2d38a4/roles/d8dbc6d83d9d41d28c3feb8b3485b291 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:26:17.427307 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c87eb6-8785-43d3-82f5-6e6f5c0ee9ea None None] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:26:17.428137 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c87eb6-8785-43d3-82f5-6e6f5c0ee9ea None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:26:17.428137 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c87eb6-8785-43d3-82f5-6e6f5c0ee9ea None None] PATH_INFO: `/` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:26:17.429697 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 630/1272] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:26:17 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:26:17.435048 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d587c6e4-5108-4f7a-aaad-bc26ab2082d5 None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:26:17.435480 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d587c6e4-5108-4f7a-aaad-bc26ab2082d5 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:26:17.435605 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d587c6e4-5108-4f7a-aaad-bc26ab2082d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:26:17.453245 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-d587c6e4-5108-4f7a-aaad-bc26ab2082d5 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:26:17.454432 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-d587c6e4-5108-4f7a-aaad-bc26ab2082d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:26:17.510662 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 643/1273] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:26:17 2022] POST /identity/v3/auth/tokens => generated 2982 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:26:17.540283 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c87eb6-8785-43d3-82f5-6e6f5c0ee9ea None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:26:17.552553 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c87eb6-8785-43d3-82f5-6e6f5c0ee9ea None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:26:17.556871 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488777a6-33e8-435f-b353-fc842db130be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:26:17.557642 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488777a6-33e8-435f-b353-fc842db130be admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:26:17.557925 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488777a6-33e8-435f-b353-fc842db130be admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:26:17.558196 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488777a6-33e8-435f-b353-fc842db130be admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:26:17.571715 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488777a6-33e8-435f-b353-fc842db130be admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 25 02:26:17.580200 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: WARNING keystone.server.flask.application [None req-488777a6-33e8-435f-b353-fc842db130be admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 25 02:26:17.581391 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 631/1274] 10.222.0.117 () {56 vars in 1122 bytes} [Tue Jan 25 02:26:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:26:17.588256 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d587c6e4-5108-4f7a-aaad-bc26ab2082d5 None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:26:17.597438 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d587c6e4-5108-4f7a-aaad-bc26ab2082d5 None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:26:17.602686 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb70cbe-85d9-4703-b5d6-ee2c1d565aaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:26:17.603336 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb70cbe-85d9-4703-b5d6-ee2c1d565aaa admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:26:17.603615 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb70cbe-85d9-4703-b5d6-ee2c1d565aaa admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:26:17.603922 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb70cbe-85d9-4703-b5d6-ee2c1d565aaa admin admin] PATH_INFO: `/v3/roles` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:26:17.604679 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb70cbe-85d9-4703-b5d6-ee2c1d565aaa admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:26:17.604981 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb70cbe-85d9-4703-b5d6-ee2c1d565aaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:26:17.606587 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb70cbe-85d9-4703-b5d6-ee2c1d565aaa admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:26:17.614647 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 644/1275] 10.222.0.117 () {56 vars in 1125 bytes} [Tue Jan 25 02:26:17 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:26:17.620221 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488777a6-33e8-435f-b353-fc842db130be admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:26:17.631030 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488777a6-33e8-435f-b353-fc842db130be admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:26:17.635612 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f5cb1a-992d-4bec-b6e7-1bca507107be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:26:17.636410 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f5cb1a-992d-4bec-b6e7-1bca507107be admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:26:17.636693 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f5cb1a-992d-4bec-b6e7-1bca507107be admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:26:17.636968 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f5cb1a-992d-4bec-b6e7-1bca507107be admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:26:17.647611 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f5cb1a-992d-4bec-b6e7-1bca507107be admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:26:17.649480 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f5cb1a-992d-4bec-b6e7-1bca507107be admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:26:17.666245 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: WARNING keystone.server.flask.application [None req-00f5cb1a-992d-4bec-b6e7-1bca507107be admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 25 02:26:17.667382 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 632/1276] 10.222.0.117 () {56 vars in 1134 bytes} [Tue Jan 25 02:26:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 25 02:26:17.677690 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb70cbe-85d9-4703-b5d6-ee2c1d565aaa admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:26:17.686905 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb70cbe-85d9-4703-b5d6-ee2c1d565aaa admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:26:17.691323 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa24537-86d0-4193-b2b2-ea830f1d9688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:26:17.691993 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa24537-86d0-4193-b2b2-ea830f1d9688 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:26:17.692328 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa24537-86d0-4193-b2b2-ea830f1d9688 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:26:17.692639 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa24537-86d0-4193-b2b2-ea830f1d9688 admin admin] PATH_INFO: `/v3/domains` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:26:17.693398 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa24537-86d0-4193-b2b2-ea830f1d9688 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:26:17.693696 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa24537-86d0-4193-b2b2-ea830f1d9688 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:26:17.695284 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa24537-86d0-4193-b2b2-ea830f1d9688 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:26:17.706725 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 645/1277] 10.222.0.117 () {56 vars in 1135 bytes} [Tue Jan 25 02:26:17 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:26:17.712307 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f5cb1a-992d-4bec-b6e7-1bca507107be admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:26:17.722015 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f5cb1a-992d-4bec-b6e7-1bca507107be admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:26:17.727068 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fcfc12-132f-40bc-b5bf-80e0f8584c5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:26:17.727876 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fcfc12-132f-40bc-b5bf-80e0f8584c5f admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:26:17.728157 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fcfc12-132f-40bc-b5bf-80e0f8584c5f admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:26:17.728427 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fcfc12-132f-40bc-b5bf-80e0f8584c5f admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:26:17.735499 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fcfc12-132f-40bc-b5bf-80e0f8584c5f admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:26:17.737543 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fcfc12-132f-40bc-b5bf-80e0f8584c5f admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:26:17.751813 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: WARNING keystone.server.flask.application [None req-79fcfc12-132f-40bc-b5bf-80e0f8584c5f admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jan 25 02:26:17.752932 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 633/1278] 10.222.0.117 () {56 vars in 1134 bytes} [Tue Jan 25 02:26:17 2022] GET /identity/v3/users/placement => generated 87 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:26:17.758864 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa24537-86d0-4193-b2b2-ea830f1d9688 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:26:17.768256 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa24537-86d0-4193-b2b2-ea830f1d9688 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:26:17.773395 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695f6196-c18d-4f86-b2ff-322f280092e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:26:17.774034 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695f6196-c18d-4f86-b2ff-322f280092e0 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:26:17.774315 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695f6196-c18d-4f86-b2ff-322f280092e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:26:17.774588 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695f6196-c18d-4f86-b2ff-322f280092e0 admin admin] PATH_INFO: `/v3/users` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:26:17.775425 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695f6196-c18d-4f86-b2ff-322f280092e0 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:26:17.775755 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695f6196-c18d-4f86-b2ff-322f280092e0 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:26:17.777614 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695f6196-c18d-4f86-b2ff-322f280092e0 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:26:17.795180 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 646/1279] 10.222.0.117 () {56 vars in 1169 bytes} [Tue Jan 25 02:26:17 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 380 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 02:26:17.800601 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fcfc12-132f-40bc-b5bf-80e0f8584c5f admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:26:17.810093 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fcfc12-132f-40bc-b5bf-80e0f8584c5f admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:26:17.814508 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41124c46-9fff-4b8a-8fff-6eec87ed3c0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:26:17.815130 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41124c46-9fff-4b8a-8fff-6eec87ed3c0c admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:26:17.815412 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41124c46-9fff-4b8a-8fff-6eec87ed3c0c admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:26:17.815713 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41124c46-9fff-4b8a-8fff-6eec87ed3c0c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:26:17.823801 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41124c46-9fff-4b8a-8fff-6eec87ed3c0c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:26:17.825527 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41124c46-9fff-4b8a-8fff-6eec87ed3c0c admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:26:17.834719 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 634/1280] 10.222.0.117 () {58 vars in 1329 bytes} [Tue Jan 25 02:26:17 2022] GET /identity/v3/auth/tokens => generated 2982 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:26:17.839989 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695f6196-c18d-4f86-b2ff-322f280092e0 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:26:17.849656 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695f6196-c18d-4f86-b2ff-322f280092e0 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:26:17.854107 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3444a6-e6e7-4482-8fcf-5d656168f019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:26:17.854863 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3444a6-e6e7-4482-8fcf-5d656168f019 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:26:17.855145 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3444a6-e6e7-4482-8fcf-5d656168f019 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:26:17.855420 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3444a6-e6e7-4482-8fcf-5d656168f019 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:26:17.865341 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3444a6-e6e7-4482-8fcf-5d656168f019 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:26:17.867145 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3444a6-e6e7-4482-8fcf-5d656168f019 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:26:17.883950 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: WARNING keystone.server.flask.application [None req-3b3444a6-e6e7-4482-8fcf-5d656168f019 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 25 02:26:17.885038 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 647/1281] 10.222.0.117 () {56 vars in 1134 bytes} [Tue Jan 25 02:26:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:26:17.890193 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41124c46-9fff-4b8a-8fff-6eec87ed3c0c admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:26:17.899671 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41124c46-9fff-4b8a-8fff-6eec87ed3c0c admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:26:17.911481 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcbfd79-a89a-4059-bcec-b727d2509bde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:26:17.912160 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcbfd79-a89a-4059-bcec-b727d2509bde admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:26:17.912542 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcbfd79-a89a-4059-bcec-b727d2509bde admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:26:17.912887 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcbfd79-a89a-4059-bcec-b727d2509bde admin admin] PATH_INFO: `/v3/domains` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:26:17.913807 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcbfd79-a89a-4059-bcec-b727d2509bde admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:26:17.914108 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcbfd79-a89a-4059-bcec-b727d2509bde admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:26:17.915682 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcbfd79-a89a-4059-bcec-b727d2509bde admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:26:17.928302 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 635/1282] 10.222.0.117 () {56 vars in 1135 bytes} [Tue Jan 25 02:26:17 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:26:17.934046 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3444a6-e6e7-4482-8fcf-5d656168f019 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:26:17.944929 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3444a6-e6e7-4482-8fcf-5d656168f019 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:26:17.952345 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d67b8b-2cf8-438d-9a24-45cd590922be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:26:17.952855 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d67b8b-2cf8-438d-9a24-45cd590922be admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:26:17.953214 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d67b8b-2cf8-438d-9a24-45cd590922be admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:26:17.953496 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d67b8b-2cf8-438d-9a24-45cd590922be admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:26:17.962956 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d67b8b-2cf8-438d-9a24-45cd590922be admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:26:17.965794 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d67b8b-2cf8-438d-9a24-45cd590922be admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:26:17.981764 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: WARNING keystone.server.flask.application [None req-e3d67b8b-2cf8-438d-9a24-45cd590922be admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 25 02:26:17.982938 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 648/1283] 10.222.0.117 () {56 vars in 1137 bytes} [Tue Jan 25 02:26:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 25 02:26:17.988962 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcbfd79-a89a-4059-bcec-b727d2509bde admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:26:17.999116 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcbfd79-a89a-4059-bcec-b727d2509bde admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:26:18.003589 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759ff609-f7fa-4750-9fca-b82ff070bbc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:26:18.004258 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759ff609-f7fa-4750-9fca-b82ff070bbc2 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:26:18.004542 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759ff609-f7fa-4750-9fca-b82ff070bbc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:26:18.005535 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759ff609-f7fa-4750-9fca-b82ff070bbc2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:26:18.006330 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759ff609-f7fa-4750-9fca-b82ff070bbc2 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:26:18.006635 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759ff609-f7fa-4750-9fca-b82ff070bbc2 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:26:18.008505 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759ff609-f7fa-4750-9fca-b82ff070bbc2 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:26:18.021652 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 636/1284] 10.222.0.117 () {56 vars in 1174 bytes} [Tue Jan 25 02:26:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 02:26:18.027611 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d67b8b-2cf8-438d-9a24-45cd590922be admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:26:18.038052 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d67b8b-2cf8-438d-9a24-45cd590922be admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:26:18.042486 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3dd39d-d911-4b37-bf52-023f80d824b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:26:18.043104 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3dd39d-d911-4b37-bf52-023f80d824b9 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:26:18.043380 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3dd39d-d911-4b37-bf52-023f80d824b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:26:18.043650 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3dd39d-d911-4b37-bf52-023f80d824b9 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:26:18.044533 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3dd39d-d911-4b37-bf52-023f80d824b9 admin admin] RBAC: Adding query filter params (role.id=d8dbc6d83d9d41d28c3feb8b3485b291, scope.project.id=61a6fe9d4c914755bb0a64c392bd16aa, user.id=890151a6bf2840f0a0a00f45dd2d38a4) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:26:18.044839 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3dd39d-d911-4b37-bf52-023f80d824b9 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:26:18.046667 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3dd39d-d911-4b37-bf52-023f80d824b9 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:26:18.053090 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 649/1285] 10.222.0.117 () {56 vars in 1400 bytes} [Tue Jan 25 02:26:18 2022] GET /identity/v3/role_assignments?user.id=890151a6bf2840f0a0a00f45dd2d38a4&scope.project.id=61a6fe9d4c914755bb0a64c392bd16aa&role.id=d8dbc6d83d9d41d28c3feb8b3485b291 => generated 610 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 02:26:20.280381 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581faaf4-eb8d-40b4-9082-c8742cc6dde2 None None] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:26:20.280944 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581faaf4-eb8d-40b4-9082-c8742cc6dde2 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:26:20.280944 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581faaf4-eb8d-40b4-9082-c8742cc6dde2 None None] PATH_INFO: `/` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:26:20.282709 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 637/1286] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:26:20 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:26:20.288794 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21fcf54-9d56-40d1-ae9f-03e1260c0ce1 None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:26:20.289206 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21fcf54-9d56-40d1-ae9f-03e1260c0ce1 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:26:20.289349 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21fcf54-9d56-40d1-ae9f-03e1260c0ce1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:26:20.306254 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-d21fcf54-9d56-40d1-ae9f-03e1260c0ce1 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:26:20.307434 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-d21fcf54-9d56-40d1-ae9f-03e1260c0ce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:26:20.314980 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 650/1287] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:26:20 2022] POST /identity/v3/auth/tokens => generated 2982 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:26:20.337567 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581faaf4-eb8d-40b4-9082-c8742cc6dde2 None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:26:20.350359 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581faaf4-eb8d-40b4-9082-c8742cc6dde2 None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:26:20.354738 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81eecd8-1755-4987-a263-d5e9b5f4ed9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:26:20.355502 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81eecd8-1755-4987-a263-d5e9b5f4ed9c admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:26:20.355815 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81eecd8-1755-4987-a263-d5e9b5f4ed9c admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:26:20.356090 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81eecd8-1755-4987-a263-d5e9b5f4ed9c admin admin] PATH_INFO: `/v3/services/placement` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:26:20.356752 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81eecd8-1755-4987-a263-d5e9b5f4ed9c admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:26:20.358344 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81eecd8-1755-4987-a263-d5e9b5f4ed9c admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:26:20.369290 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: WARNING keystone.server.flask.application [None req-c81eecd8-1755-4987-a263-d5e9b5f4ed9c admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jan 25 02:26:20.370398 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 638/1288] 10.222.0.117 () {56 vars in 1143 bytes} [Tue Jan 25 02:26:20 2022] GET /identity/v3/services/placement => generated 90 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 25 02:26:20.375972 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21fcf54-9d56-40d1-ae9f-03e1260c0ce1 None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:26:20.384957 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21fcf54-9d56-40d1-ae9f-03e1260c0ce1 None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:26:20.389425 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082305f5-f848-4809-a77f-25839d1e1fbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:26:20.390061 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082305f5-f848-4809-a77f-25839d1e1fbd admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:26:20.390345 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082305f5-f848-4809-a77f-25839d1e1fbd admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:26:20.390618 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082305f5-f848-4809-a77f-25839d1e1fbd admin admin] PATH_INFO: `/v3/services` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:26:20.391325 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082305f5-f848-4809-a77f-25839d1e1fbd admin admin] RBAC: Adding query filter params (name=placement) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:26:20.391628 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082305f5-f848-4809-a77f-25839d1e1fbd admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:26:20.393246 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082305f5-f848-4809-a77f-25839d1e1fbd admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:26:20.398540 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 651/1289] 10.222.0.117 () {56 vars in 1142 bytes} [Tue Jan 25 02:26:20 2022] GET /identity/v3/services?name=placement => generated 127 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:26:20.403757 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81eecd8-1755-4987-a263-d5e9b5f4ed9c admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:26:20.413804 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81eecd8-1755-4987-a263-d5e9b5f4ed9c admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:26:20.418395 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b00ac9e-3c7d-4471-8982-96b1e9b916e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:26:20.419016 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b00ac9e-3c7d-4471-8982-96b1e9b916e4 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:26:20.419298 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b00ac9e-3c7d-4471-8982-96b1e9b916e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:26:20.419635 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b00ac9e-3c7d-4471-8982-96b1e9b916e4 admin admin] PATH_INFO: `/v3/services` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:26:20.420373 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b00ac9e-3c7d-4471-8982-96b1e9b916e4 admin admin] RBAC: Adding query filter params (type=placement) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:26:20.420679 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b00ac9e-3c7d-4471-8982-96b1e9b916e4 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:26:20.422243 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b00ac9e-3c7d-4471-8982-96b1e9b916e4 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:26:20.426499 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 639/1290] 10.222.0.117 () {56 vars in 1142 bytes} [Tue Jan 25 02:26:20 2022] GET /identity/v3/services?type=placement => generated 127 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:26:22.611458 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcf7fe0-8bef-4148-8d7b-ef44c3c38523 None None] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:26:22.612050 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcf7fe0-8bef-4148-8d7b-ef44c3c38523 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:26:22.612050 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcf7fe0-8bef-4148-8d7b-ef44c3c38523 None None] PATH_INFO: `/` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:26:22.613791 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 652/1291] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:26:22 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:26:22.619424 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01837858-bf44-4fa4-af31-bd868868e05a None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:26:22.619878 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01837858-bf44-4fa4-af31-bd868868e05a None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:26:22.619983 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01837858-bf44-4fa4-af31-bd868868e05a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:26:22.640188 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-01837858-bf44-4fa4-af31-bd868868e05a None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:26:22.641395 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-01837858-bf44-4fa4-af31-bd868868e05a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:26:22.649838 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 640/1292] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:26:22 2022] POST /identity/v3/auth/tokens => generated 2982 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:26:22.672510 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcf7fe0-8bef-4148-8d7b-ef44c3c38523 None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:26:22.685117 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcf7fe0-8bef-4148-8d7b-ef44c3c38523 None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:26:22.689432 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21eb4909-bbd3-4833-8302-d6da1f075d37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:26:22.690074 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eb4909-bbd3-4833-8302-d6da1f075d37 admin admin] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:26:22.690357 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eb4909-bbd3-4833-8302-d6da1f075d37 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:26:22.690632 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eb4909-bbd3-4833-8302-d6da1f075d37 admin admin] PATH_INFO: `/v3/services` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:26:22.691365 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21eb4909-bbd3-4833-8302-d6da1f075d37 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:26:22.693662 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21eb4909-bbd3-4833-8302-d6da1f075d37 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:26:22.706407 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 653/1293] 10.222.0.117 () {60 vars in 1167 bytes} [Tue Jan 25 02:26:22 2022] POST /identity/v3/services => generated 247 bytes in 34 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 02:26:24.959199 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a2377e-377e-4ce6-8a8d-1599c0250528 None None] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:26:24.959778 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a2377e-377e-4ce6-8a8d-1599c0250528 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:26:24.959778 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a2377e-377e-4ce6-8a8d-1599c0250528 None None] PATH_INFO: `/` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:26:24.961746 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 641/1294] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:26:24 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:26:24.967841 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6605edb4-21ac-456f-83ab-5b0018ebadf6 None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:26:24.968388 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6605edb4-21ac-456f-83ab-5b0018ebadf6 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:26:24.968388 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6605edb4-21ac-456f-83ab-5b0018ebadf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:26:24.986709 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-6605edb4-21ac-456f-83ab-5b0018ebadf6 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:26:24.987908 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-6605edb4-21ac-456f-83ab-5b0018ebadf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:26:25.005937 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 654/1295] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:26:24 2022] POST /identity/v3/auth/tokens => generated 3085 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:26:25.029235 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a2377e-377e-4ce6-8a8d-1599c0250528 None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:26:25.041601 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a2377e-377e-4ce6-8a8d-1599c0250528 None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:26:25.046007 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049d8f61-e2a4-4207-bd83-b99fe1eaa9dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:26:25.046802 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049d8f61-e2a4-4207-bd83-b99fe1eaa9dd admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:26:25.047082 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049d8f61-e2a4-4207-bd83-b99fe1eaa9dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:26:25.047372 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049d8f61-e2a4-4207-bd83-b99fe1eaa9dd admin admin] PATH_INFO: `/v3/services/placement` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:26:25.048053 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049d8f61-e2a4-4207-bd83-b99fe1eaa9dd admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:26:25.049667 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049d8f61-e2a4-4207-bd83-b99fe1eaa9dd admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:26:25.062558 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: WARNING keystone.server.flask.application [None req-049d8f61-e2a4-4207-bd83-b99fe1eaa9dd admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jan 25 02:26:25.063746 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 642/1296] 10.222.0.117 () {56 vars in 1143 bytes} [Tue Jan 25 02:26:25 2022] GET /identity/v3/services/placement => generated 90 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 25 02:26:25.070779 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6605edb4-21ac-456f-83ab-5b0018ebadf6 None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:26:25.079614 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6605edb4-21ac-456f-83ab-5b0018ebadf6 None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:26:25.084827 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e196fc2b-c846-4338-9266-a1ce1b792bd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:26:25.085467 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e196fc2b-c846-4338-9266-a1ce1b792bd0 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:26:25.085748 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e196fc2b-c846-4338-9266-a1ce1b792bd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:26:25.086022 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e196fc2b-c846-4338-9266-a1ce1b792bd0 admin admin] PATH_INFO: `/v3/services` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:26:25.086730 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e196fc2b-c846-4338-9266-a1ce1b792bd0 admin admin] RBAC: Adding query filter params (name=placement) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:26:25.087032 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e196fc2b-c846-4338-9266-a1ce1b792bd0 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:26:25.088656 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e196fc2b-c846-4338-9266-a1ce1b792bd0 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:26:25.093796 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 655/1297] 10.222.0.117 () {56 vars in 1142 bytes} [Tue Jan 25 02:26:25 2022] GET /identity/v3/services?name=placement => generated 360 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:26:25.099805 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049d8f61-e2a4-4207-bd83-b99fe1eaa9dd admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:26:25.109421 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049d8f61-e2a4-4207-bd83-b99fe1eaa9dd admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:26:25.113938 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92126a26-daea-4a63-b441-3cc57e66f3b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:26:25.114597 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92126a26-daea-4a63-b441-3cc57e66f3b8 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:26:25.114821 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92126a26-daea-4a63-b441-3cc57e66f3b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:26:25.115092 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92126a26-daea-4a63-b441-3cc57e66f3b8 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:26:25.115911 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92126a26-daea-4a63-b441-3cc57e66f3b8 admin admin] RBAC: Adding query filter params (interface=public, service_id=db655640b5304ed39ebd7c448fd8205f, region_id=RegionOne) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:26:25.116222 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92126a26-daea-4a63-b441-3cc57e66f3b8 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:26:25.117798 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92126a26-daea-4a63-b441-3cc57e66f3b8 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:26:25.122648 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 643/1298] 10.222.0.117 () {56 vars in 1277 bytes} [Tue Jan 25 02:26:25 2022] GET /identity/v3/endpoints?service_id=db655640b5304ed39ebd7c448fd8205f&interface=public®ion_id=RegionOne => generated 195 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:26:25.127987 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e196fc2b-c846-4338-9266-a1ce1b792bd0 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:26:25.137822 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e196fc2b-c846-4338-9266-a1ce1b792bd0 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:26:25.142352 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2cd727-68fc-48d4-be4f-ee1958f17cc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:26:25.142985 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2cd727-68fc-48d4-be4f-ee1958f17cc2 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:26:25.143269 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2cd727-68fc-48d4-be4f-ee1958f17cc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:26:25.143545 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2cd727-68fc-48d4-be4f-ee1958f17cc2 admin admin] PATH_INFO: `/v3/services` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:26:25.144264 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2cd727-68fc-48d4-be4f-ee1958f17cc2 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:26:25.146616 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2cd727-68fc-48d4-be4f-ee1958f17cc2 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:26:25.153104 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 656/1299] 10.222.0.117 () {56 vars in 1113 bytes} [Tue Jan 25 02:26:25 2022] GET /identity/v3/services => generated 2201 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 02:26:27.381736 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c050bb3-4f3d-4d0a-9757-2b7b171900be None None] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:26:27.382275 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c050bb3-4f3d-4d0a-9757-2b7b171900be None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:26:27.382275 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c050bb3-4f3d-4d0a-9757-2b7b171900be None None] PATH_INFO: `/` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:26:27.384087 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 644/1300] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:26:27 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:26:27.389448 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2276a7-0f57-4f08-9663-ded3f8359e6e None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:26:27.389851 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2276a7-0f57-4f08-9663-ded3f8359e6e None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:26:27.390006 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2276a7-0f57-4f08-9663-ded3f8359e6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:26:27.407927 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-1c2276a7-0f57-4f08-9663-ded3f8359e6e None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:26:27.409108 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-1c2276a7-0f57-4f08-9663-ded3f8359e6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:26:27.417498 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 657/1301] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:26:27 2022] POST /identity/v3/auth/tokens => generated 3085 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:26:27.446999 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c050bb3-4f3d-4d0a-9757-2b7b171900be None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:26:27.459521 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c050bb3-4f3d-4d0a-9757-2b7b171900be None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:26:27.464445 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab28cc3-b6c7-454e-a812-1c38e19fdef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:26:27.465224 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab28cc3-b6c7-454e-a812-1c38e19fdef8 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:26:27.465506 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab28cc3-b6c7-454e-a812-1c38e19fdef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:26:27.465781 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab28cc3-b6c7-454e-a812-1c38e19fdef8 admin admin] PATH_INFO: `/v3/services/placement` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:26:27.466445 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab28cc3-b6c7-454e-a812-1c38e19fdef8 admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:26:27.468334 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab28cc3-b6c7-454e-a812-1c38e19fdef8 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:26:27.479805 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: WARNING keystone.server.flask.application [None req-cab28cc3-b6c7-454e-a812-1c38e19fdef8 admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jan 25 02:26:27.480949 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 645/1302] 10.222.0.117 () {56 vars in 1143 bytes} [Tue Jan 25 02:26:27 2022] GET /identity/v3/services/placement => generated 90 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 25 02:26:27.487011 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2276a7-0f57-4f08-9663-ded3f8359e6e None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:26:27.497243 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2276a7-0f57-4f08-9663-ded3f8359e6e None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:26:27.501677 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87318fb2-a2d8-42f7-adb7-ddfaccbe3f7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:26:27.502319 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87318fb2-a2d8-42f7-adb7-ddfaccbe3f7f admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:26:27.502597 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87318fb2-a2d8-42f7-adb7-ddfaccbe3f7f admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:26:27.502866 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87318fb2-a2d8-42f7-adb7-ddfaccbe3f7f admin admin] PATH_INFO: `/v3/services` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:26:27.503575 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87318fb2-a2d8-42f7-adb7-ddfaccbe3f7f admin admin] RBAC: Adding query filter params (name=placement) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:26:27.503907 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87318fb2-a2d8-42f7-adb7-ddfaccbe3f7f admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:26:27.506372 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87318fb2-a2d8-42f7-adb7-ddfaccbe3f7f admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:26:27.511313 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 658/1303] 10.222.0.117 () {56 vars in 1142 bytes} [Tue Jan 25 02:26:27 2022] GET /identity/v3/services?name=placement => generated 360 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:26:27.516609 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab28cc3-b6c7-454e-a812-1c38e19fdef8 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:26:27.526565 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab28cc3-b6c7-454e-a812-1c38e19fdef8 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:26:27.531086 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe493be-a90e-41e4-9d39-2cd6c5dbd970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:26:27.531741 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe493be-a90e-41e4-9d39-2cd6c5dbd970 admin admin] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:26:27.532027 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe493be-a90e-41e4-9d39-2cd6c5dbd970 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:26:27.532303 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe493be-a90e-41e4-9d39-2cd6c5dbd970 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:26:27.533046 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe493be-a90e-41e4-9d39-2cd6c5dbd970 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:26:27.534611 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe493be-a90e-41e4-9d39-2cd6c5dbd970 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:26:27.552507 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 646/1304] 10.222.0.117 () {60 vars in 1170 bytes} [Tue Jan 25 02:26:27 2022] POST /identity/v3/endpoints => generated 333 bytes in 36 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 25 02:27:30.986072 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25774013-75bc-48dd-9f0d-8b5d2fe6ba3b None None] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:27:30.987038 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25774013-75bc-48dd-9f0d-8b5d2fe6ba3b None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:27:30.988115 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25774013-75bc-48dd-9f0d-8b5d2fe6ba3b None None] PATH_INFO: `/` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:27:30.995610 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5c3b91-e34c-4cd4-987d-66ffb36681aa None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:27:30.996442 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5c3b91-e34c-4cd4-987d-66ffb36681aa None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:27:30.996878 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5c3b91-e34c-4cd4-987d-66ffb36681aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:27:30.999826 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 659/1305] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:27:30 2022] GET /identity => generated 271 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:27:31.082629 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-3b5c3b91-e34c-4cd4-987d-66ffb36681aa None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:27:31.084093 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-3b5c3b91-e34c-4cd4-987d-66ffb36681aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:27:31.208293 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 647/1306] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:27:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:27:31.231392 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25774013-75bc-48dd-9f0d-8b5d2fe6ba3b None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:27:31.236607 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-25774013-75bc-48dd-9f0d-8b5d2fe6ba3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:27:31.418690 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25774013-75bc-48dd-9f0d-8b5d2fe6ba3b None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:27:31.536728 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00a7d6d-4f21-4379-ac3f-2913c8748847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:27:31.537393 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00a7d6d-4f21-4379-ac3f-2913c8748847 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:27:31.537677 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00a7d6d-4f21-4379-ac3f-2913c8748847 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:27:31.537953 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00a7d6d-4f21-4379-ac3f-2913c8748847 admin admin] PATH_INFO: `/v3/projects` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:27:31.538708 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00a7d6d-4f21-4379-ac3f-2913c8748847 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:27:31.540612 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00a7d6d-4f21-4379-ac3f-2913c8748847 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:27:31.559681 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 660/1307] 10.222.0.117 () {56 vars in 1113 bytes} [Tue Jan 25 02:27:31 2022] GET /identity/v3/projects => generated 2562 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 02:27:33.839363 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a811c35-6b37-42df-b464-956bb01dff9d None None] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:27:33.840204 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a811c35-6b37-42df-b464-956bb01dff9d None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:27:33.840204 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a811c35-6b37-42df-b464-956bb01dff9d None None] PATH_INFO: `/` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:27:33.842157 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 648/1308] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:27:33 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:27:33.847462 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e485707-fa69-457f-8059-43b1d1785554 None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:27:33.847924 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e485707-fa69-457f-8059-43b1d1785554 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:27:33.848036 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e485707-fa69-457f-8059-43b1d1785554 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:27:33.920590 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-9e485707-fa69-457f-8059-43b1d1785554 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:27:33.921773 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-9e485707-fa69-457f-8059-43b1d1785554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:27:34.018924 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 661/1309] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:27:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:27:34.042364 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a811c35-6b37-42df-b464-956bb01dff9d None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:27:34.043925 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-8a811c35-6b37-42df-b464-956bb01dff9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:27:34.182933 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a811c35-6b37-42df-b464-956bb01dff9d None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:27:34.295336 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2289308-2f49-4f5f-a977-cbd143830c68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:27:34.296145 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2289308-2f49-4f5f-a977-cbd143830c68 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:27:34.296487 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2289308-2f49-4f5f-a977-cbd143830c68 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:27:34.296761 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2289308-2f49-4f5f-a977-cbd143830c68 admin admin] PATH_INFO: `/v3/projects` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:27:34.297506 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2289308-2f49-4f5f-a977-cbd143830c68 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:27:34.300085 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2289308-2f49-4f5f-a977-cbd143830c68 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:27:34.319600 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 649/1310] 10.222.0.117 () {56 vars in 1113 bytes} [Tue Jan 25 02:27:34 2022] GET /identity/v3/projects => generated 2562 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 02:27:36.673984 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cb31bb-9c3b-4dee-9c5c-f4108bf5deec None None] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:27:36.675763 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cb31bb-9c3b-4dee-9c5c-f4108bf5deec None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:27:36.678101 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cb31bb-9c3b-4dee-9c5c-f4108bf5deec None None] PATH_INFO: `/` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:27:36.680090 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 662/1311] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:27:36 2022] GET /identity => generated 271 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:27:36.685893 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb38871f-4e5c-498b-8e0a-4599a1df59a8 None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:27:36.686461 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb38871f-4e5c-498b-8e0a-4599a1df59a8 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:27:36.686461 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb38871f-4e5c-498b-8e0a-4599a1df59a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:27:36.759204 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-bb38871f-4e5c-498b-8e0a-4599a1df59a8 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:27:36.760629 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-bb38871f-4e5c-498b-8e0a-4599a1df59a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:27:36.862385 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 650/1312] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:27:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:27:36.912261 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b79630c-b927-4c5c-a16b-5158e1761619 None None] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:27:36.912552 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b79630c-b927-4c5c-a16b-5158e1761619 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:27:36.912832 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b79630c-b927-4c5c-a16b-5158e1761619 None None] PATH_INFO: `/` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:27:36.914593 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 663/1313] 10.222.0.117 () {54 vars in 969 bytes} [Tue Jan 25 02:27:36 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:27:36.920618 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f935e544-b09b-4bd4-8b36-646425504009 None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:27:36.920913 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f935e544-b09b-4bd4-8b36-646425504009 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:27:36.921197 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f935e544-b09b-4bd4-8b36-646425504009 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:27:36.996318 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-f935e544-b09b-4bd4-8b36-646425504009 None None] MFA Rules not processed for user `9ca4071c5f8f4a31b5edb81fa66a43a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:27:36.997541 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-f935e544-b09b-4bd4-8b36-646425504009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:27:37.072699 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 651/1314] 10.222.0.117 () {58 vars in 1066 bytes} [Tue Jan 25 02:27:36 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 25 02:27:37.081936 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b79630c-b927-4c5c-a16b-5158e1761619 None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:27:37.083478 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-7b79630c-b927-4c5c-a16b-5158e1761619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:27:37.186217 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b79630c-b927-4c5c-a16b-5158e1761619 None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:27:37.258012 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ffa3b9-dfad-4b81-bb31-f9f4f14e9bc6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca4071c5f8f4a31b5edb81fa66a43a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:27:37.258656 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ffa3b9-dfad-4b81-bb31-f9f4f14e9bc6 service neutron] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:27:37.258930 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ffa3b9-dfad-4b81-bb31-f9f4f14e9bc6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:27:37.259197 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ffa3b9-dfad-4b81-bb31-f9f4f14e9bc6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:27:37.260859 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-99ffa3b9-dfad-4b81-bb31-f9f4f14e9bc6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:27:37.365534 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ffa3b9-dfad-4b81-bb31-f9f4f14e9bc6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:27:37.366967 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ffa3b9-dfad-4b81-bb31-f9f4f14e9bc6 service neutron] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:27:37.384209 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 664/1315] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:27:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:27:39.885071 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd900b95-a52f-4c3e-b842-97b2fe962ea1 None None] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:27:39.885615 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd900b95-a52f-4c3e-b842-97b2fe962ea1 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:27:39.885615 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd900b95-a52f-4c3e-b842-97b2fe962ea1 None None] PATH_INFO: `/` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:27:39.887388 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 652/1316] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:27:39 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:27:39.892608 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbf8cee-0bb5-4239-8f77-9efc0a19b86f None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:27:39.893054 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbf8cee-0bb5-4239-8f77-9efc0a19b86f None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:27:39.893305 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbf8cee-0bb5-4239-8f77-9efc0a19b86f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:27:39.956533 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-1dbf8cee-0bb5-4239-8f77-9efc0a19b86f None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:27:39.957743 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-1dbf8cee-0bb5-4239-8f77-9efc0a19b86f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:27:40.055637 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 665/1317] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:27:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 25 02:27:40.089071 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd900b95-a52f-4c3e-b842-97b2fe962ea1 None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:27:40.090840 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-cd900b95-a52f-4c3e-b842-97b2fe962ea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:27:40.214471 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd900b95-a52f-4c3e-b842-97b2fe962ea1 None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:27:40.304788 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a71d91f-fe3a-4a8d-a9fc-74a383a93c40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:27:40.305638 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a71d91f-fe3a-4a8d-a9fc-74a383a93c40 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:27:40.305917 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a71d91f-fe3a-4a8d-a9fc-74a383a93c40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:27:40.306188 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a71d91f-fe3a-4a8d-a9fc-74a383a93c40 admin admin] PATH_INFO: `/v3/projects/705a3c6650674528a0096768eea3fe81` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:27:40.307084 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a71d91f-fe3a-4a8d-a9fc-74a383a93c40 admin admin] RBAC: Authorizing `identity:get_project(project_id=705a3c6650674528a0096768eea3fe81)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:27:40.308901 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a71d91f-fe3a-4a8d-a9fc-74a383a93c40 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:27:40.310558 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 653/1318] 10.222.0.117 () {56 vars in 1212 bytes} [Tue Jan 25 02:27:40 2022] GET /identity/v3/projects/705a3c6650674528a0096768eea3fe81 => generated 345 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:27:40.322548 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbf8cee-0bb5-4239-8f77-9efc0a19b86f None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:27:40.323766 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-1dbf8cee-0bb5-4239-8f77-9efc0a19b86f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:27:40.412984 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbf8cee-0bb5-4239-8f77-9efc0a19b86f None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:27:40.481111 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816d676f-ce78-48e1-91fa-6b9dae918d01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca4071c5f8f4a31b5edb81fa66a43a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:27:40.481704 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816d676f-ce78-48e1-91fa-6b9dae918d01 service neutron] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:27:40.482030 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816d676f-ce78-48e1-91fa-6b9dae918d01 service neutron] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:27:40.482251 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816d676f-ce78-48e1-91fa-6b9dae918d01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:27:40.483900 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-816d676f-ce78-48e1-91fa-6b9dae918d01 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:27:40.592875 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816d676f-ce78-48e1-91fa-6b9dae918d01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:27:40.594323 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816d676f-ce78-48e1-91fa-6b9dae918d01 service neutron] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:27:40.613109 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 666/1319] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:27:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:27:43.175149 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3144c957-a697-46da-b0f4-a625a4390dd8 None None] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:27:43.175678 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3144c957-a697-46da-b0f4-a625a4390dd8 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:27:43.175678 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3144c957-a697-46da-b0f4-a625a4390dd8 None None] PATH_INFO: `/` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:27:43.177485 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 654/1320] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:27:43 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:27:43.183081 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426291c1-5e62-40a7-b12b-8c23d09dc1ae None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:27:43.183519 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426291c1-5e62-40a7-b12b-8c23d09dc1ae None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:27:43.183664 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426291c1-5e62-40a7-b12b-8c23d09dc1ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:27:43.250271 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-426291c1-5e62-40a7-b12b-8c23d09dc1ae None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:27:43.251480 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-426291c1-5e62-40a7-b12b-8c23d09dc1ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:27:43.346812 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 667/1321] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:27:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:27:43.382488 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3144c957-a697-46da-b0f4-a625a4390dd8 None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:27:43.384046 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-3144c957-a697-46da-b0f4-a625a4390dd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:27:43.505119 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3144c957-a697-46da-b0f4-a625a4390dd8 None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:27:43.595028 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df2e9e1-92d5-4e86-9a80-60d5d8911bf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:27:43.596621 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df2e9e1-92d5-4e86-9a80-60d5d8911bf8 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:27:43.596964 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df2e9e1-92d5-4e86-9a80-60d5d8911bf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:27:43.597235 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df2e9e1-92d5-4e86-9a80-60d5d8911bf8 admin admin] PATH_INFO: `/v3/projects/26e358bfb5294c7f9855f86b5dbeedac` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:27:43.607254 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df2e9e1-92d5-4e86-9a80-60d5d8911bf8 admin admin] RBAC: Authorizing `identity:get_project(project_id=26e358bfb5294c7f9855f86b5dbeedac)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:27:43.609365 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df2e9e1-92d5-4e86-9a80-60d5d8911bf8 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:27:43.611063 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 655/1322] 10.222.0.117 () {56 vars in 1212 bytes} [Tue Jan 25 02:27:43 2022] GET /identity/v3/projects/26e358bfb5294c7f9855f86b5dbeedac => generated 299 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:27:43.622770 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426291c1-5e62-40a7-b12b-8c23d09dc1ae None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:27:43.624017 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-426291c1-5e62-40a7-b12b-8c23d09dc1ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:27:43.712343 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426291c1-5e62-40a7-b12b-8c23d09dc1ae None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:27:43.781289 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a12a673-b314-4791-a157-91587020b67e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca4071c5f8f4a31b5edb81fa66a43a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:27:43.781859 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a12a673-b314-4791-a157-91587020b67e service neutron] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:27:43.782140 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a12a673-b314-4791-a157-91587020b67e service neutron] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:27:43.782412 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a12a673-b314-4791-a157-91587020b67e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:27:43.784618 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-5a12a673-b314-4791-a157-91587020b67e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:27:43.887251 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a12a673-b314-4791-a157-91587020b67e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:27:43.888723 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a12a673-b314-4791-a157-91587020b67e service neutron] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:27:43.906379 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 668/1323] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:27:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:27:46.669156 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5add80-a948-4fbe-a3a3-91e4a17b4197 None None] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:27:46.669694 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5add80-a948-4fbe-a3a3-91e4a17b4197 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:27:46.669694 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5add80-a948-4fbe-a3a3-91e4a17b4197 None None] PATH_INFO: `/` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:27:46.671486 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 656/1324] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:27:46 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:27:46.677074 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb3da29-2ca7-434c-af64-9dc60b39771d None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:27:46.677527 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb3da29-2ca7-434c-af64-9dc60b39771d None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:27:46.677763 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb3da29-2ca7-434c-af64-9dc60b39771d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:27:46.742293 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-ddb3da29-2ca7-434c-af64-9dc60b39771d None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:27:46.743488 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-ddb3da29-2ca7-434c-af64-9dc60b39771d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:27:46.842273 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 669/1325] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:27:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:27:46.875935 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5add80-a948-4fbe-a3a3-91e4a17b4197 None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:27:46.878183 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-2c5add80-a948-4fbe-a3a3-91e4a17b4197 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:27:47.003330 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5add80-a948-4fbe-a3a3-91e4a17b4197 None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:27:47.094093 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06c679a-9be8-4e49-887c-bd83aa1236e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:27:47.094945 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06c679a-9be8-4e49-887c-bd83aa1236e8 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:27:47.095224 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06c679a-9be8-4e49-887c-bd83aa1236e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:27:47.095502 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06c679a-9be8-4e49-887c-bd83aa1236e8 admin admin] PATH_INFO: `/v3/projects/26e358bfb5294c7f9855f86b5dbeedac` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:27:47.104920 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06c679a-9be8-4e49-887c-bd83aa1236e8 admin admin] RBAC: Authorizing `identity:get_project(project_id=26e358bfb5294c7f9855f86b5dbeedac)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:27:47.106965 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06c679a-9be8-4e49-887c-bd83aa1236e8 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:27:47.108671 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 657/1326] 10.222.0.117 () {56 vars in 1212 bytes} [Tue Jan 25 02:27:46 2022] GET /identity/v3/projects/26e358bfb5294c7f9855f86b5dbeedac => generated 299 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:27:47.136722 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e163563-59b4-4b31-b104-7b42b0a01c9b None None] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:27:47.137009 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e163563-59b4-4b31-b104-7b42b0a01c9b None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:27:47.137284 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e163563-59b4-4b31-b104-7b42b0a01c9b None None] PATH_INFO: `/` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:27:47.139051 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 670/1327] 10.222.0.117 () {54 vars in 969 bytes} [Tue Jan 25 02:27:47 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:27:47.146214 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77347c31-e981-4537-b87b-fd99a7e60727 None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:27:47.146507 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77347c31-e981-4537-b87b-fd99a7e60727 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:27:47.146788 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77347c31-e981-4537-b87b-fd99a7e60727 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:27:47.220685 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-77347c31-e981-4537-b87b-fd99a7e60727 None None] MFA Rules not processed for user `9ca4071c5f8f4a31b5edb81fa66a43a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:27:47.221971 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-77347c31-e981-4537-b87b-fd99a7e60727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:27:47.294796 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 658/1328] 10.222.0.117 () {58 vars in 1066 bytes} [Tue Jan 25 02:27:47 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:27:47.304110 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e163563-59b4-4b31-b104-7b42b0a01c9b None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:27:47.305629 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-6e163563-59b4-4b31-b104-7b42b0a01c9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:27:47.404991 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e163563-59b4-4b31-b104-7b42b0a01c9b None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:27:47.476688 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c532a576-7afa-447d-b6ee-1b9a87d0a8f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca4071c5f8f4a31b5edb81fa66a43a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:27:47.477329 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c532a576-7afa-447d-b6ee-1b9a87d0a8f6 service neutron] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:27:47.477612 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c532a576-7afa-447d-b6ee-1b9a87d0a8f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:27:47.477887 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c532a576-7afa-447d-b6ee-1b9a87d0a8f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:27:47.479526 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-c532a576-7afa-447d-b6ee-1b9a87d0a8f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:27:47.583294 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c532a576-7afa-447d-b6ee-1b9a87d0a8f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:27:47.584701 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c532a576-7afa-447d-b6ee-1b9a87d0a8f6 service neutron] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:27:47.602944 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 671/1329] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:27:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:27:50.967133 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdad9c7-52fd-4328-a003-7f2e6f25e437 None None] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:27:50.967650 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdad9c7-52fd-4328-a003-7f2e6f25e437 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:27:50.967785 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdad9c7-52fd-4328-a003-7f2e6f25e437 None None] PATH_INFO: `/` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:27:50.969541 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 659/1330] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:27:50 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:27:50.975143 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ebd041-64bd-4190-acf6-07262d0ed4e6 None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:27:50.975564 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ebd041-64bd-4190-acf6-07262d0ed4e6 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:27:50.975771 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ebd041-64bd-4190-acf6-07262d0ed4e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:27:51.038813 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-31ebd041-64bd-4190-acf6-07262d0ed4e6 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:27:51.040037 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-31ebd041-64bd-4190-acf6-07262d0ed4e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:27:51.133950 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 672/1331] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:27:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:27:51.169905 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdad9c7-52fd-4328-a003-7f2e6f25e437 None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:27:51.171432 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-7cdad9c7-52fd-4328-a003-7f2e6f25e437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:27:51.273608 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdad9c7-52fd-4328-a003-7f2e6f25e437 None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:27:51.344807 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df093d1-a875-4b34-b2d2-544daaf3084c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca4071c5f8f4a31b5edb81fa66a43a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:27:51.345973 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df093d1-a875-4b34-b2d2-544daaf3084c service neutron] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:27:51.346424 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df093d1-a875-4b34-b2d2-544daaf3084c service neutron] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:27:51.346838 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df093d1-a875-4b34-b2d2-544daaf3084c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:27:51.348512 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-4df093d1-a875-4b34-b2d2-544daaf3084c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:27:51.455194 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df093d1-a875-4b34-b2d2-544daaf3084c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:27:51.456701 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df093d1-a875-4b34-b2d2-544daaf3084c service neutron] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:27:51.477199 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 660/1332] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:27:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:27:53.822518 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f41118-3571-40b9-b3ce-941401d5b434 None None] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:27:53.823064 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f41118-3571-40b9-b3ce-941401d5b434 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:27:53.823064 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f41118-3571-40b9-b3ce-941401d5b434 None None] PATH_INFO: `/` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:27:53.825019 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 673/1333] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:27:53 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:27:53.830493 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064d73b1-3838-4226-ad45-486c98deafb8 None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:27:53.830925 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064d73b1-3838-4226-ad45-486c98deafb8 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:27:53.831044 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064d73b1-3838-4226-ad45-486c98deafb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:27:53.896257 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-064d73b1-3838-4226-ad45-486c98deafb8 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:27:53.897471 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-064d73b1-3838-4226-ad45-486c98deafb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:27:53.991002 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 661/1334] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:27:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:27:54.026731 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f41118-3571-40b9-b3ce-941401d5b434 None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:27:54.028291 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-60f41118-3571-40b9-b3ce-941401d5b434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:27:54.127119 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f41118-3571-40b9-b3ce-941401d5b434 None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:27:54.197935 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf40e1fe-af04-4dd4-ae5b-0eba0a69385a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca4071c5f8f4a31b5edb81fa66a43a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:27:54.198583 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf40e1fe-af04-4dd4-ae5b-0eba0a69385a service neutron] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:27:54.198875 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf40e1fe-af04-4dd4-ae5b-0eba0a69385a service neutron] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:27:54.199155 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf40e1fe-af04-4dd4-ae5b-0eba0a69385a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:27:54.200838 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-bf40e1fe-af04-4dd4-ae5b-0eba0a69385a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:27:54.427373 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf40e1fe-af04-4dd4-ae5b-0eba0a69385a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:27:54.428770 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf40e1fe-af04-4dd4-ae5b-0eba0a69385a service neutron] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:27:54.447105 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 674/1335] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:27:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:27:56.776300 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7994614-1f1c-4e50-8bff-bdb17e593370 None None] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:27:56.776842 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7994614-1f1c-4e50-8bff-bdb17e593370 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:27:56.776842 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7994614-1f1c-4e50-8bff-bdb17e593370 None None] PATH_INFO: `/` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:27:56.778629 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 662/1336] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:27:56 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:27:56.784660 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ccd026-d3b3-40df-b825-15d0dbb8c059 None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:27:56.785099 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ccd026-d3b3-40df-b825-15d0dbb8c059 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:27:56.785344 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ccd026-d3b3-40df-b825-15d0dbb8c059 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:27:56.848200 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-24ccd026-d3b3-40df-b825-15d0dbb8c059 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:27:56.849397 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-24ccd026-d3b3-40df-b825-15d0dbb8c059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:27:56.940691 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 675/1337] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:27:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:27:56.973638 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7994614-1f1c-4e50-8bff-bdb17e593370 None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:27:56.975157 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-d7994614-1f1c-4e50-8bff-bdb17e593370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:27:57.096602 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7994614-1f1c-4e50-8bff-bdb17e593370 None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:27:57.185728 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da872f5-da6e-4d1c-8ed7-8450ab850115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:27:57.186587 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da872f5-da6e-4d1c-8ed7-8450ab850115 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:27:57.186869 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da872f5-da6e-4d1c-8ed7-8450ab850115 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:27:57.187146 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da872f5-da6e-4d1c-8ed7-8450ab850115 admin admin] PATH_INFO: `/v3/projects/26e358bfb5294c7f9855f86b5dbeedac` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:27:57.197075 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da872f5-da6e-4d1c-8ed7-8450ab850115 admin admin] RBAC: Authorizing `identity:get_project(project_id=26e358bfb5294c7f9855f86b5dbeedac)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:27:57.199069 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da872f5-da6e-4d1c-8ed7-8450ab850115 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:27:57.200839 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 663/1338] 10.222.0.117 () {56 vars in 1212 bytes} [Tue Jan 25 02:27:56 2022] GET /identity/v3/projects/26e358bfb5294c7f9855f86b5dbeedac => generated 299 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:27:57.212708 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ccd026-d3b3-40df-b825-15d0dbb8c059 None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:27:57.214095 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-24ccd026-d3b3-40df-b825-15d0dbb8c059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:27:57.317770 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ccd026-d3b3-40df-b825-15d0dbb8c059 None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:27:57.389926 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca0f91d-d436-49f7-8d8c-ba0e8037fa3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca4071c5f8f4a31b5edb81fa66a43a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:27:57.390571 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca0f91d-d436-49f7-8d8c-ba0e8037fa3a service neutron] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:27:57.390857 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca0f91d-d436-49f7-8d8c-ba0e8037fa3a service neutron] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:27:57.391129 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca0f91d-d436-49f7-8d8c-ba0e8037fa3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:27:57.392829 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-9ca0f91d-d436-49f7-8d8c-ba0e8037fa3a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:27:57.500923 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca0f91d-d436-49f7-8d8c-ba0e8037fa3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:27:57.502492 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca0f91d-d436-49f7-8d8c-ba0e8037fa3a service neutron] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:27:57.525594 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 676/1339] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:27:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:28:00.069523 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd357db2-78a0-40df-872e-9510165f031c None None] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:28:00.069994 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd357db2-78a0-40df-872e-9510165f031c None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:28:00.070185 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd357db2-78a0-40df-872e-9510165f031c None None] PATH_INFO: `/` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:28:00.071932 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 664/1340] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:28:00 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:28:00.077550 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3d7d13-9e75-48b6-b5cd-21a24b8f1143 None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:28:00.078047 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3d7d13-9e75-48b6-b5cd-21a24b8f1143 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:28:00.078152 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3d7d13-9e75-48b6-b5cd-21a24b8f1143 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:28:00.145597 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-8d3d7d13-9e75-48b6-b5cd-21a24b8f1143 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:28:00.146727 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-8d3d7d13-9e75-48b6-b5cd-21a24b8f1143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:28:00.239516 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 677/1341] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:28:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:28:00.275242 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd357db2-78a0-40df-872e-9510165f031c None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:28:00.276822 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-dd357db2-78a0-40df-872e-9510165f031c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:28:00.377933 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd357db2-78a0-40df-872e-9510165f031c None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:28:00.448057 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69642746-9f79-4231-996e-8a1afbdce6c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca4071c5f8f4a31b5edb81fa66a43a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:28:00.448637 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69642746-9f79-4231-996e-8a1afbdce6c9 service neutron] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:28:00.448922 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69642746-9f79-4231-996e-8a1afbdce6c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:28:00.449198 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69642746-9f79-4231-996e-8a1afbdce6c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:28:00.450839 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-69642746-9f79-4231-996e-8a1afbdce6c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:28:00.556034 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69642746-9f79-4231-996e-8a1afbdce6c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:28:00.557459 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69642746-9f79-4231-996e-8a1afbdce6c9 service neutron] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:28:00.575069 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 665/1342] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:28:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:28:02.890449 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cdae4c-b64b-408b-9d13-d9b039eba2c8 None None] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:28:02.890907 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cdae4c-b64b-408b-9d13-d9b039eba2c8 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:28:02.891016 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cdae4c-b64b-408b-9d13-d9b039eba2c8 None None] PATH_INFO: `/` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:28:02.895766 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 678/1343] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:28:02 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:28:02.898734 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091ff308-3aaa-48fc-9647-8dcd38b4b570 None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:28:02.899177 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091ff308-3aaa-48fc-9647-8dcd38b4b570 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:28:02.899319 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091ff308-3aaa-48fc-9647-8dcd38b4b570 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:28:02.976929 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-091ff308-3aaa-48fc-9647-8dcd38b4b570 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:28:02.978135 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-091ff308-3aaa-48fc-9647-8dcd38b4b570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:28:03.076809 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 666/1344] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:28:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:28:03.112612 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cdae4c-b64b-408b-9d13-d9b039eba2c8 None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:28:03.125902 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cdae4c-b64b-408b-9d13-d9b039eba2c8 None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:28:03.130468 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f642f9f1-96c0-4477-8736-117e43112306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:28:03.131300 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f642f9f1-96c0-4477-8736-117e43112306 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:28:03.131581 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f642f9f1-96c0-4477-8736-117e43112306 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:28:03.131882 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f642f9f1-96c0-4477-8736-117e43112306 admin admin] PATH_INFO: `/v3/projects/705a3c6650674528a0096768eea3fe81` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:28:03.133074 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f642f9f1-96c0-4477-8736-117e43112306 admin admin] RBAC: Authorizing `identity:get_project(project_id=705a3c6650674528a0096768eea3fe81)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:28:03.134855 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f642f9f1-96c0-4477-8736-117e43112306 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:28:03.136515 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 679/1345] 10.222.0.117 () {56 vars in 1212 bytes} [Tue Jan 25 02:28:03 2022] GET /identity/v3/projects/705a3c6650674528a0096768eea3fe81 => generated 345 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:28:03.148528 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091ff308-3aaa-48fc-9647-8dcd38b4b570 None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:28:03.149919 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-091ff308-3aaa-48fc-9647-8dcd38b4b570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:28:03.240174 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091ff308-3aaa-48fc-9647-8dcd38b4b570 None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:28:03.243812 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b858cf86-e245-47ee-8858-cde74a3c2c92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca4071c5f8f4a31b5edb81fa66a43a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:28:03.244428 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b858cf86-e245-47ee-8858-cde74a3c2c92 service neutron] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:28:03.244705 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b858cf86-e245-47ee-8858-cde74a3c2c92 service neutron] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:28:03.244977 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b858cf86-e245-47ee-8858-cde74a3c2c92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:28:03.253685 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b858cf86-e245-47ee-8858-cde74a3c2c92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:28:03.255106 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b858cf86-e245-47ee-8858-cde74a3c2c92 service neutron] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:28:03.264150 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 667/1346] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:28:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 25 02:28:05.793055 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029817f5-cbf6-41aa-9920-10c25220ebf5 None None] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:28:05.793603 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029817f5-cbf6-41aa-9920-10c25220ebf5 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:28:05.793603 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029817f5-cbf6-41aa-9920-10c25220ebf5 None None] PATH_INFO: `/` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:28:05.795354 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 680/1347] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:28:05 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:28:05.801171 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1f0cdb-6ee1-4d78-91dc-143089a0f975 None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:28:05.801576 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1f0cdb-6ee1-4d78-91dc-143089a0f975 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:28:05.801734 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1f0cdb-6ee1-4d78-91dc-143089a0f975 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:28:05.818785 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-2b1f0cdb-6ee1-4d78-91dc-143089a0f975 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:28:05.820012 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-2b1f0cdb-6ee1-4d78-91dc-143089a0f975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:28:05.827972 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 668/1348] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:28:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:28:05.865041 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029817f5-cbf6-41aa-9920-10c25220ebf5 None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:28:05.866717 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-029817f5-cbf6-41aa-9920-10c25220ebf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:28:05.879740 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029817f5-cbf6-41aa-9920-10c25220ebf5 None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:28:05.883206 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1eee9c1-a5b7-444c-adb9-c7a0efc15de8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca4071c5f8f4a31b5edb81fa66a43a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:28:05.883869 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eee9c1-a5b7-444c-adb9-c7a0efc15de8 service neutron] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:28:05.884148 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eee9c1-a5b7-444c-adb9-c7a0efc15de8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:28:05.884419 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eee9c1-a5b7-444c-adb9-c7a0efc15de8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:28:05.893757 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1eee9c1-a5b7-444c-adb9-c7a0efc15de8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:28:05.895378 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1eee9c1-a5b7-444c-adb9-c7a0efc15de8 service neutron] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:28:05.904605 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 681/1349] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:28:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:28:10.034163 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa826064-349f-4041-9f48-7145fef28111 None None] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:28:10.034695 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa826064-349f-4041-9f48-7145fef28111 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:28:10.034695 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa826064-349f-4041-9f48-7145fef28111 None None] PATH_INFO: `/` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:28:10.036537 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 669/1350] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:28:10 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:28:10.041747 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ff949d-36ec-4b05-b4e4-71ff58a9963e None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:28:10.042158 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ff949d-36ec-4b05-b4e4-71ff58a9963e None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:28:10.042310 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ff949d-36ec-4b05-b4e4-71ff58a9963e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:28:10.060411 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-c5ff949d-36ec-4b05-b4e4-71ff58a9963e None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:28:10.061610 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-c5ff949d-36ec-4b05-b4e4-71ff58a9963e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:28:10.070252 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 682/1351] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:28:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:28:10.093357 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa826064-349f-4041-9f48-7145fef28111 None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:28:10.106106 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa826064-349f-4041-9f48-7145fef28111 None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:28:10.111392 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1534ef96-f2b4-427f-b1c5-a90d808bb497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:28:10.112060 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1534ef96-f2b4-427f-b1c5-a90d808bb497 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:28:10.112348 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1534ef96-f2b4-427f-b1c5-a90d808bb497 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:28:10.112628 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1534ef96-f2b4-427f-b1c5-a90d808bb497 admin admin] PATH_INFO: `/v3/projects` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:28:10.113376 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1534ef96-f2b4-427f-b1c5-a90d808bb497 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:28:10.115241 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1534ef96-f2b4-427f-b1c5-a90d808bb497 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:28:10.129143 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 670/1352] 10.222.0.117 () {56 vars in 1113 bytes} [Tue Jan 25 02:28:10 2022] GET /identity/v3/projects => generated 2562 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 02:28:12.399141 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544ba4db-fcfc-4df9-a481-15074840160b None None] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:28:12.399729 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544ba4db-fcfc-4df9-a481-15074840160b None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:28:12.399729 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544ba4db-fcfc-4df9-a481-15074840160b None None] PATH_INFO: `/` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:28:12.401497 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 683/1353] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:28:12 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:28:12.406785 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7d40e9-6584-4153-8550-098c1305e81f None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:28:12.407733 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7d40e9-6584-4153-8550-098c1305e81f None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:28:12.408124 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7d40e9-6584-4153-8550-098c1305e81f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:28:12.426859 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-bf7d40e9-6584-4153-8550-098c1305e81f None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:28:12.428138 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-bf7d40e9-6584-4153-8550-098c1305e81f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:28:12.436273 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 671/1354] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:28:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:28:12.471272 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544ba4db-fcfc-4df9-a481-15074840160b None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:28:12.483531 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544ba4db-fcfc-4df9-a481-15074840160b None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:28:12.488663 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be05e451-2806-4121-a6f2-c6fd64b57e34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:28:12.489504 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be05e451-2806-4121-a6f2-c6fd64b57e34 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:28:12.489788 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be05e451-2806-4121-a6f2-c6fd64b57e34 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:28:12.490065 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be05e451-2806-4121-a6f2-c6fd64b57e34 admin admin] PATH_INFO: `/v3/projects/705a3c6650674528a0096768eea3fe81` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:28:12.491274 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be05e451-2806-4121-a6f2-c6fd64b57e34 admin admin] RBAC: Authorizing `identity:get_project(project_id=705a3c6650674528a0096768eea3fe81)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:28:12.493098 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be05e451-2806-4121-a6f2-c6fd64b57e34 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:28:12.494747 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 684/1355] 10.222.0.117 () {56 vars in 1212 bytes} [Tue Jan 25 02:28:12 2022] GET /identity/v3/projects/705a3c6650674528a0096768eea3fe81 => generated 345 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:28:12.506677 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7d40e9-6584-4153-8550-098c1305e81f None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:28:12.516161 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7d40e9-6584-4153-8550-098c1305e81f None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:28:12.520406 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33494c3a-786a-42a7-abed-326a1545332b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca4071c5f8f4a31b5edb81fa66a43a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:28:12.521079 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33494c3a-786a-42a7-abed-326a1545332b service neutron] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:28:12.521394 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33494c3a-786a-42a7-abed-326a1545332b service neutron] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:28:12.521668 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33494c3a-786a-42a7-abed-326a1545332b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:28:12.530645 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33494c3a-786a-42a7-abed-326a1545332b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:28:12.532643 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33494c3a-786a-42a7-abed-326a1545332b service neutron] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:28:12.542525 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 672/1356] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:28:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:28:15.386962 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f50b2d-41af-4d5f-b9dc-64b6ba9912d2 None None] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:28:15.387490 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f50b2d-41af-4d5f-b9dc-64b6ba9912d2 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:28:15.387490 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f50b2d-41af-4d5f-b9dc-64b6ba9912d2 None None] PATH_INFO: `/` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:28:15.389192 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 685/1357] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:28:15 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:28:15.394593 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c165b516-831a-45c3-bb6b-c589d7efd83e None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:28:15.395037 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c165b516-831a-45c3-bb6b-c589d7efd83e None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:28:15.395148 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c165b516-831a-45c3-bb6b-c589d7efd83e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:28:15.417292 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-c165b516-831a-45c3-bb6b-c589d7efd83e None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:28:15.418583 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-c165b516-831a-45c3-bb6b-c589d7efd83e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:28:15.427471 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 673/1358] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:28:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:28:15.465095 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f50b2d-41af-4d5f-b9dc-64b6ba9912d2 None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:28:15.477369 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f50b2d-41af-4d5f-b9dc-64b6ba9912d2 None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:28:15.480891 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc4002f-154d-41e7-addb-9e4f085d92d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca4071c5f8f4a31b5edb81fa66a43a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:28:15.481530 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc4002f-154d-41e7-addb-9e4f085d92d8 service neutron] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:28:15.481810 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc4002f-154d-41e7-addb-9e4f085d92d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:28:15.482085 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc4002f-154d-41e7-addb-9e4f085d92d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:28:15.492508 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc4002f-154d-41e7-addb-9e4f085d92d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:28:15.493943 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc4002f-154d-41e7-addb-9e4f085d92d8 service neutron] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:28:15.503454 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 686/1359] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:28:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:28:20.090617 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fa6470-ef6a-4da4-9273-65c8d2ca7255 None None] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:28:20.091207 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fa6470-ef6a-4da4-9273-65c8d2ca7255 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:28:20.091207 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fa6470-ef6a-4da4-9273-65c8d2ca7255 None None] PATH_INFO: `/` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:28:20.093044 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 674/1360] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:28:20 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:28:20.099178 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c5ff7d-0728-4730-a824-0b4215ae67c3 None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:28:20.099754 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c5ff7d-0728-4730-a824-0b4215ae67c3 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:28:20.099754 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c5ff7d-0728-4730-a824-0b4215ae67c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:28:20.118863 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-b5c5ff7d-0728-4730-a824-0b4215ae67c3 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:28:20.120132 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-b5c5ff7d-0728-4730-a824-0b4215ae67c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:28:20.128224 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 687/1361] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:28:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:28:20.166467 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fa6470-ef6a-4da4-9273-65c8d2ca7255 None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:28:20.177887 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fa6470-ef6a-4da4-9273-65c8d2ca7255 None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:28:20.181879 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc2e782-bd75-481a-a827-73838bc45c8e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca4071c5f8f4a31b5edb81fa66a43a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:28:20.182456 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc2e782-bd75-481a-a827-73838bc45c8e service neutron] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:28:20.182740 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc2e782-bd75-481a-a827-73838bc45c8e service neutron] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:28:20.183009 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc2e782-bd75-481a-a827-73838bc45c8e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:28:20.192575 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc2e782-bd75-481a-a827-73838bc45c8e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:28:20.194026 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc2e782-bd75-481a-a827-73838bc45c8e service neutron] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:28:20.204668 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 675/1362] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:28:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:28:25.192504 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002e7893-a976-47ea-ad44-5896af3bc6c3 None None] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:28:25.192920 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002e7893-a976-47ea-ad44-5896af3bc6c3 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:28:25.192920 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002e7893-a976-47ea-ad44-5896af3bc6c3 None None] PATH_INFO: `/` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:28:25.194965 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 688/1363] 10.222.0.117 () {54 vars in 926 bytes} [Tue Jan 25 02:28:25 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:28:25.205584 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c78f6c8-40ae-4378-8aeb-ad9d7b6fc323 None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:28:25.206407 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c78f6c8-40ae-4378-8aeb-ad9d7b6fc323 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:28:25.206910 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c78f6c8-40ae-4378-8aeb-ad9d7b6fc323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:28:25.346938 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-3c78f6c8-40ae-4378-8aeb-ad9d7b6fc323 None None] MFA Rules not processed for user `890151a6bf2840f0a0a00f45dd2d38a4`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:28:25.348409 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-3c78f6c8-40ae-4378-8aeb-ad9d7b6fc323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:28:25.422281 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 676/1364] 10.222.0.117 () {58 vars in 1023 bytes} [Tue Jan 25 02:28:25 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:28:29.880514 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34695b7-53df-482d-a12b-c964e00c19de None None] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:28:29.881023 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34695b7-53df-482d-a12b-c964e00c19de None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:28:29.881135 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34695b7-53df-482d-a12b-c964e00c19de None None] PATH_INFO: `/` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:28:29.883152 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 689/1365] 10.222.0.117 () {54 vars in 926 bytes} [Tue Jan 25 02:28:29 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:28:29.888765 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf7c2e7-a76c-4654-8a06-888327903ba5 None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:28:29.889190 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf7c2e7-a76c-4654-8a06-888327903ba5 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:28:29.889548 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf7c2e7-a76c-4654-8a06-888327903ba5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:28:29.908417 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-2bf7c2e7-a76c-4654-8a06-888327903ba5 None None] MFA Rules not processed for user `890151a6bf2840f0a0a00f45dd2d38a4`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:28:29.909757 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-2bf7c2e7-a76c-4654-8a06-888327903ba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:28:29.918311 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 677/1366] 10.222.0.117 () {58 vars in 1023 bytes} [Tue Jan 25 02:28:29 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:28:31.339926 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a06f13-a1f8-42c4-b49b-a33c084b726e None None] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:28:31.340439 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a06f13-a1f8-42c4-b49b-a33c084b726e None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:28:31.340519 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a06f13-a1f8-42c4-b49b-a33c084b726e None None] PATH_INFO: `/` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:28:31.342223 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 690/1367] 10.222.0.117 () {54 vars in 926 bytes} [Tue Jan 25 02:28:31 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:28:31.347977 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79342a63-aaf5-4319-aaa9-512f7e75ad0c None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:28:31.348416 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79342a63-aaf5-4319-aaa9-512f7e75ad0c None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:28:31.348606 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79342a63-aaf5-4319-aaa9-512f7e75ad0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:28:31.367257 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-79342a63-aaf5-4319-aaa9-512f7e75ad0c None None] MFA Rules not processed for user `890151a6bf2840f0a0a00f45dd2d38a4`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:28:31.368487 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-79342a63-aaf5-4319-aaa9-512f7e75ad0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:28:31.377085 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 678/1368] 10.222.0.117 () {58 vars in 1023 bytes} [Tue Jan 25 02:28:31 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 25 02:28:35.242189 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac9cbe6-e8f0-4aa4-b7b3-69690d016525 None None] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:28:35.242710 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac9cbe6-e8f0-4aa4-b7b3-69690d016525 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:28:35.242817 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac9cbe6-e8f0-4aa4-b7b3-69690d016525 None None] PATH_INFO: `/` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:28:35.244525 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 691/1369] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:28:35 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:28:35.249874 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cb3545-d7ed-4b7a-9a78-6c6af0cb8db0 None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:28:35.250396 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cb3545-d7ed-4b7a-9a78-6c6af0cb8db0 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:28:35.250530 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cb3545-d7ed-4b7a-9a78-6c6af0cb8db0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:28:35.268523 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-38cb3545-d7ed-4b7a-9a78-6c6af0cb8db0 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:28:35.269725 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-38cb3545-d7ed-4b7a-9a78-6c6af0cb8db0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:28:35.277624 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 679/1370] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:28:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:28:35.325922 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39329fb7-f0e6-43fe-8dce-a839b9140219 None None] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:28:35.326287 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39329fb7-f0e6-43fe-8dce-a839b9140219 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:28:35.326656 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39329fb7-f0e6-43fe-8dce-a839b9140219 None None] PATH_INFO: `/` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:28:35.329324 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 692/1371] 10.222.0.117 () {54 vars in 966 bytes} [Tue Jan 25 02:28:35 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:28:35.334612 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d0b456-1b07-4d3c-b491-d91661b16050 None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:28:35.335027 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d0b456-1b07-4d3c-b491-d91661b16050 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:28:35.335315 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d0b456-1b07-4d3c-b491-d91661b16050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:28:35.383852 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-76d0b456-1b07-4d3c-b491-d91661b16050 None None] MFA Rules not processed for user `d9ad6269900346458050063c12cac299`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:28:35.385030 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-76d0b456-1b07-4d3c-b491-d91661b16050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:28:35.466367 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 680/1372] 10.222.0.117 () {58 vars in 1063 bytes} [Tue Jan 25 02:28:35 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:28:35.476507 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39329fb7-f0e6-43fe-8dce-a839b9140219 None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:28:35.492129 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39329fb7-f0e6-43fe-8dce-a839b9140219 None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:28:35.499380 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d54b80-ee31-428d-8584-878de7155f7d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9ad6269900346458050063c12cac299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:28:35.501112 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d54b80-ee31-428d-8584-878de7155f7d service nova] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:28:35.501708 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d54b80-ee31-428d-8584-878de7155f7d service nova] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:28:35.502210 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d54b80-ee31-428d-8584-878de7155f7d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:28:35.511502 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d54b80-ee31-428d-8584-878de7155f7d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:28:35.513470 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d54b80-ee31-428d-8584-878de7155f7d service nova] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:28:35.524092 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 693/1373] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:28:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 25 02:28:38.034534 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b83c4b-62bc-48f8-840a-05c88e81540e None None] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:28:38.035152 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b83c4b-62bc-48f8-840a-05c88e81540e None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:28:38.035406 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b83c4b-62bc-48f8-840a-05c88e81540e None None] PATH_INFO: `/` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:28:38.038158 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 681/1374] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:28:38 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:28:38.044612 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce0c594-3803-4b91-a9cc-adf3ae1f133e None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:28:38.045080 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce0c594-3803-4b91-a9cc-adf3ae1f133e None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:28:38.045339 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce0c594-3803-4b91-a9cc-adf3ae1f133e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:28:38.067636 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-4ce0c594-3803-4b91-a9cc-adf3ae1f133e None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:28:38.069374 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-4ce0c594-3803-4b91-a9cc-adf3ae1f133e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:28:38.081355 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 694/1375] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:28:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:28:38.136286 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b83c4b-62bc-48f8-840a-05c88e81540e None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:28:38.152711 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b83c4b-62bc-48f8-840a-05c88e81540e None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:28:38.159578 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c149d09-011b-4eba-a3e2-5f81f50b0d4d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9ad6269900346458050063c12cac299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:28:38.160257 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c149d09-011b-4eba-a3e2-5f81f50b0d4d service nova] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:28:38.160538 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c149d09-011b-4eba-a3e2-5f81f50b0d4d service nova] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:28:38.160811 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c149d09-011b-4eba-a3e2-5f81f50b0d4d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:28:38.172727 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c149d09-011b-4eba-a3e2-5f81f50b0d4d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:28:38.174575 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c149d09-011b-4eba-a3e2-5f81f50b0d4d service nova] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:28:38.185642 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 682/1376] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:28:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:28:40.934528 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f05bff-a239-4a78-bf88-5ca066aa3a42 None None] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:28:40.935036 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f05bff-a239-4a78-bf88-5ca066aa3a42 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:28:40.935036 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f05bff-a239-4a78-bf88-5ca066aa3a42 None None] PATH_INFO: `/` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:28:40.936794 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 695/1377] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:28:40 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:28:40.942196 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b39326c-0ecb-46fb-83de-6b1ea5450831 None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:28:40.942616 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b39326c-0ecb-46fb-83de-6b1ea5450831 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:28:40.942781 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b39326c-0ecb-46fb-83de-6b1ea5450831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:28:40.960591 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-4b39326c-0ecb-46fb-83de-6b1ea5450831 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:28:40.961808 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-4b39326c-0ecb-46fb-83de-6b1ea5450831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:28:40.970409 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 683/1378] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:28:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:28:41.016029 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57bdd72-33f0-4914-a883-88dcdc46ca81 None None] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:28:41.016319 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57bdd72-33f0-4914-a883-88dcdc46ca81 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:28:41.016597 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57bdd72-33f0-4914-a883-88dcdc46ca81 None None] PATH_INFO: `/` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:28:41.018355 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 696/1379] 10.222.0.117 () {54 vars in 966 bytes} [Tue Jan 25 02:28:41 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:28:41.023836 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80028cf2-7961-4082-926c-e9f973fdcd96 None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:28:41.024131 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80028cf2-7961-4082-926c-e9f973fdcd96 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:28:41.024414 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80028cf2-7961-4082-926c-e9f973fdcd96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:28:41.043550 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-80028cf2-7961-4082-926c-e9f973fdcd96 None None] MFA Rules not processed for user `d9ad6269900346458050063c12cac299`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:28:41.044789 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-80028cf2-7961-4082-926c-e9f973fdcd96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:28:41.055128 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 684/1380] 10.222.0.117 () {58 vars in 1063 bytes} [Tue Jan 25 02:28:41 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 25 02:28:41.062887 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57bdd72-33f0-4914-a883-88dcdc46ca81 None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:28:41.076874 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57bdd72-33f0-4914-a883-88dcdc46ca81 None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:28:41.082530 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae44726-469a-4a65-bc37-110114d1bf7b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9ad6269900346458050063c12cac299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:28:41.083162 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae44726-469a-4a65-bc37-110114d1bf7b service nova] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:28:41.083448 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae44726-469a-4a65-bc37-110114d1bf7b service nova] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:28:41.083755 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae44726-469a-4a65-bc37-110114d1bf7b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:28:41.092267 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae44726-469a-4a65-bc37-110114d1bf7b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:28:41.094523 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae44726-469a-4a65-bc37-110114d1bf7b service nova] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:28:41.104116 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 697/1381] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:28:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 25 02:28:43.426965 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c81b9a-f8bf-471b-9f78-43497fcd3292 None None] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:28:43.427861 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c81b9a-f8bf-471b-9f78-43497fcd3292 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:28:43.428291 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c81b9a-f8bf-471b-9f78-43497fcd3292 None None] PATH_INFO: `/` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:28:43.435742 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dbe8fa-2e8a-4ef2-9b78-4ad9a0eaa919 None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:28:43.436532 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dbe8fa-2e8a-4ef2-9b78-4ad9a0eaa919 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:28:43.436943 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dbe8fa-2e8a-4ef2-9b78-4ad9a0eaa919 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:28:43.440348 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 685/1382] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:28:43 2022] GET /identity => generated 271 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:28:43.457223 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-84dbe8fa-2e8a-4ef2-9b78-4ad9a0eaa919 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:28:43.458719 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-84dbe8fa-2e8a-4ef2-9b78-4ad9a0eaa919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:28:43.480347 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 698/1383] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:28:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 25 02:28:43.520540 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c81b9a-f8bf-471b-9f78-43497fcd3292 None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:28:43.544465 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c81b9a-f8bf-471b-9f78-43497fcd3292 None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:28:43.551071 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da287528-a572-47d1-a7cd-98da18944771 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9ad6269900346458050063c12cac299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:28:43.552034 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da287528-a572-47d1-a7cd-98da18944771 service nova] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:28:43.552492 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da287528-a572-47d1-a7cd-98da18944771 service nova] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:28:43.552946 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da287528-a572-47d1-a7cd-98da18944771 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:28:43.563174 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da287528-a572-47d1-a7cd-98da18944771 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:28:43.565109 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da287528-a572-47d1-a7cd-98da18944771 service nova] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:28:43.576174 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 686/1384] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:28:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:28:43.606663 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1211e1-025a-4fb8-812d-f53f1e870fe6 None None] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:28:43.607364 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1211e1-025a-4fb8-812d-f53f1e870fe6 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:28:43.607881 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1211e1-025a-4fb8-812d-f53f1e870fe6 None None] PATH_INFO: `/` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:28:43.610301 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 699/1385] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:28:43 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:28:43.616197 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b420882a-90e6-4ab2-ab4c-47348a2d693e None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:28:43.616799 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b420882a-90e6-4ab2-ab4c-47348a2d693e None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:28:43.617283 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b420882a-90e6-4ab2-ab4c-47348a2d693e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:28:43.636828 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-b420882a-90e6-4ab2-ab4c-47348a2d693e None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:28:43.638370 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-b420882a-90e6-4ab2-ab4c-47348a2d693e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:28:43.648166 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 687/1386] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:28:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 25 02:28:43.918822 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb000d2-8a82-45d4-8a02-40be3d470a19 None None] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:28:43.919234 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb000d2-8a82-45d4-8a02-40be3d470a19 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:28:43.919436 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb000d2-8a82-45d4-8a02-40be3d470a19 None None] PATH_INFO: `/` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:28:43.921249 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 700/1387] 10.222.0.117 () {54 vars in 968 bytes} [Tue Jan 25 02:28:43 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:28:43.928194 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743ba95d-dcf2-44de-846f-255a45b178c3 None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:28:43.928642 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743ba95d-dcf2-44de-846f-255a45b178c3 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:28:43.929199 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743ba95d-dcf2-44de-846f-255a45b178c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:28:43.983023 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-743ba95d-dcf2-44de-846f-255a45b178c3 None None] MFA Rules not processed for user `1cc5249aea09430080e232cf17757f86`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:28:43.985168 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-743ba95d-dcf2-44de-846f-255a45b178c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:28:44.049451 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 688/1388] 10.222.0.117 () {58 vars in 1065 bytes} [Tue Jan 25 02:28:43 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 25 02:28:44.056847 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb000d2-8a82-45d4-8a02-40be3d470a19 None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:28:44.068396 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb000d2-8a82-45d4-8a02-40be3d470a19 None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:28:44.072007 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf251fe-e33c-40f4-8652-db66d507ccaa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cc5249aea09430080e232cf17757f86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:28:44.072705 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf251fe-e33c-40f4-8652-db66d507ccaa service cinder] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:28:44.073053 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf251fe-e33c-40f4-8652-db66d507ccaa service cinder] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:28:44.073395 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf251fe-e33c-40f4-8652-db66d507ccaa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:28:44.090479 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf251fe-e33c-40f4-8652-db66d507ccaa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:28:44.092136 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf251fe-e33c-40f4-8652-db66d507ccaa service cinder] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:28:44.107441 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 701/1389] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:28:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:28:45.927139 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0ac343-b240-4987-a297-f91f8d055213 None None] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:28:45.927625 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0ac343-b240-4987-a297-f91f8d055213 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:28:45.927823 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0ac343-b240-4987-a297-f91f8d055213 None None] PATH_INFO: `/` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:28:45.929529 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 689/1390] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:28:45 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:28:45.935049 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee1a9b9-6116-47bd-ac35-b899014b0db0 None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:28:45.935486 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee1a9b9-6116-47bd-ac35-b899014b0db0 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:28:45.935613 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee1a9b9-6116-47bd-ac35-b899014b0db0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:28:45.955604 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-aee1a9b9-6116-47bd-ac35-b899014b0db0 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:28:45.956926 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-aee1a9b9-6116-47bd-ac35-b899014b0db0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:28:45.965114 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 702/1391] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:28:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:28:46.010473 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0ac343-b240-4987-a297-f91f8d055213 None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:28:46.025546 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0ac343-b240-4987-a297-f91f8d055213 None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:28:46.031628 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccad58a0-3f1c-434a-8289-024f1bf136d8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9ad6269900346458050063c12cac299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:28:46.032387 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccad58a0-3f1c-434a-8289-024f1bf136d8 service nova] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:28:46.032670 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccad58a0-3f1c-434a-8289-024f1bf136d8 service nova] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:28:46.032945 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccad58a0-3f1c-434a-8289-024f1bf136d8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:28:46.041603 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccad58a0-3f1c-434a-8289-024f1bf136d8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:28:46.043199 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccad58a0-3f1c-434a-8289-024f1bf136d8 service nova] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:28:46.053373 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 690/1392] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:28:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:28:48.337653 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25ef08d-3021-4ece-bb41-ae2b301f73c2 None None] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:28:48.338902 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25ef08d-3021-4ece-bb41-ae2b301f73c2 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:28:48.339187 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25ef08d-3021-4ece-bb41-ae2b301f73c2 None None] PATH_INFO: `/` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:28:48.340986 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 703/1393] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:28:48 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:28:48.346928 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c406a63-7182-40f1-b054-122c30e2c4ba None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:28:48.347381 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c406a63-7182-40f1-b054-122c30e2c4ba None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:28:48.347496 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c406a63-7182-40f1-b054-122c30e2c4ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:28:48.365913 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-2c406a63-7182-40f1-b054-122c30e2c4ba None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:28:48.367101 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-2c406a63-7182-40f1-b054-122c30e2c4ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:28:48.374912 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 691/1394] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:28:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:28:48.419516 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25ef08d-3021-4ece-bb41-ae2b301f73c2 None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:28:48.434281 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25ef08d-3021-4ece-bb41-ae2b301f73c2 None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:28:48.440040 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1155e52-ba0e-4bdf-81b5-67db4d1460fd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9ad6269900346458050063c12cac299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:28:48.440676 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1155e52-ba0e-4bdf-81b5-67db4d1460fd service nova] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:28:48.441137 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1155e52-ba0e-4bdf-81b5-67db4d1460fd service nova] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:28:48.441418 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1155e52-ba0e-4bdf-81b5-67db4d1460fd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:28:48.450193 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1155e52-ba0e-4bdf-81b5-67db4d1460fd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:28:48.451802 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1155e52-ba0e-4bdf-81b5-67db4d1460fd service nova] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:28:48.463143 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 704/1395] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:28:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:28:50.759154 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898901ee-66b2-4456-8126-84d1bacf7b9e None None] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:28:50.759979 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898901ee-66b2-4456-8126-84d1bacf7b9e None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:28:50.760439 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898901ee-66b2-4456-8126-84d1bacf7b9e None None] PATH_INFO: `/` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:28:50.762235 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 692/1396] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:28:50 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:28:50.768362 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26280862-4d37-4921-8734-62d45fe87b83 None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:28:50.768797 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26280862-4d37-4921-8734-62d45fe87b83 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:28:50.768923 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26280862-4d37-4921-8734-62d45fe87b83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:28:50.787666 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-26280862-4d37-4921-8734-62d45fe87b83 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:28:50.788885 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-26280862-4d37-4921-8734-62d45fe87b83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:28:50.796868 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 705/1397] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:28:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:28:50.839380 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898901ee-66b2-4456-8126-84d1bacf7b9e None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:28:50.854090 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898901ee-66b2-4456-8126-84d1bacf7b9e None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:28:50.859799 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf157269-8397-4b34-be56-708cad78ede1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9ad6269900346458050063c12cac299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:28:50.860575 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf157269-8397-4b34-be56-708cad78ede1 service nova] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:28:50.860968 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf157269-8397-4b34-be56-708cad78ede1 service nova] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:28:50.861352 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf157269-8397-4b34-be56-708cad78ede1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:28:50.870146 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf157269-8397-4b34-be56-708cad78ede1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:28:50.871913 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf157269-8397-4b34-be56-708cad78ede1 service nova] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:28:50.882776 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 693/1398] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:28:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:28:53.375369 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d167067e-75ad-4151-bb88-e5f40a605d75 None None] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:28:53.376496 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d167067e-75ad-4151-bb88-e5f40a605d75 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:28:53.376496 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d167067e-75ad-4151-bb88-e5f40a605d75 None None] PATH_INFO: `/` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:28:53.377588 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 706/1399] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:28:53 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:28:53.383120 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeae7a7-5a97-4371-905c-c7895ac7cd23 None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:28:53.383600 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeae7a7-5a97-4371-905c-c7895ac7cd23 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:28:53.383727 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeae7a7-5a97-4371-905c-c7895ac7cd23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:28:53.403846 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-ebeae7a7-5a97-4371-905c-c7895ac7cd23 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:28:53.405058 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-ebeae7a7-5a97-4371-905c-c7895ac7cd23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:28:53.413211 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 694/1400] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:28:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 25 02:28:53.460353 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d167067e-75ad-4151-bb88-e5f40a605d75 None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:28:53.478772 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d167067e-75ad-4151-bb88-e5f40a605d75 None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:28:53.486061 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1644b5-851c-4eff-ba76-52347171a735 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9ad6269900346458050063c12cac299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:28:53.486950 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1644b5-851c-4eff-ba76-52347171a735 service nova] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:28:53.487327 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1644b5-851c-4eff-ba76-52347171a735 service nova] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:28:53.487900 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1644b5-851c-4eff-ba76-52347171a735 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:28:53.498057 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1644b5-851c-4eff-ba76-52347171a735 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:28:53.500961 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1644b5-851c-4eff-ba76-52347171a735 service nova] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:28:53.512859 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 707/1401] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:28:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:28:55.823686 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abcf9cd-3f7d-4fde-9190-7c4cb25dcaf0 None None] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:28:55.824257 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abcf9cd-3f7d-4fde-9190-7c4cb25dcaf0 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:28:55.824257 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abcf9cd-3f7d-4fde-9190-7c4cb25dcaf0 None None] PATH_INFO: `/` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:28:55.826086 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 695/1402] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:28:55 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:28:55.831963 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d158fe-b79a-4cf5-b8e4-187b3db4f720 None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:28:55.832395 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d158fe-b79a-4cf5-b8e4-187b3db4f720 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:28:55.832578 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d158fe-b79a-4cf5-b8e4-187b3db4f720 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:28:55.852796 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-69d158fe-b79a-4cf5-b8e4-187b3db4f720 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:28:55.854038 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-69d158fe-b79a-4cf5-b8e4-187b3db4f720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:28:55.862962 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 708/1403] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:28:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:28:55.913419 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abcf9cd-3f7d-4fde-9190-7c4cb25dcaf0 None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:28:55.929222 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abcf9cd-3f7d-4fde-9190-7c4cb25dcaf0 None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:28:55.934933 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6438e23f-9bff-4fbb-9d0f-621e8bd491c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9ad6269900346458050063c12cac299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:28:55.935584 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6438e23f-9bff-4fbb-9d0f-621e8bd491c8 service nova] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:28:55.935895 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6438e23f-9bff-4fbb-9d0f-621e8bd491c8 service nova] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:28:55.936186 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6438e23f-9bff-4fbb-9d0f-621e8bd491c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:28:55.945210 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6438e23f-9bff-4fbb-9d0f-621e8bd491c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:28:55.946807 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6438e23f-9bff-4fbb-9d0f-621e8bd491c8 service nova] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:28:55.956850 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 696/1404] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:28:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:28:58.281761 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118e87f0-79f1-42d6-aca9-d105cb882c14 None None] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:28:58.282294 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118e87f0-79f1-42d6-aca9-d105cb882c14 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:28:58.282294 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118e87f0-79f1-42d6-aca9-d105cb882c14 None None] PATH_INFO: `/` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:28:58.284077 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 709/1405] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:28:58 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:28:58.289546 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b752bb21-fcbe-4a40-b4f2-0bd5ce5fa482 None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:28:58.290002 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b752bb21-fcbe-4a40-b4f2-0bd5ce5fa482 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:28:58.290105 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b752bb21-fcbe-4a40-b4f2-0bd5ce5fa482 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:28:58.308745 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-b752bb21-fcbe-4a40-b4f2-0bd5ce5fa482 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:28:58.309946 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-b752bb21-fcbe-4a40-b4f2-0bd5ce5fa482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:28:58.317892 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 697/1406] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:28:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:28:58.363813 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118e87f0-79f1-42d6-aca9-d105cb882c14 None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:28:58.380042 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118e87f0-79f1-42d6-aca9-d105cb882c14 None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:28:58.386086 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c81751-42ec-4276-ba8b-16e2303ce812 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9ad6269900346458050063c12cac299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:28:58.386712 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c81751-42ec-4276-ba8b-16e2303ce812 service nova] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:28:58.386992 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c81751-42ec-4276-ba8b-16e2303ce812 service nova] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:28:58.387302 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c81751-42ec-4276-ba8b-16e2303ce812 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:28:58.397437 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c81751-42ec-4276-ba8b-16e2303ce812 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:28:58.399429 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c81751-42ec-4276-ba8b-16e2303ce812 service nova] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:28:58.410655 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 710/1407] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:28:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:29:00.741970 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f70e24-c75f-4315-8fa2-fc31671c73e5 None None] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:29:00.742570 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f70e24-c75f-4315-8fa2-fc31671c73e5 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:29:00.742570 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f70e24-c75f-4315-8fa2-fc31671c73e5 None None] PATH_INFO: `/` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:29:00.744379 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 698/1408] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:29:00 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:29:00.749893 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f510c21c-bb76-415f-958a-e5ff05319ee9 None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:29:00.750353 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f510c21c-bb76-415f-958a-e5ff05319ee9 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:29:00.750460 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f510c21c-bb76-415f-958a-e5ff05319ee9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:29:00.772504 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-f510c21c-bb76-415f-958a-e5ff05319ee9 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:29:00.773707 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-f510c21c-bb76-415f-958a-e5ff05319ee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:29:00.782352 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 711/1409] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:29:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:29:00.826447 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f70e24-c75f-4315-8fa2-fc31671c73e5 None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:29:00.841349 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f70e24-c75f-4315-8fa2-fc31671c73e5 None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:29:00.847488 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8d8570-ec06-4b42-ab8d-ceada6ae6320 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9ad6269900346458050063c12cac299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:29:00.848162 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8d8570-ec06-4b42-ab8d-ceada6ae6320 service nova] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:29:00.848448 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8d8570-ec06-4b42-ab8d-ceada6ae6320 service nova] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:29:00.848727 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8d8570-ec06-4b42-ab8d-ceada6ae6320 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:29:00.856912 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8d8570-ec06-4b42-ab8d-ceada6ae6320 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:29:00.858554 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8d8570-ec06-4b42-ab8d-ceada6ae6320 service nova] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:29:00.867996 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 699/1410] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:29:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:29:01.287003 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6089deb9-e569-4e1b-9ba4-be531339b73a None None] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:29:01.287341 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6089deb9-e569-4e1b-9ba4-be531339b73a None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:29:01.289075 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6089deb9-e569-4e1b-9ba4-be531339b73a None None] PATH_INFO: `/` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:29:01.289995 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 712/1411] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:29:01 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:29:01.295467 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b73449-fbc2-43d2-b53a-9ceffa5e4754 None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:29:01.295848 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b73449-fbc2-43d2-b53a-9ceffa5e4754 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:29:01.296127 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b73449-fbc2-43d2-b53a-9ceffa5e4754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:29:01.314330 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-b9b73449-fbc2-43d2-b53a-9ceffa5e4754 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:29:01.315506 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-b9b73449-fbc2-43d2-b53a-9ceffa5e4754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:29:01.323186 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 700/1412] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:29:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:29:01.378870 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96661797-b461-46c7-99e3-9452442e905b None None] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:29:01.379229 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96661797-b461-46c7-99e3-9452442e905b None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:29:01.379577 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96661797-b461-46c7-99e3-9452442e905b None None] PATH_INFO: `/` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:29:01.381650 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 713/1413] 10.222.0.117 () {54 vars in 967 bytes} [Tue Jan 25 02:29:01 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:29:01.386282 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd63ff6-9c3d-424a-ae32-9350ff82a64d None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:29:01.386575 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd63ff6-9c3d-424a-ae32-9350ff82a64d None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:29:01.386851 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd63ff6-9c3d-424a-ae32-9350ff82a64d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:29:01.434433 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-8fd63ff6-9c3d-424a-ae32-9350ff82a64d None None] MFA Rules not processed for user `db3663416137459d9da4a71032505b0b`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:29:01.435950 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-8fd63ff6-9c3d-424a-ae32-9350ff82a64d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:29:01.501216 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 701/1414] 10.222.0.117 () {58 vars in 1064 bytes} [Tue Jan 25 02:29:01 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:29:01.508661 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96661797-b461-46c7-99e3-9452442e905b None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:29:01.519608 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96661797-b461-46c7-99e3-9452442e905b None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:29:01.523162 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69194c07-16bb-4ffa-a7e0-2c4937630ba6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db3663416137459d9da4a71032505b0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:29:01.523892 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69194c07-16bb-4ffa-a7e0-2c4937630ba6 service glance] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:29:01.524178 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69194c07-16bb-4ffa-a7e0-2c4937630ba6 service glance] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:29:01.524455 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69194c07-16bb-4ffa-a7e0-2c4937630ba6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:29:01.533558 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69194c07-16bb-4ffa-a7e0-2c4937630ba6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:29:01.535017 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69194c07-16bb-4ffa-a7e0-2c4937630ba6 service glance] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:29:01.544405 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 714/1415] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:29:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:29:01.960232 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487f67cc-290d-4aa8-aab1-375c9f9752d0 None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:29:01.960720 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487f67cc-290d-4aa8-aab1-375c9f9752d0 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:29:01.960910 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487f67cc-290d-4aa8-aab1-375c9f9752d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:29:02.009170 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-487f67cc-290d-4aa8-aab1-375c9f9752d0 None None] MFA Rules not processed for user `5924414ee6e948a680b8b75c8797b466`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:29:02.010411 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-487f67cc-290d-4aa8-aab1-375c9f9752d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:29:02.074837 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 702/1416] 10.222.0.117 () {58 vars in 1014 bytes} [Tue Jan 25 02:29:01 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:29:02.120709 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec35f04-c19e-4b26-9780-747a42d46335 None None] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:29:02.121173 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec35f04-c19e-4b26-9780-747a42d46335 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:29:02.121374 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec35f04-c19e-4b26-9780-747a42d46335 None None] PATH_INFO: `/` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:29:02.123230 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 715/1417] 10.222.0.117 () {54 vars in 947 bytes} [Tue Jan 25 02:29:02 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:29:02.129910 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0412483a-272e-438d-bb16-be94793d72c3 None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:29:02.130204 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0412483a-272e-438d-bb16-be94793d72c3 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:29:02.130482 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0412483a-272e-438d-bb16-be94793d72c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:29:02.179227 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-0412483a-272e-438d-bb16-be94793d72c3 None None] MFA Rules not processed for user `100f12ee56754f1c859106bf3e473df6`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:29:02.180480 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-0412483a-272e-438d-bb16-be94793d72c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:29:02.252395 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 703/1418] 10.222.0.117 () {58 vars in 1044 bytes} [Tue Jan 25 02:29:02 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:29:02.261616 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec35f04-c19e-4b26-9780-747a42d46335 None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:29:02.275353 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec35f04-c19e-4b26-9780-747a42d46335 None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:29:02.280407 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee6c9cd-5bd5-443b-9a8d-360fe246560f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100f12ee56754f1c859106bf3e473df6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:29:02.281066 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee6c9cd-5bd5-443b-9a8d-360fe246560f service swift] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:29:02.281516 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee6c9cd-5bd5-443b-9a8d-360fe246560f service swift] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:29:02.281794 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee6c9cd-5bd5-443b-9a8d-360fe246560f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:29:02.289705 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee6c9cd-5bd5-443b-9a8d-360fe246560f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:29:02.291298 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee6c9cd-5bd5-443b-9a8d-360fe246560f service swift] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:29:02.300353 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 716/1419] 10.222.0.117 () {60 vars in 1389 bytes} [Tue Jan 25 02:29:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 25 02:29:03.167407 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc44eca-314e-459d-845f-288f0d44d13f None None] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:29:03.168015 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc44eca-314e-459d-845f-288f0d44d13f None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:29:03.168015 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc44eca-314e-459d-845f-288f0d44d13f None None] PATH_INFO: `/` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:29:03.169783 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 704/1420] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:29:03 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:29:03.176332 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65494e0-a641-4bfb-bfd8-a348a219bcd8 None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:29:03.177341 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65494e0-a641-4bfb-bfd8-a348a219bcd8 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:29:03.177626 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65494e0-a641-4bfb-bfd8-a348a219bcd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:29:03.195902 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-c65494e0-a641-4bfb-bfd8-a348a219bcd8 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:29:03.197117 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-c65494e0-a641-4bfb-bfd8-a348a219bcd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:29:03.206067 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 717/1421] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:29:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:29:03.252141 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc44eca-314e-459d-845f-288f0d44d13f None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:29:03.271803 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc44eca-314e-459d-845f-288f0d44d13f None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:29:03.277720 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411789c7-72a2-4c18-8ab3-2b6fd5cba71a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9ad6269900346458050063c12cac299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:29:03.278443 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411789c7-72a2-4c18-8ab3-2b6fd5cba71a service nova] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:29:03.278801 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411789c7-72a2-4c18-8ab3-2b6fd5cba71a service nova] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:29:03.279153 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411789c7-72a2-4c18-8ab3-2b6fd5cba71a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:29:03.289978 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411789c7-72a2-4c18-8ab3-2b6fd5cba71a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:29:03.291576 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411789c7-72a2-4c18-8ab3-2b6fd5cba71a service nova] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:29:03.313494 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 705/1422] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:29:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:29:24.944043 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf96d29-545b-4dd3-8155-a37d4b297ec9 None None] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:29:24.944603 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf96d29-545b-4dd3-8155-a37d4b297ec9 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:29:24.944603 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf96d29-545b-4dd3-8155-a37d4b297ec9 None None] PATH_INFO: `/` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:29:24.946340 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 718/1423] 10.222.0.117 () {54 vars in 923 bytes} [Tue Jan 25 02:29:24 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:29:24.952272 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a07a144-36b4-404e-b5e0-7f74ca515e4c None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:29:24.952726 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a07a144-36b4-404e-b5e0-7f74ca515e4c None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:29:24.952894 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a07a144-36b4-404e-b5e0-7f74ca515e4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:29:24.971786 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-4a07a144-36b4-404e-b5e0-7f74ca515e4c None None] MFA Rules not processed for user `890151a6bf2840f0a0a00f45dd2d38a4`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:29:24.972980 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-4a07a144-36b4-404e-b5e0-7f74ca515e4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:29:24.981363 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 706/1424] 10.222.0.117 () {58 vars in 1020 bytes} [Tue Jan 25 02:29:24 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:29:24.995821 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1567cf05-5a6e-4524-8d18-65cc32917fdd None None] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:29:24.996107 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1567cf05-5a6e-4524-8d18-65cc32917fdd None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:29:24.996386 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1567cf05-5a6e-4524-8d18-65cc32917fdd None None] PATH_INFO: `/` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:29:24.998139 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 719/1425] 10.222.0.117 () {54 vars in 923 bytes} [Tue Jan 25 02:29:24 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:29:25.002737 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58d1cfe-a84e-4749-83ce-6900e466e686 None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:29:25.003028 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58d1cfe-a84e-4749-83ce-6900e466e686 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:29:25.003315 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58d1cfe-a84e-4749-83ce-6900e466e686 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:29:25.021470 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-c58d1cfe-a84e-4749-83ce-6900e466e686 None None] MFA Rules not processed for user `d9ad6269900346458050063c12cac299`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:29:25.022665 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-c58d1cfe-a84e-4749-83ce-6900e466e686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:29:25.032374 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 707/1426] 10.222.0.117 () {58 vars in 1020 bytes} [Tue Jan 25 02:29:25 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:29:27.732620 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29296acb-1731-498b-8527-f69140052497 None None] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:29:27.733162 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29296acb-1731-498b-8527-f69140052497 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:29:27.733162 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29296acb-1731-498b-8527-f69140052497 None None] PATH_INFO: `/` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:29:27.735000 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 720/1427] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jan 25 02:29:27 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:29:27.740406 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbe2f30-6601-43b7-b7c0-952ae02e9f52 None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:29:27.740836 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbe2f30-6601-43b7-b7c0-952ae02e9f52 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:29:27.740963 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbe2f30-6601-43b7-b7c0-952ae02e9f52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:29:27.759360 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-7bbe2f30-6601-43b7-b7c0-952ae02e9f52 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:29:27.760589 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-7bbe2f30-6601-43b7-b7c0-952ae02e9f52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:29:27.768423 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 708/1428] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jan 25 02:29:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 25 02:29:27.814485 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29296acb-1731-498b-8527-f69140052497 None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:29:27.828697 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29296acb-1731-498b-8527-f69140052497 None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:29:27.833940 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8780b4b-5575-4159-8b4e-db2edbf4a267 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9ad6269900346458050063c12cac299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:29:27.834567 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8780b4b-5575-4159-8b4e-db2edbf4a267 service nova] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:29:27.834845 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8780b4b-5575-4159-8b4e-db2edbf4a267 service nova] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:29:27.835120 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8780b4b-5575-4159-8b4e-db2edbf4a267 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:29:27.843521 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8780b4b-5575-4159-8b4e-db2edbf4a267 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:29:27.845140 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8780b4b-5575-4159-8b4e-db2edbf4a267 service nova] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:29:27.854175 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 721/1429] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:29:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:29:29.206484 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1f2ce1-0645-40d8-b650-7400d9d4b5bb None None] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:29:29.207071 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1f2ce1-0645-40d8-b650-7400d9d4b5bb None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:29:29.207071 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1f2ce1-0645-40d8-b650-7400d9d4b5bb None None] PATH_INFO: `/` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:29:29.209003 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 709/1430] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jan 25 02:29:29 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:29:29.214052 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72f4b21-87bd-4bb4-88d6-2ca163109f17 None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:29:29.214465 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72f4b21-87bd-4bb4-88d6-2ca163109f17 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:29:29.214623 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72f4b21-87bd-4bb4-88d6-2ca163109f17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:29:29.233445 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-a72f4b21-87bd-4bb4-88d6-2ca163109f17 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:29:29.234626 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-a72f4b21-87bd-4bb4-88d6-2ca163109f17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:29:29.242357 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 722/1431] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jan 25 02:29:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:29:29.396490 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1f2ce1-0645-40d8-b650-7400d9d4b5bb None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:29:29.410948 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1f2ce1-0645-40d8-b650-7400d9d4b5bb None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:29:29.416439 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cab2d3c-e65c-4de0-a43e-9f2a59312566 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9ad6269900346458050063c12cac299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:29:29.417064 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cab2d3c-e65c-4de0-a43e-9f2a59312566 service nova] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:29:29.417345 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cab2d3c-e65c-4de0-a43e-9f2a59312566 service nova] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:29:29.417619 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cab2d3c-e65c-4de0-a43e-9f2a59312566 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:29:29.426042 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cab2d3c-e65c-4de0-a43e-9f2a59312566 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:29:29.427620 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cab2d3c-e65c-4de0-a43e-9f2a59312566 service nova] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:29:29.437309 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 710/1432] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:29:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:29:30.800054 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bd3456-b83c-4e11-91ac-353a72559dc0 None None] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:29:30.800515 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bd3456-b83c-4e11-91ac-353a72559dc0 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:29:30.800609 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bd3456-b83c-4e11-91ac-353a72559dc0 None None] PATH_INFO: `/` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:29:30.802335 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 723/1433] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jan 25 02:29:30 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:29:30.807290 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd0d06c-7503-41d3-9548-808b39af5440 None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:29:30.807721 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd0d06c-7503-41d3-9548-808b39af5440 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:29:30.807875 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd0d06c-7503-41d3-9548-808b39af5440 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:29:30.826315 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-8fd0d06c-7503-41d3-9548-808b39af5440 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:29:30.827503 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-8fd0d06c-7503-41d3-9548-808b39af5440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:29:30.835125 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 711/1434] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jan 25 02:29:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:29:30.989557 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bd3456-b83c-4e11-91ac-353a72559dc0 None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:29:31.004278 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bd3456-b83c-4e11-91ac-353a72559dc0 None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:29:31.009747 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8a3259-2de1-48c5-a9c2-a2e9fe7fe278 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9ad6269900346458050063c12cac299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:29:31.010377 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8a3259-2de1-48c5-a9c2-a2e9fe7fe278 service nova] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:29:31.010657 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8a3259-2de1-48c5-a9c2-a2e9fe7fe278 service nova] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:29:31.010930 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8a3259-2de1-48c5-a9c2-a2e9fe7fe278 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:29:31.018927 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8a3259-2de1-48c5-a9c2-a2e9fe7fe278 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:29:31.020541 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8a3259-2de1-48c5-a9c2-a2e9fe7fe278 service nova] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:29:31.029569 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 724/1435] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:29:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:29:32.356267 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d303873a-fbf2-4b03-8447-2c0ace5638c7 None None] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:29:32.356945 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d303873a-fbf2-4b03-8447-2c0ace5638c7 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:29:32.356945 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d303873a-fbf2-4b03-8447-2c0ace5638c7 None None] PATH_INFO: `/` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:29:32.358669 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 712/1436] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jan 25 02:29:32 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:29:32.363640 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47257a49-d5c3-4ea8-a120-1dc1268c3a8a None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:29:32.364097 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47257a49-d5c3-4ea8-a120-1dc1268c3a8a None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:29:32.364200 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47257a49-d5c3-4ea8-a120-1dc1268c3a8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:29:32.381941 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-47257a49-d5c3-4ea8-a120-1dc1268c3a8a None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:29:32.383125 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-47257a49-d5c3-4ea8-a120-1dc1268c3a8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:29:32.391320 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 725/1437] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jan 25 02:29:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:29:32.545413 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d303873a-fbf2-4b03-8447-2c0ace5638c7 None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:29:32.559806 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d303873a-fbf2-4b03-8447-2c0ace5638c7 None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:29:32.566855 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849fea7b-ed54-44a3-a768-f2fe2678244d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9ad6269900346458050063c12cac299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:29:32.567496 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849fea7b-ed54-44a3-a768-f2fe2678244d service nova] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:29:32.567803 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849fea7b-ed54-44a3-a768-f2fe2678244d service nova] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:29:32.568078 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849fea7b-ed54-44a3-a768-f2fe2678244d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:29:32.577973 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849fea7b-ed54-44a3-a768-f2fe2678244d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:29:32.579545 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849fea7b-ed54-44a3-a768-f2fe2678244d service nova] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:29:32.589146 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 713/1438] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:29:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:29:33.908687 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cf965c-6094-4a85-8b46-e3eca72a0526 None None] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:29:33.909267 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cf965c-6094-4a85-8b46-e3eca72a0526 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:29:33.909267 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cf965c-6094-4a85-8b46-e3eca72a0526 None None] PATH_INFO: `/` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:29:33.910995 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 726/1439] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jan 25 02:29:33 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:29:33.916007 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbef1a23-c31e-4f81-979d-e7f68d456ed4 None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:29:33.916436 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbef1a23-c31e-4f81-979d-e7f68d456ed4 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:29:33.916575 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbef1a23-c31e-4f81-979d-e7f68d456ed4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:29:33.934830 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-bbef1a23-c31e-4f81-979d-e7f68d456ed4 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:29:33.936633 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-bbef1a23-c31e-4f81-979d-e7f68d456ed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:29:33.945252 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 714/1440] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jan 25 02:29:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:29:34.097466 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cf965c-6094-4a85-8b46-e3eca72a0526 None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:29:34.112261 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cf965c-6094-4a85-8b46-e3eca72a0526 None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:29:34.118261 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c214577a-53b7-4940-a295-20980d1b730c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9ad6269900346458050063c12cac299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:29:34.119046 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c214577a-53b7-4940-a295-20980d1b730c service nova] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:29:34.119356 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c214577a-53b7-4940-a295-20980d1b730c service nova] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:29:34.119583 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c214577a-53b7-4940-a295-20980d1b730c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:29:34.128248 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c214577a-53b7-4940-a295-20980d1b730c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:29:34.129871 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c214577a-53b7-4940-a295-20980d1b730c service nova] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:29:34.139031 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 727/1441] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:29:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:29:35.400282 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d45e81-b9d4-4046-a1a5-30eba7815a37 None None] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:29:35.400881 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d45e81-b9d4-4046-a1a5-30eba7815a37 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:29:35.400881 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d45e81-b9d4-4046-a1a5-30eba7815a37 None None] PATH_INFO: `/` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:29:35.402623 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 715/1442] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jan 25 02:29:35 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:29:35.408311 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8996c326-903a-48c4-b267-3f133c66f421 None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:29:35.408723 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8996c326-903a-48c4-b267-3f133c66f421 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:29:35.408869 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8996c326-903a-48c4-b267-3f133c66f421 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:29:35.427175 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-8996c326-903a-48c4-b267-3f133c66f421 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:29:35.428383 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-8996c326-903a-48c4-b267-3f133c66f421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:29:35.436322 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 728/1443] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jan 25 02:29:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:29:35.596307 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d45e81-b9d4-4046-a1a5-30eba7815a37 None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:29:35.613123 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d45e81-b9d4-4046-a1a5-30eba7815a37 None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:29:35.621647 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b519475d-7ad6-4c4c-b4b6-2bbf4a1e17c0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9ad6269900346458050063c12cac299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:29:35.623417 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b519475d-7ad6-4c4c-b4b6-2bbf4a1e17c0 service nova] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:29:35.623749 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b519475d-7ad6-4c4c-b4b6-2bbf4a1e17c0 service nova] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:29:35.624027 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b519475d-7ad6-4c4c-b4b6-2bbf4a1e17c0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:29:35.632347 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b519475d-7ad6-4c4c-b4b6-2bbf4a1e17c0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:29:35.633932 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b519475d-7ad6-4c4c-b4b6-2bbf4a1e17c0 service nova] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:29:35.643862 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 716/1444] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:29:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:29:36.901737 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc22024e-1bf9-4802-bb6d-72e35c8f2286 None None] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:29:36.902293 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc22024e-1bf9-4802-bb6d-72e35c8f2286 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:29:36.902293 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc22024e-1bf9-4802-bb6d-72e35c8f2286 None None] PATH_INFO: `/` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:29:36.905185 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 729/1445] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jan 25 02:29:36 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:29:36.910189 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0664da3e-551c-408d-be8e-c5454e51ac1f None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:29:36.910595 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0664da3e-551c-408d-be8e-c5454e51ac1f None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:29:36.910730 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0664da3e-551c-408d-be8e-c5454e51ac1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:29:36.928761 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-0664da3e-551c-408d-be8e-c5454e51ac1f None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:29:36.929882 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-0664da3e-551c-408d-be8e-c5454e51ac1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:29:36.937967 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 717/1446] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jan 25 02:29:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:29:37.093723 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc22024e-1bf9-4802-bb6d-72e35c8f2286 None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:29:37.107931 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc22024e-1bf9-4802-bb6d-72e35c8f2286 None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:29:37.113350 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c40b56-93ca-4853-9ba9-5bdadd35cf99 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9ad6269900346458050063c12cac299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:29:37.113977 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c40b56-93ca-4853-9ba9-5bdadd35cf99 service nova] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:29:37.114260 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c40b56-93ca-4853-9ba9-5bdadd35cf99 service nova] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:29:37.114536 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c40b56-93ca-4853-9ba9-5bdadd35cf99 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:29:37.123050 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c40b56-93ca-4853-9ba9-5bdadd35cf99 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:29:37.124663 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c40b56-93ca-4853-9ba9-5bdadd35cf99 service nova] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:29:37.134060 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 730/1447] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:29:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 25 02:29:38.412310 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375f9575-cd27-4e70-b90b-69af4931f461 None None] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:29:38.412857 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375f9575-cd27-4e70-b90b-69af4931f461 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:29:38.412857 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375f9575-cd27-4e70-b90b-69af4931f461 None None] PATH_INFO: `/` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:29:38.414642 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 718/1448] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jan 25 02:29:38 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:29:38.419578 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3694d44-2cf2-4697-8fb6-f647e1bac263 None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:29:38.420092 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3694d44-2cf2-4697-8fb6-f647e1bac263 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:29:38.420208 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3694d44-2cf2-4697-8fb6-f647e1bac263 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:29:38.437780 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-a3694d44-2cf2-4697-8fb6-f647e1bac263 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:29:38.438970 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-a3694d44-2cf2-4697-8fb6-f647e1bac263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:29:38.446690 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 731/1449] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jan 25 02:29:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:29:38.620855 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375f9575-cd27-4e70-b90b-69af4931f461 None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:29:38.635302 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375f9575-cd27-4e70-b90b-69af4931f461 None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:29:38.641577 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bc2f9e-af89-480a-9fed-14601939ac8d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9ad6269900346458050063c12cac299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:29:38.642226 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bc2f9e-af89-480a-9fed-14601939ac8d service nova] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:29:38.642506 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bc2f9e-af89-480a-9fed-14601939ac8d service nova] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:29:38.642805 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bc2f9e-af89-480a-9fed-14601939ac8d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:29:38.651228 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bc2f9e-af89-480a-9fed-14601939ac8d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:29:38.652925 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bc2f9e-af89-480a-9fed-14601939ac8d service nova] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:29:38.663346 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 719/1450] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:29:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:29:40.092934 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3379cf7c-8ee6-41d2-9f3d-5e82b59c38a6 None None] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:29:40.093517 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3379cf7c-8ee6-41d2-9f3d-5e82b59c38a6 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:29:40.093517 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3379cf7c-8ee6-41d2-9f3d-5e82b59c38a6 None None] PATH_INFO: `/` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:29:40.095283 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 732/1451] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jan 25 02:29:40 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:29:40.100128 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04e4879-b74a-4e5e-a253-9332597ed667 None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:29:40.100518 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04e4879-b74a-4e5e-a253-9332597ed667 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:29:40.100683 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04e4879-b74a-4e5e-a253-9332597ed667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:29:40.118610 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-c04e4879-b74a-4e5e-a253-9332597ed667 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:29:40.119822 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-c04e4879-b74a-4e5e-a253-9332597ed667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:29:40.128430 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 720/1452] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jan 25 02:29:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:29:40.287990 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3379cf7c-8ee6-41d2-9f3d-5e82b59c38a6 None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:29:40.302674 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3379cf7c-8ee6-41d2-9f3d-5e82b59c38a6 None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:29:40.307882 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c760686-3131-42ad-9580-e2f39de61544 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9ad6269900346458050063c12cac299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:29:40.308503 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c760686-3131-42ad-9580-e2f39de61544 service nova] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:29:40.308783 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c760686-3131-42ad-9580-e2f39de61544 service nova] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:29:40.309056 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c760686-3131-42ad-9580-e2f39de61544 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:29:40.317803 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c760686-3131-42ad-9580-e2f39de61544 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:29:40.319375 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c760686-3131-42ad-9580-e2f39de61544 service nova] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:29:40.329313 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 733/1453] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:29:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:29:42.521856 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc0585b-660e-4262-bc27-6f4eb4004590 None None] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:29:42.522434 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc0585b-660e-4262-bc27-6f4eb4004590 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:29:42.522434 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc0585b-660e-4262-bc27-6f4eb4004590 None None] PATH_INFO: `/` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:29:42.524194 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 721/1454] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jan 25 02:29:42 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:29:42.530015 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1628326-7dea-44b8-9a2d-840cde57f8a4 None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:29:42.530415 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1628326-7dea-44b8-9a2d-840cde57f8a4 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:29:42.530558 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1628326-7dea-44b8-9a2d-840cde57f8a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:29:42.548250 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-f1628326-7dea-44b8-9a2d-840cde57f8a4 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:29:42.549429 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-f1628326-7dea-44b8-9a2d-840cde57f8a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:29:42.556997 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 734/1455] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jan 25 02:29:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:29:42.596504 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc0585b-660e-4262-bc27-6f4eb4004590 None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:29:42.607498 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc0585b-660e-4262-bc27-6f4eb4004590 None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:29:42.611071 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17db442b-c2cd-44e9-a290-e87a38c2b2a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca4071c5f8f4a31b5edb81fa66a43a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:29:42.611720 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17db442b-c2cd-44e9-a290-e87a38c2b2a3 service neutron] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:29:42.612020 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17db442b-c2cd-44e9-a290-e87a38c2b2a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:29:42.612298 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17db442b-c2cd-44e9-a290-e87a38c2b2a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:29:42.621091 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17db442b-c2cd-44e9-a290-e87a38c2b2a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:29:42.623071 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17db442b-c2cd-44e9-a290-e87a38c2b2a3 service neutron] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:29:42.632562 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 722/1456] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:29:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:29:45.016867 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad13b50e-183c-461f-8b88-b1f96e9daf16 None None] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:29:45.017523 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad13b50e-183c-461f-8b88-b1f96e9daf16 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:29:45.017523 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad13b50e-183c-461f-8b88-b1f96e9daf16 None None] PATH_INFO: `/` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:29:45.019180 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 735/1457] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jan 25 02:29:45 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:29:45.024397 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4289baf-7553-4489-8f6a-693fd1f5cae5 None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:29:45.024847 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4289baf-7553-4489-8f6a-693fd1f5cae5 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:29:45.024960 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4289baf-7553-4489-8f6a-693fd1f5cae5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:29:45.042467 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-c4289baf-7553-4489-8f6a-693fd1f5cae5 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:29:45.043652 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-c4289baf-7553-4489-8f6a-693fd1f5cae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:29:45.051952 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 723/1458] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jan 25 02:29:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:29:45.090859 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad13b50e-183c-461f-8b88-b1f96e9daf16 None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:29:45.101477 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad13b50e-183c-461f-8b88-b1f96e9daf16 None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:29:45.104973 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135490d1-370e-4c19-9580-73204b7f2f83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca4071c5f8f4a31b5edb81fa66a43a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:29:45.105604 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135490d1-370e-4c19-9580-73204b7f2f83 service neutron] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:29:45.105890 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135490d1-370e-4c19-9580-73204b7f2f83 service neutron] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:29:45.106175 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135490d1-370e-4c19-9580-73204b7f2f83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:29:45.115501 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135490d1-370e-4c19-9580-73204b7f2f83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:29:45.116985 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135490d1-370e-4c19-9580-73204b7f2f83 service neutron] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:29:45.126878 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 736/1459] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:29:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 25 02:29:47.704581 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2790b01f-4140-4a3b-81fa-edf52269c12d None None] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:29:47.705397 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2790b01f-4140-4a3b-81fa-edf52269c12d None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:29:47.705397 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2790b01f-4140-4a3b-81fa-edf52269c12d None None] PATH_INFO: `/` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:29:47.707024 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 724/1460] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jan 25 02:29:47 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:29:47.713076 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d070efc-36cf-4722-9cb3-3688589608c8 None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:29:47.713525 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d070efc-36cf-4722-9cb3-3688589608c8 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:29:47.713902 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d070efc-36cf-4722-9cb3-3688589608c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:29:47.733080 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-6d070efc-36cf-4722-9cb3-3688589608c8 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:29:47.734270 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-6d070efc-36cf-4722-9cb3-3688589608c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:29:47.741970 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 737/1461] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jan 25 02:29:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:29:47.782160 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2790b01f-4140-4a3b-81fa-edf52269c12d None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:29:47.792458 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2790b01f-4140-4a3b-81fa-edf52269c12d None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:29:47.797104 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012d16ef-125d-41a1-9862-4bbb2204fa3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca4071c5f8f4a31b5edb81fa66a43a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:29:47.797724 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012d16ef-125d-41a1-9862-4bbb2204fa3c service neutron] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:29:47.798002 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012d16ef-125d-41a1-9862-4bbb2204fa3c service neutron] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:29:47.798279 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012d16ef-125d-41a1-9862-4bbb2204fa3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:29:47.806915 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012d16ef-125d-41a1-9862-4bbb2204fa3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:29:47.808367 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012d16ef-125d-41a1-9862-4bbb2204fa3c service neutron] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:29:47.818025 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 725/1462] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:29:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:29:50.163338 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d95efa-d41e-47ea-a4df-e0e06561c75a None None] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:29:50.163923 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d95efa-d41e-47ea-a4df-e0e06561c75a None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:29:50.163923 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d95efa-d41e-47ea-a4df-e0e06561c75a None None] PATH_INFO: `/` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:29:50.165754 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 738/1463] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jan 25 02:29:50 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:29:50.171315 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c1109d-d5a0-43fc-b085-bf528f637eeb None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:29:50.171783 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c1109d-d5a0-43fc-b085-bf528f637eeb None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:29:50.171922 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c1109d-d5a0-43fc-b085-bf528f637eeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:29:50.190065 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-51c1109d-d5a0-43fc-b085-bf528f637eeb None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:29:50.191253 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-51c1109d-d5a0-43fc-b085-bf528f637eeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:29:50.198976 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 726/1464] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jan 25 02:29:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:29:50.238231 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d95efa-d41e-47ea-a4df-e0e06561c75a None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:29:50.249234 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d95efa-d41e-47ea-a4df-e0e06561c75a None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:29:50.252692 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14256ec7-f4ed-4e1d-a3a0-347332212ec6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca4071c5f8f4a31b5edb81fa66a43a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:29:50.253443 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14256ec7-f4ed-4e1d-a3a0-347332212ec6 service neutron] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:29:50.253722 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14256ec7-f4ed-4e1d-a3a0-347332212ec6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:29:50.253994 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14256ec7-f4ed-4e1d-a3a0-347332212ec6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:29:50.262527 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14256ec7-f4ed-4e1d-a3a0-347332212ec6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:29:50.263986 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14256ec7-f4ed-4e1d-a3a0-347332212ec6 service neutron] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:29:50.273083 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 739/1465] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:29:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:29:52.549822 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99758824-b2b8-4896-b454-1cb4c675e64e None None] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:29:52.550439 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99758824-b2b8-4896-b454-1cb4c675e64e None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:29:52.550439 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99758824-b2b8-4896-b454-1cb4c675e64e None None] PATH_INFO: `/` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:29:52.552197 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 727/1466] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jan 25 02:29:52 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:29:52.557708 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef373344-29c0-4185-b25d-a088d8cc5748 None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:29:52.558157 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef373344-29c0-4185-b25d-a088d8cc5748 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:29:52.558272 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef373344-29c0-4185-b25d-a088d8cc5748 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:29:52.576523 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-ef373344-29c0-4185-b25d-a088d8cc5748 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:29:52.577705 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-ef373344-29c0-4185-b25d-a088d8cc5748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:29:52.585377 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 740/1467] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jan 25 02:29:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:29:52.624854 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99758824-b2b8-4896-b454-1cb4c675e64e None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:29:52.635123 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99758824-b2b8-4896-b454-1cb4c675e64e None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:29:52.638970 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc2147d-194e-4ffc-8f38-01b3d6bfe808 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca4071c5f8f4a31b5edb81fa66a43a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:29:52.639598 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc2147d-194e-4ffc-8f38-01b3d6bfe808 service neutron] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:29:52.639909 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc2147d-194e-4ffc-8f38-01b3d6bfe808 service neutron] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:29:52.640181 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc2147d-194e-4ffc-8f38-01b3d6bfe808 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:29:52.648755 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc2147d-194e-4ffc-8f38-01b3d6bfe808 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:29:52.650178 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc2147d-194e-4ffc-8f38-01b3d6bfe808 service neutron] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:29:52.659767 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 728/1468] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:29:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:29:54.952518 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10b161c-d6ff-4819-9ff5-635f52e422df None None] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:29:54.953037 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10b161c-d6ff-4819-9ff5-635f52e422df None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:29:54.953037 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10b161c-d6ff-4819-9ff5-635f52e422df None None] PATH_INFO: `/` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:29:54.954732 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 741/1469] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jan 25 02:29:54 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:29:54.960155 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627bd030-1b44-4129-ad0d-71a929cbfc0b None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:29:54.960566 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627bd030-1b44-4129-ad0d-71a929cbfc0b None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:29:54.960716 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627bd030-1b44-4129-ad0d-71a929cbfc0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:29:54.979179 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-627bd030-1b44-4129-ad0d-71a929cbfc0b None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:29:54.980406 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-627bd030-1b44-4129-ad0d-71a929cbfc0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:29:54.988744 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 729/1470] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jan 25 02:29:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:29:55.026473 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10b161c-d6ff-4819-9ff5-635f52e422df None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:29:55.037104 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10b161c-d6ff-4819-9ff5-635f52e422df None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:29:55.040543 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6c5364-35e0-4859-829c-d8e9b284bb2e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca4071c5f8f4a31b5edb81fa66a43a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:29:55.041162 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6c5364-35e0-4859-829c-d8e9b284bb2e service neutron] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:29:55.041442 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6c5364-35e0-4859-829c-d8e9b284bb2e service neutron] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:29:55.041712 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6c5364-35e0-4859-829c-d8e9b284bb2e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:29:55.051013 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6c5364-35e0-4859-829c-d8e9b284bb2e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:29:55.052469 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6c5364-35e0-4859-829c-d8e9b284bb2e service neutron] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:29:55.062420 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 742/1471] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:29:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:29:57.356022 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb74be97-2a86-4ee5-9c59-1ef6d1394e5f None None] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:29:57.356659 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb74be97-2a86-4ee5-9c59-1ef6d1394e5f None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:29:57.356871 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb74be97-2a86-4ee5-9c59-1ef6d1394e5f None None] PATH_INFO: `/` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:29:57.358944 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 730/1472] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jan 25 02:29:57 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:29:57.364356 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b17e170-1c74-4014-93e7-3d91cc3a4967 None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:29:57.364816 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b17e170-1c74-4014-93e7-3d91cc3a4967 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:29:57.364921 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b17e170-1c74-4014-93e7-3d91cc3a4967 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:29:57.383268 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-6b17e170-1c74-4014-93e7-3d91cc3a4967 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:29:57.384525 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-6b17e170-1c74-4014-93e7-3d91cc3a4967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:29:57.392919 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 743/1473] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jan 25 02:29:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:29:57.429680 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb74be97-2a86-4ee5-9c59-1ef6d1394e5f None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:29:57.441001 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb74be97-2a86-4ee5-9c59-1ef6d1394e5f None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:29:57.444460 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9384ebd-7c23-4e15-92d3-649165e09b7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca4071c5f8f4a31b5edb81fa66a43a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:29:57.445080 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9384ebd-7c23-4e15-92d3-649165e09b7e service neutron] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:29:57.445357 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9384ebd-7c23-4e15-92d3-649165e09b7e service neutron] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:29:57.445628 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9384ebd-7c23-4e15-92d3-649165e09b7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:29:57.455298 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9384ebd-7c23-4e15-92d3-649165e09b7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:29:57.456749 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9384ebd-7c23-4e15-92d3-649165e09b7e service neutron] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:29:57.466059 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 731/1474] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:29:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:29:59.729613 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0ea849-69ae-4403-859f-a7f907a43b18 None None] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:29:59.730122 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0ea849-69ae-4403-859f-a7f907a43b18 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:29:59.730224 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0ea849-69ae-4403-859f-a7f907a43b18 None None] PATH_INFO: `/` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:29:59.732846 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 744/1475] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jan 25 02:29:59 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:29:59.738954 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfacd4a-5aee-47de-87e2-fd2360447a5b None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:29:59.739370 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfacd4a-5aee-47de-87e2-fd2360447a5b None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:29:59.739506 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfacd4a-5aee-47de-87e2-fd2360447a5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:29:59.757233 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-bbfacd4a-5aee-47de-87e2-fd2360447a5b None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:29:59.758425 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-bbfacd4a-5aee-47de-87e2-fd2360447a5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:29:59.766444 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 732/1476] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jan 25 02:29:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:29:59.818582 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0ea849-69ae-4403-859f-a7f907a43b18 None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:29:59.829566 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0ea849-69ae-4403-859f-a7f907a43b18 None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:29:59.832993 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8f30d4-af7b-4c36-aba6-9157447f62f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca4071c5f8f4a31b5edb81fa66a43a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:29:59.833604 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8f30d4-af7b-4c36-aba6-9157447f62f1 service neutron] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:29:59.833889 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8f30d4-af7b-4c36-aba6-9157447f62f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:29:59.834158 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8f30d4-af7b-4c36-aba6-9157447f62f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:29:59.843783 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8f30d4-af7b-4c36-aba6-9157447f62f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:29:59.845216 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8f30d4-af7b-4c36-aba6-9157447f62f1 service neutron] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:29:59.854303 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 745/1477] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:29:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:30:02.113063 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f079f1-8d8b-41c3-8f25-71fc29950fa5 None None] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:30:02.113063 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f079f1-8d8b-41c3-8f25-71fc29950fa5 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:30:02.113063 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f079f1-8d8b-41c3-8f25-71fc29950fa5 None None] PATH_INFO: `/` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:30:02.113063 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 733/1478] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jan 25 02:30:02 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:30:02.116925 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda50be6-588f-4943-ab23-ac2847fa5416 None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:30:02.117620 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda50be6-588f-4943-ab23-ac2847fa5416 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:30:02.117929 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda50be6-588f-4943-ab23-ac2847fa5416 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:30:02.137469 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-fda50be6-588f-4943-ab23-ac2847fa5416 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:30:02.140113 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-fda50be6-588f-4943-ab23-ac2847fa5416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:30:02.149825 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 746/1479] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jan 25 02:30:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:30:02.187056 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f079f1-8d8b-41c3-8f25-71fc29950fa5 None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:30:02.197564 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f079f1-8d8b-41c3-8f25-71fc29950fa5 None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:30:02.201959 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28311769-8306-4fe0-bbf3-6cf2b9138b0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca4071c5f8f4a31b5edb81fa66a43a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:30:02.202874 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28311769-8306-4fe0-bbf3-6cf2b9138b0f service neutron] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:30:02.203347 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28311769-8306-4fe0-bbf3-6cf2b9138b0f service neutron] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:30:02.203636 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28311769-8306-4fe0-bbf3-6cf2b9138b0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:30:02.213424 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28311769-8306-4fe0-bbf3-6cf2b9138b0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:30:02.214997 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28311769-8306-4fe0-bbf3-6cf2b9138b0f service neutron] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:30:02.224574 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 734/1480] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:30:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:30:04.495657 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803a2270-9e93-436a-8ec9-74756a2fab8f None None] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:30:04.496260 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803a2270-9e93-436a-8ec9-74756a2fab8f None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:30:04.496260 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803a2270-9e93-436a-8ec9-74756a2fab8f None None] PATH_INFO: `/` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:30:04.498701 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 747/1481] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jan 25 02:30:04 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:30:04.504088 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b9cd42-429a-4c2d-b0f0-795f4852205a None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:30:04.504529 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b9cd42-429a-4c2d-b0f0-795f4852205a None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:30:04.504639 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b9cd42-429a-4c2d-b0f0-795f4852205a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:30:04.522303 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-b1b9cd42-429a-4c2d-b0f0-795f4852205a None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:30:04.523520 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-b1b9cd42-429a-4c2d-b0f0-795f4852205a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:30:04.531240 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 735/1482] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jan 25 02:30:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:30:04.568282 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803a2270-9e93-436a-8ec9-74756a2fab8f None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:30:04.579023 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803a2270-9e93-436a-8ec9-74756a2fab8f None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:30:04.582464 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88d3b53-1e0f-44bf-bde4-5b058c91fd98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca4071c5f8f4a31b5edb81fa66a43a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:30:04.583082 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88d3b53-1e0f-44bf-bde4-5b058c91fd98 service neutron] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:30:04.583360 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88d3b53-1e0f-44bf-bde4-5b058c91fd98 service neutron] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:30:04.583632 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88d3b53-1e0f-44bf-bde4-5b058c91fd98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:30:04.593155 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88d3b53-1e0f-44bf-bde4-5b058c91fd98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:30:04.594586 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88d3b53-1e0f-44bf-bde4-5b058c91fd98 service neutron] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:30:04.603797 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 748/1483] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:30:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:30:21.790758 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f074a43d-626a-4d9a-8b18-43078727b6f6 None None] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:30:21.791340 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f074a43d-626a-4d9a-8b18-43078727b6f6 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:30:21.791340 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f074a43d-626a-4d9a-8b18-43078727b6f6 None None] PATH_INFO: `/` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:30:21.793121 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 736/1484] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:30:21 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:30:21.798719 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c606ab2-1aeb-4b97-adb3-faa01646976a None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:30:21.799164 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c606ab2-1aeb-4b97-adb3-faa01646976a None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:30:21.799283 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c606ab2-1aeb-4b97-adb3-faa01646976a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:30:21.817774 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-8c606ab2-1aeb-4b97-adb3-faa01646976a None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:30:21.818979 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-8c606ab2-1aeb-4b97-adb3-faa01646976a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:30:21.827389 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 749/1485] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:30:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:30:21.874268 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb29e84e-7d0d-406a-a1df-78718ba11f46 None None] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:30:21.874555 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb29e84e-7d0d-406a-a1df-78718ba11f46 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:30:21.874854 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb29e84e-7d0d-406a-a1df-78718ba11f46 None None] PATH_INFO: `/` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:30:21.876656 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 737/1486] 10.222.0.117 () {54 vars in 967 bytes} [Tue Jan 25 02:30:21 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:30:21.881483 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32a0113-a078-4b02-9545-04a81e9abae2 None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:30:21.881773 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32a0113-a078-4b02-9545-04a81e9abae2 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:30:21.882055 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32a0113-a078-4b02-9545-04a81e9abae2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:30:21.901383 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-a32a0113-a078-4b02-9545-04a81e9abae2 None None] MFA Rules not processed for user `db3663416137459d9da4a71032505b0b`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:30:21.902574 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-a32a0113-a078-4b02-9545-04a81e9abae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:30:21.909063 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 750/1487] 10.222.0.117 () {58 vars in 1064 bytes} [Tue Jan 25 02:30:21 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:30:21.916672 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb29e84e-7d0d-406a-a1df-78718ba11f46 None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:30:21.927158 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb29e84e-7d0d-406a-a1df-78718ba11f46 None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:30:21.930631 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc31239-ca73-4bbc-911f-7c3948cbb9b5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db3663416137459d9da4a71032505b0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:30:21.931250 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc31239-ca73-4bbc-911f-7c3948cbb9b5 service glance] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:30:21.931529 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc31239-ca73-4bbc-911f-7c3948cbb9b5 service glance] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:30:21.931842 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc31239-ca73-4bbc-911f-7c3948cbb9b5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:30:21.941670 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc31239-ca73-4bbc-911f-7c3948cbb9b5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:30:21.943116 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc31239-ca73-4bbc-911f-7c3948cbb9b5 service glance] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:30:21.953051 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 738/1488] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:30:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:30:24.306222 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2886bcec-32c3-43f0-a7c6-b1355f44e272 None None] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:30:24.306770 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2886bcec-32c3-43f0-a7c6-b1355f44e272 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:30:24.306770 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2886bcec-32c3-43f0-a7c6-b1355f44e272 None None] PATH_INFO: `/` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:30:24.308563 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 751/1489] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:30:24 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:30:24.315092 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e720a4a-efee-411d-b5a0-1e3d213a1689 None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:30:24.315562 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e720a4a-efee-411d-b5a0-1e3d213a1689 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:30:24.315734 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e720a4a-efee-411d-b5a0-1e3d213a1689 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:30:24.334073 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-3e720a4a-efee-411d-b5a0-1e3d213a1689 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:30:24.335260 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-3e720a4a-efee-411d-b5a0-1e3d213a1689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:30:24.343629 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 739/1490] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:30:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:30:24.367606 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2886bcec-32c3-43f0-a7c6-b1355f44e272 None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:30:24.380608 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2886bcec-32c3-43f0-a7c6-b1355f44e272 None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:30:24.384932 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2f29b2-bbd4-47ec-a80a-8f17f48b6821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:30:24.385564 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2f29b2-bbd4-47ec-a80a-8f17f48b6821 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:30:24.385842 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2f29b2-bbd4-47ec-a80a-8f17f48b6821 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:30:24.386112 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2f29b2-bbd4-47ec-a80a-8f17f48b6821 admin admin] PATH_INFO: `/v3/projects` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:30:24.386853 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2f29b2-bbd4-47ec-a80a-8f17f48b6821 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:30:24.389304 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2f29b2-bbd4-47ec-a80a-8f17f48b6821 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:30:24.402297 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 752/1491] 10.222.0.117 () {56 vars in 1113 bytes} [Tue Jan 25 02:30:24 2022] GET /identity/v3/projects => generated 2562 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 02:30:26.764268 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a25457-aa25-41f5-9313-a51a076783bd None None] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:30:26.764977 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a25457-aa25-41f5-9313-a51a076783bd None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:30:26.764977 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a25457-aa25-41f5-9313-a51a076783bd None None] PATH_INFO: `/` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:30:26.766584 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 740/1492] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:30:26 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:30:26.773200 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bd32cc-38a1-4a81-9a5e-4d65e7cb198e None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:30:26.773662 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bd32cc-38a1-4a81-9a5e-4d65e7cb198e None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:30:26.773788 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bd32cc-38a1-4a81-9a5e-4d65e7cb198e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:30:26.792139 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-b7bd32cc-38a1-4a81-9a5e-4d65e7cb198e None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:30:26.793325 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-b7bd32cc-38a1-4a81-9a5e-4d65e7cb198e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:30:26.802371 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 753/1493] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:30:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 25 02:30:26.845516 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a25457-aa25-41f5-9313-a51a076783bd None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:30:26.860064 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a25457-aa25-41f5-9313-a51a076783bd None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:30:26.865389 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f5014d-70bd-4c75-8f69-8dea26c80b8e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9ad6269900346458050063c12cac299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:30:26.866009 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f5014d-70bd-4c75-8f69-8dea26c80b8e service nova] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:30:26.866328 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f5014d-70bd-4c75-8f69-8dea26c80b8e service nova] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:30:26.866600 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f5014d-70bd-4c75-8f69-8dea26c80b8e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:30:26.875632 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f5014d-70bd-4c75-8f69-8dea26c80b8e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:30:26.877242 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f5014d-70bd-4c75-8f69-8dea26c80b8e service nova] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:30:26.886276 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 741/1494] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:30:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:30:29.313523 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec3e983-f3f6-4a3c-b0f8-42f7dd844e46 None None] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:30:29.314046 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec3e983-f3f6-4a3c-b0f8-42f7dd844e46 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:30:29.314170 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec3e983-f3f6-4a3c-b0f8-42f7dd844e46 None None] PATH_INFO: `/` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:30:29.315861 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 754/1495] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:30:29 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:30:29.321157 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd75bb5f-f016-4e8c-9066-dcdbad43ddbe None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:30:29.321580 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd75bb5f-f016-4e8c-9066-dcdbad43ddbe None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:30:29.321873 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd75bb5f-f016-4e8c-9066-dcdbad43ddbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:30:29.340558 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-dd75bb5f-f016-4e8c-9066-dcdbad43ddbe None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:30:29.341746 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-dd75bb5f-f016-4e8c-9066-dcdbad43ddbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:30:29.349452 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 742/1496] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:30:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 25 02:30:29.385591 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec3e983-f3f6-4a3c-b0f8-42f7dd844e46 None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:30:29.396875 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec3e983-f3f6-4a3c-b0f8-42f7dd844e46 None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:30:29.400460 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab22adc-7d27-4a81-9264-2a8a84f81d4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca4071c5f8f4a31b5edb81fa66a43a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:30:29.401086 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab22adc-7d27-4a81-9264-2a8a84f81d4e service neutron] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:30:29.401422 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab22adc-7d27-4a81-9264-2a8a84f81d4e service neutron] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:30:29.401705 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab22adc-7d27-4a81-9264-2a8a84f81d4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:30:29.410643 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab22adc-7d27-4a81-9264-2a8a84f81d4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:30:29.412133 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab22adc-7d27-4a81-9264-2a8a84f81d4e service neutron] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:30:29.422096 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 755/1497] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:30:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:30:31.739429 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0def481-42c6-4b6f-ba9c-9ef93f5a2a3a None None] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:30:31.740052 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0def481-42c6-4b6f-ba9c-9ef93f5a2a3a None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:30:31.740052 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0def481-42c6-4b6f-ba9c-9ef93f5a2a3a None None] PATH_INFO: `/` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:30:31.741688 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 743/1498] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:30:31 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:30:31.747421 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9de812-b67d-4dbd-9e52-acf213d3ed88 None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:30:31.747900 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9de812-b67d-4dbd-9e52-acf213d3ed88 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:30:31.748083 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9de812-b67d-4dbd-9e52-acf213d3ed88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:30:31.766661 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-3b9de812-b67d-4dbd-9e52-acf213d3ed88 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:30:31.767922 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-3b9de812-b67d-4dbd-9e52-acf213d3ed88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:30:31.775908 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 756/1499] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:30:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:30:31.815866 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0def481-42c6-4b6f-ba9c-9ef93f5a2a3a None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:30:31.827382 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0def481-42c6-4b6f-ba9c-9ef93f5a2a3a None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:30:31.830991 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316fb525-39b8-404d-9550-119e743168ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca4071c5f8f4a31b5edb81fa66a43a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:30:31.831621 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316fb525-39b8-404d-9550-119e743168ab service neutron] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:30:31.831980 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316fb525-39b8-404d-9550-119e743168ab service neutron] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:30:31.832258 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316fb525-39b8-404d-9550-119e743168ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:30:31.841947 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316fb525-39b8-404d-9550-119e743168ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:30:31.843394 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316fb525-39b8-404d-9550-119e743168ab service neutron] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:30:31.853207 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 744/1500] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:30:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:30:34.225740 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1419777a-0bdb-43d0-bcd7-115938d09c55 None None] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:30:34.226283 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1419777a-0bdb-43d0-bcd7-115938d09c55 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:30:34.226283 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1419777a-0bdb-43d0-bcd7-115938d09c55 None None] PATH_INFO: `/` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:30:34.228139 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 757/1501] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:30:34 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:30:34.237389 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe885f6b-95fc-4b34-b019-37939d40179b None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:30:34.237893 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe885f6b-95fc-4b34-b019-37939d40179b None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:30:34.238008 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe885f6b-95fc-4b34-b019-37939d40179b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:30:34.256961 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-fe885f6b-95fc-4b34-b019-37939d40179b None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:30:34.258174 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-fe885f6b-95fc-4b34-b019-37939d40179b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:30:34.267603 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 745/1502] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:30:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:30:34.303100 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1419777a-0bdb-43d0-bcd7-115938d09c55 None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:30:34.317397 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1419777a-0bdb-43d0-bcd7-115938d09c55 None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:30:34.322163 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c260c1-f792-4ce3-93ef-0d804a0dfd64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:30:34.323015 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c260c1-f792-4ce3-93ef-0d804a0dfd64 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:30:34.323296 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c260c1-f792-4ce3-93ef-0d804a0dfd64 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:30:34.323569 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c260c1-f792-4ce3-93ef-0d804a0dfd64 admin admin] PATH_INFO: `/v3/projects/705a3c6650674528a0096768eea3fe81` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:30:34.325245 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c260c1-f792-4ce3-93ef-0d804a0dfd64 admin admin] RBAC: Authorizing `identity:get_project(project_id=705a3c6650674528a0096768eea3fe81)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:30:34.327162 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c260c1-f792-4ce3-93ef-0d804a0dfd64 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:30:34.328874 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 758/1503] 10.222.0.117 () {56 vars in 1212 bytes} [Tue Jan 25 02:30:34 2022] GET /identity/v3/projects/705a3c6650674528a0096768eea3fe81 => generated 345 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:30:34.341914 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe885f6b-95fc-4b34-b019-37939d40179b None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:30:34.351520 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe885f6b-95fc-4b34-b019-37939d40179b None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:30:34.355269 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d559f12-975d-4437-bd9c-20417a285314 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca4071c5f8f4a31b5edb81fa66a43a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:30:34.356698 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d559f12-975d-4437-bd9c-20417a285314 service neutron] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:30:34.356896 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d559f12-975d-4437-bd9c-20417a285314 service neutron] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:30:34.357171 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d559f12-975d-4437-bd9c-20417a285314 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:30:34.367101 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d559f12-975d-4437-bd9c-20417a285314 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:30:34.368602 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d559f12-975d-4437-bd9c-20417a285314 service neutron] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:30:34.378734 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 746/1504] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:30:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:30:36.838780 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2649ba4-d873-46a2-9574-54310bb282a3 None None] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:30:36.839314 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2649ba4-d873-46a2-9574-54310bb282a3 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:30:36.839314 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2649ba4-d873-46a2-9574-54310bb282a3 None None] PATH_INFO: `/` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:30:36.841195 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 759/1505] 10.222.0.117 () {54 vars in 931 bytes} [Tue Jan 25 02:30:36 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:30:36.846592 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d199ed75-9057-47f0-8b4b-f39fa7b6ee52 None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:30:36.847062 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d199ed75-9057-47f0-8b4b-f39fa7b6ee52 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:30:36.847157 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d199ed75-9057-47f0-8b4b-f39fa7b6ee52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:30:36.866140 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-d199ed75-9057-47f0-8b4b-f39fa7b6ee52 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:30:36.867369 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-d199ed75-9057-47f0-8b4b-f39fa7b6ee52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:30:36.876012 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 747/1506] 10.222.0.117 () {58 vars in 1028 bytes} [Tue Jan 25 02:30:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:30:36.911283 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2649ba4-d873-46a2-9574-54310bb282a3 None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:30:36.924477 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2649ba4-d873-46a2-9574-54310bb282a3 None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:30:36.929143 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64328fe-00bd-44ae-aa78-3496121eb166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:30:36.929940 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64328fe-00bd-44ae-aa78-3496121eb166 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:30:36.930225 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64328fe-00bd-44ae-aa78-3496121eb166 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:30:36.930498 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64328fe-00bd-44ae-aa78-3496121eb166 admin admin] PATH_INFO: `/v3/projects/705a3c6650674528a0096768eea3fe81` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:30:36.931836 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64328fe-00bd-44ae-aa78-3496121eb166 admin admin] RBAC: Authorizing `identity:get_project(project_id=705a3c6650674528a0096768eea3fe81)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:30:36.933648 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64328fe-00bd-44ae-aa78-3496121eb166 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:30:36.936258 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 760/1507] 10.222.0.117 () {56 vars in 1212 bytes} [Tue Jan 25 02:30:36 2022] GET /identity/v3/projects/705a3c6650674528a0096768eea3fe81 => generated 345 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:30:36.949481 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d199ed75-9057-47f0-8b4b-f39fa7b6ee52 None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:30:36.959770 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d199ed75-9057-47f0-8b4b-f39fa7b6ee52 None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:30:36.963678 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0815016-8d50-4a45-9b74-01de491d0d1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca4071c5f8f4a31b5edb81fa66a43a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:30:36.964356 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0815016-8d50-4a45-9b74-01de491d0d1a service neutron] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:30:36.964641 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0815016-8d50-4a45-9b74-01de491d0d1a service neutron] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:30:36.964919 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0815016-8d50-4a45-9b74-01de491d0d1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:30:36.974395 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0815016-8d50-4a45-9b74-01de491d0d1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:30:36.975873 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0815016-8d50-4a45-9b74-01de491d0d1a service neutron] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:30:36.985722 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 748/1508] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:30:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:31:55.962377 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b60597-3d31-446a-8123-8c368a1ccec7 None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:31:55.962958 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b60597-3d31-446a-8123-8c368a1ccec7 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:31:55.962958 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b60597-3d31-446a-8123-8c368a1ccec7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:31:55.981072 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-73b60597-3d31-446a-8123-8c368a1ccec7 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:31:55.982261 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-73b60597-3d31-446a-8123-8c368a1ccec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:31:55.989919 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 761/1509] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:31:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:31:55.997773 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a393ba-7a6d-4c12-ae5d-766b464a7a0a None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:31:55.998269 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a393ba-7a6d-4c12-ae5d-766b464a7a0a None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:31:55.998378 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a393ba-7a6d-4c12-ae5d-766b464a7a0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:31:56.016435 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-73a393ba-7a6d-4c12-ae5d-766b464a7a0a None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:31:56.017627 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-73a393ba-7a6d-4c12-ae5d-766b464a7a0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:31:56.025340 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 749/1510] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:31:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:31:56.030722 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b60597-3d31-446a-8123-8c368a1ccec7 None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:31:56.039945 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b60597-3d31-446a-8123-8c368a1ccec7 None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:31:56.044931 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967d830e-acc5-41a2-a400-38074fbff0da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:31:56.045568 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967d830e-acc5-41a2-a400-38074fbff0da admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:31:56.045844 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967d830e-acc5-41a2-a400-38074fbff0da admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:31:56.046115 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967d830e-acc5-41a2-a400-38074fbff0da admin admin] PATH_INFO: `/v3/domains` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:31:56.046840 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967d830e-acc5-41a2-a400-38074fbff0da admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:31:56.047138 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967d830e-acc5-41a2-a400-38074fbff0da admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:31:56.048754 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967d830e-acc5-41a2-a400-38074fbff0da admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:31:56.060114 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 762/1511] 10.222.0.117 () {58 vars in 1157 bytes} [Tue Jan 25 02:31:56 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:31:56.068170 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a393ba-7a6d-4c12-ae5d-766b464a7a0a None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:31:56.077660 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a393ba-7a6d-4c12-ae5d-766b464a7a0a None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:31:56.082327 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ef7a7d-5d35-42bd-b863-5e562a5cf601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:31:56.082971 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ef7a7d-5d35-42bd-b863-5e562a5cf601 admin admin] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:31:56.083258 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ef7a7d-5d35-42bd-b863-5e562a5cf601 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:31:56.083536 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ef7a7d-5d35-42bd-b863-5e562a5cf601 admin admin] PATH_INFO: `/v3/projects` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:31:56.084360 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ef7a7d-5d35-42bd-b863-5e562a5cf601 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:31:56.086263 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ef7a7d-5d35-42bd-b863-5e562a5cf601 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:31:56.121198 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 750/1512] 10.222.0.117 () {60 vars in 1157 bytes} [Tue Jan 25 02:31:56 2022] POST /identity/v3/projects => generated 380 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 02:31:56.125478 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967d830e-acc5-41a2-a400-38074fbff0da admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:31:56.135010 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967d830e-acc5-41a2-a400-38074fbff0da admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:31:56.187557 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92076a8c-a4d5-435e-b0cd-3d1a1f113cb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:31:56.188252 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92076a8c-a4d5-435e-b0cd-3d1a1f113cb1 admin admin] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:31:56.188532 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92076a8c-a4d5-435e-b0cd-3d1a1f113cb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:31:56.188803 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92076a8c-a4d5-435e-b0cd-3d1a1f113cb1 admin admin] PATH_INFO: `/v3/users` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:31:56.189505 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92076a8c-a4d5-435e-b0cd-3d1a1f113cb1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:31:56.191430 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92076a8c-a4d5-435e-b0cd-3d1a1f113cb1 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:31:56.209725 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 763/1513] 10.222.0.117 () {60 vars in 1148 bytes} [Tue Jan 25 02:31:56 2022] POST /identity/v3/users => generated 291 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 02:31:56.214754 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ef7a7d-5d35-42bd-b863-5e562a5cf601 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:31:56.224742 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ef7a7d-5d35-42bd-b863-5e562a5cf601 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:31:56.229266 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bda7ea-3429-46b8-8b5a-d76953e432f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:31:56.230026 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bda7ea-3429-46b8-8b5a-d76953e432f9 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:31:56.230309 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bda7ea-3429-46b8-8b5a-d76953e432f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:31:56.230590 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bda7ea-3429-46b8-8b5a-d76953e432f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:31:56.231333 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bda7ea-3429-46b8-8b5a-d76953e432f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:31:56.232968 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bda7ea-3429-46b8-8b5a-d76953e432f9 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:31:56.246404 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 751/1514] 10.222.0.117 () {58 vars in 1126 bytes} [Tue Jan 25 02:31:56 2022] GET /identity/v3/roles => generated 1427 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 02:31:56.250275 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92076a8c-a4d5-435e-b0cd-3d1a1f113cb1 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:31:56.259811 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92076a8c-a4d5-435e-b0cd-3d1a1f113cb1 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:31:56.265154 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c22c77a-f2ad-4d8a-8bc0-4084d08a22d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:31:56.265816 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c22c77a-f2ad-4d8a-8bc0-4084d08a22d5 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:31:56.266080 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c22c77a-f2ad-4d8a-8bc0-4084d08a22d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:31:56.266352 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c22c77a-f2ad-4d8a-8bc0-4084d08a22d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:31:56.267084 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c22c77a-f2ad-4d8a-8bc0-4084d08a22d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:31:56.268707 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c22c77a-f2ad-4d8a-8bc0-4084d08a22d5 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:31:56.282006 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 764/1515] 10.222.0.117 () {58 vars in 1126 bytes} [Tue Jan 25 02:31:56 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 02:31:56.286092 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bda7ea-3429-46b8-8b5a-d76953e432f9 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:31:56.295748 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bda7ea-3429-46b8-8b5a-d76953e432f9 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:31:56.300519 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c174a2-a22d-45f6-b9de-e2d5b1b887b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:31:56.301393 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c174a2-a22d-45f6-b9de-e2d5b1b887b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:31:56.301676 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c174a2-a22d-45f6-b9de-e2d5b1b887b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:31:56.301952 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c174a2-a22d-45f6-b9de-e2d5b1b887b3 admin admin] PATH_INFO: `/v3/projects/237d610e083f4021a7012feecb7e75d7/users/1fa4308a6b86450c95e8e9bb4a700234/roles/33a8e87420ed423f9cb29e0084eab5d2` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:31:56.316588 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c174a2-a22d-45f6-b9de-e2d5b1b887b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=237d610e083f4021a7012feecb7e75d7, user_id=1fa4308a6b86450c95e8e9bb4a700234, role_id=33a8e87420ed423f9cb29e0084eab5d2)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:31:56.319241 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c174a2-a22d-45f6-b9de-e2d5b1b887b3 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:31:56.332265 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 752/1516] 10.222.0.117 () {60 vars in 1487 bytes} [Tue Jan 25 02:31:56 2022] PUT /identity/v3/projects/237d610e083f4021a7012feecb7e75d7/users/1fa4308a6b86450c95e8e9bb4a700234/roles/33a8e87420ed423f9cb29e0084eab5d2 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 25 02:31:56.344353 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3353ef2f-f938-46e8-b015-6877ada83438 None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:31:56.344638 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3353ef2f-f938-46e8-b015-6877ada83438 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:31:56.344914 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3353ef2f-f938-46e8-b015-6877ada83438 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:31:56.371296 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-3353ef2f-f938-46e8-b015-6877ada83438 None None] MFA Rules not processed for user `1fa4308a6b86450c95e8e9bb4a700234`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:31:56.372516 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-3353ef2f-f938-46e8-b015-6877ada83438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:31:56.434141 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 765/1517] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:31:56 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:31:56.445020 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c174a2-a22d-45f6-b9de-e2d5b1b887b3 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:31:56.513006 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c174a2-a22d-45f6-b9de-e2d5b1b887b3 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:31:56.518894 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a17abd-2179-4459-88f1-41c11531670c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9ad6269900346458050063c12cac299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:31:56.519533 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a17abd-2179-4459-88f1-41c11531670c service nova] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:31:56.519846 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a17abd-2179-4459-88f1-41c11531670c service nova] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:31:56.520125 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a17abd-2179-4459-88f1-41c11531670c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:31:56.527667 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a17abd-2179-4459-88f1-41c11531670c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:31:56.529285 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a17abd-2179-4459-88f1-41c11531670c service nova] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:31:56.537697 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 753/1518] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:31:56 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:31:56.607363 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cfbc98-3554-4d1d-abe9-489101c1730f None None] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:31:56.607652 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cfbc98-3554-4d1d-abe9-489101c1730f None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:31:56.607955 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cfbc98-3554-4d1d-abe9-489101c1730f None None] PATH_INFO: `/` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:31:56.609642 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 766/1519] 10.222.0.117 () {52 vars in 834 bytes} [Tue Jan 25 02:31:56 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:31:56.613238 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a17abd-2179-4459-88f1-41c11531670c service nova] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:31:56.675494 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a17abd-2179-4459-88f1-41c11531670c service nova] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:31:56.680541 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbafe7a-af55-417c-ab5a-3666f08a1984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:31:56.681409 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbafe7a-af55-417c-ab5a-3666f08a1984 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:31:56.681695 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbafe7a-af55-417c-ab5a-3666f08a1984 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:31:56.681974 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbafe7a-af55-417c-ab5a-3666f08a1984 admin admin] PATH_INFO: `/v3/users/1fa4308a6b86450c95e8e9bb4a700234` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:31:56.683828 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbafe7a-af55-417c-ab5a-3666f08a1984 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1fa4308a6b86450c95e8e9bb4a700234)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:31:56.684870 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: WARNING py.warnings [None req-ffbafe7a-af55-417c-ab5a-3666f08a1984 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 25 02:31:56.684870 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: warnings.warn(msg) Jan 25 02:31:56.684870 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: Jan 25 02:31:56.686083 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbafe7a-af55-417c-ab5a-3666f08a1984 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:31:56.749697 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-ffbafe7a-af55-417c-ab5a-3666f08a1984 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1fa4308a6b86450c95e8e9bb4a700234'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:31:56.758741 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-ffbafe7a-af55-417c-ab5a-3666f08a1984 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1fa4308a6b86450c95e8e9bb4a700234'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:31:56.759373 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-ffbafe7a-af55-417c-ab5a-3666f08a1984 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1fa4308a6b86450c95e8e9bb4a700234'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:31:56.760085 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-ffbafe7a-af55-417c-ab5a-3666f08a1984 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1fa4308a6b86450c95e8e9bb4a700234'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:31:56.780440 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-ffbafe7a-af55-417c-ab5a-3666f08a1984 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1fa4308a6b86450c95e8e9bb4a700234'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:31:56.798458 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 754/1520] 10.222.0.117 () {58 vars in 1228 bytes} [Tue Jan 25 02:31:56 2022] DELETE /identity/v3/users/1fa4308a6b86450c95e8e9bb4a700234 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:31:56.802960 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056b570c-b39a-4e50-b5d8-844856c202b7 None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:31:56.803254 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056b570c-b39a-4e50-b5d8-844856c202b7 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:31:56.803539 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056b570c-b39a-4e50-b5d8-844856c202b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:31:56.821408 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-056b570c-b39a-4e50-b5d8-844856c202b7 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:31:56.822588 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-056b570c-b39a-4e50-b5d8-844856c202b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:31:56.878966 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 767/1521] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:31:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:31:56.888311 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbafe7a-af55-417c-ab5a-3666f08a1984 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:31:56.889811 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-ffbafe7a-af55-417c-ab5a-3666f08a1984 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:31:56.944671 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbafe7a-af55-417c-ab5a-3666f08a1984 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:31:56.948353 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86112005-7115-43c6-b698-a92341d9bd28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca4071c5f8f4a31b5edb81fa66a43a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:31:56.948991 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86112005-7115-43c6-b698-a92341d9bd28 service neutron] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:31:56.949269 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86112005-7115-43c6-b698-a92341d9bd28 service neutron] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:31:56.949542 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86112005-7115-43c6-b698-a92341d9bd28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:31:56.958391 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86112005-7115-43c6-b698-a92341d9bd28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:31:56.959868 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86112005-7115-43c6-b698-a92341d9bd28 service neutron] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:31:56.969995 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 755/1522] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:31:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:31:57.311462 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056b570c-b39a-4e50-b5d8-844856c202b7 None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:31:57.312963 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-056b570c-b39a-4e50-b5d8-844856c202b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:31:57.325386 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056b570c-b39a-4e50-b5d8-844856c202b7 None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:31:57.330115 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aceb5399-72cf-48fd-8520-2a7fbe9ab317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:31:57.330974 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceb5399-72cf-48fd-8520-2a7fbe9ab317 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:31:57.331257 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceb5399-72cf-48fd-8520-2a7fbe9ab317 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:31:57.331535 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceb5399-72cf-48fd-8520-2a7fbe9ab317 admin admin] PATH_INFO: `/v3/projects/237d610e083f4021a7012feecb7e75d7` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:31:57.332838 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aceb5399-72cf-48fd-8520-2a7fbe9ab317 admin admin] RBAC: Authorizing `identity:delete_project(project_id=237d610e083f4021a7012feecb7e75d7)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:31:57.333891 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: WARNING py.warnings [None req-aceb5399-72cf-48fd-8520-2a7fbe9ab317 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 25 02:31:57.333891 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: warnings.warn(msg) Jan 25 02:31:57.333891 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: Jan 25 02:31:57.335134 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aceb5399-72cf-48fd-8520-2a7fbe9ab317 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:31:57.394161 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-aceb5399-72cf-48fd-8520-2a7fbe9ab317 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '237d610e083f4021a7012feecb7e75d7', 'request_id': 'req-aceb5399-72cf-48fd-8520-2a7fbe9ab317'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:31:57.399932 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-aceb5399-72cf-48fd-8520-2a7fbe9ab317 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '237d610e083f4021a7012feecb7e75d7', 'request_id': 'req-aceb5399-72cf-48fd-8520-2a7fbe9ab317'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:31:57.412081 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-aceb5399-72cf-48fd-8520-2a7fbe9ab317 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '237d610e083f4021a7012feecb7e75d7', 'request_id': 'req-aceb5399-72cf-48fd-8520-2a7fbe9ab317'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:31:57.429758 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-aceb5399-72cf-48fd-8520-2a7fbe9ab317 admin admin] The token cache is being invalidate because project 237d610e083f4021a7012feecb7e75d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79121) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 25 02:31:57.430068 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-aceb5399-72cf-48fd-8520-2a7fbe9ab317 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:31:57.430721 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-aceb5399-72cf-48fd-8520-2a7fbe9ab317 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:31:57.432365 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 768/1523] 10.222.0.117 () {58 vars in 1237 bytes} [Tue Jan 25 02:31:57 2022] DELETE /identity/v3/projects/237d610e083f4021a7012feecb7e75d7 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:33:26.046131 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c62bbda-f71b-4c1f-912f-29a74f9dc3ed None None] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:33:26.046729 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c62bbda-f71b-4c1f-912f-29a74f9dc3ed None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:33:26.046729 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c62bbda-f71b-4c1f-912f-29a74f9dc3ed None None] PATH_INFO: `/` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:33:26.049614 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 756/1524] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jan 25 02:33:26 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:33:26.054555 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7554640-2839-48e3-9245-f72c3363f5e9 None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:33:26.054999 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7554640-2839-48e3-9245-f72c3363f5e9 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:33:26.055104 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7554640-2839-48e3-9245-f72c3363f5e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:33:26.072923 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-d7554640-2839-48e3-9245-f72c3363f5e9 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:33:26.074119 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-d7554640-2839-48e3-9245-f72c3363f5e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:33:26.131201 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 769/1525] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jan 25 02:33:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:33:26.289333 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c62bbda-f71b-4c1f-912f-29a74f9dc3ed None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:33:26.291188 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-2c62bbda-f71b-4c1f-912f-29a74f9dc3ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:33:26.317030 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcaaf4b-8183-48fa-8192-a7dd24d507a3 None None] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:33:26.317307 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcaaf4b-8183-48fa-8192-a7dd24d507a3 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:33:26.317583 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcaaf4b-8183-48fa-8192-a7dd24d507a3 None None] PATH_INFO: `/v3` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:33:26.318884 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 770/1526] 10.222.0.121 () {54 vars in 930 bytes} [Tue Jan 25 02:33:26 2022] GET /identity/v3 => generated 256 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 02:33:26.325556 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18de18a7-5253-4218-9218-9268a4ba607d None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:33:26.325847 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18de18a7-5253-4218-9218-9268a4ba607d None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:33:26.326129 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18de18a7-5253-4218-9218-9268a4ba607d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:33:26.343815 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-18de18a7-5253-4218-9218-9268a4ba607d None None] MFA Rules not processed for user `890151a6bf2840f0a0a00f45dd2d38a4`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:33:26.345088 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-18de18a7-5253-4218-9218-9268a4ba607d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:33:26.365861 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c62bbda-f71b-4c1f-912f-29a74f9dc3ed None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:33:26.371431 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe2f168-3ca0-44ec-8e60-cb3170a47d83 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9ad6269900346458050063c12cac299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:33:26.372121 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe2f168-3ca0-44ec-8e60-cb3170a47d83 service nova] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:33:26.372409 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe2f168-3ca0-44ec-8e60-cb3170a47d83 service nova] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:33:26.372685 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe2f168-3ca0-44ec-8e60-cb3170a47d83 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:33:26.381382 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe2f168-3ca0-44ec-8e60-cb3170a47d83 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:33:26.382977 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe2f168-3ca0-44ec-8e60-cb3170a47d83 service nova] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:33:26.392232 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 757/1527] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:33:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:33:26.405999 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 771/1528] 10.222.0.121 () {58 vars in 1020 bytes} [Tue Jan 25 02:33:26 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 25 02:33:27.701727 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0169c21f-975c-41bd-a0cd-d67430296f2e None None] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:33:27.702228 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0169c21f-975c-41bd-a0cd-d67430296f2e None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:33:27.702325 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0169c21f-975c-41bd-a0cd-d67430296f2e None None] PATH_INFO: `/` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:33:27.704619 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 758/1529] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jan 25 02:33:27 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:33:27.709756 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aee102-5f50-4e39-ab3e-a69a1c55123a None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:33:27.710456 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aee102-5f50-4e39-ab3e-a69a1c55123a None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:33:27.710683 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aee102-5f50-4e39-ab3e-a69a1c55123a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:33:27.730041 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-28aee102-5f50-4e39-ab3e-a69a1c55123a None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:33:27.731220 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-28aee102-5f50-4e39-ab3e-a69a1c55123a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:33:27.739313 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 772/1530] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jan 25 02:33:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 25 02:33:27.895568 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0169c21f-975c-41bd-a0cd-d67430296f2e None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:33:27.910310 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0169c21f-975c-41bd-a0cd-d67430296f2e None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:33:27.915853 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef70e57f-2d12-4640-b170-59130fecde9b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9ad6269900346458050063c12cac299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:33:27.916490 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef70e57f-2d12-4640-b170-59130fecde9b service nova] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:33:27.916774 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef70e57f-2d12-4640-b170-59130fecde9b service nova] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:33:27.917058 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef70e57f-2d12-4640-b170-59130fecde9b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:33:27.925270 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef70e57f-2d12-4640-b170-59130fecde9b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:33:27.926995 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef70e57f-2d12-4640-b170-59130fecde9b service nova] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:33:27.936557 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 759/1531] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:33:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:33:35.398255 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e426cb-396c-49d9-9012-fb4c48732c72 None None] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:33:35.398832 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e426cb-396c-49d9-9012-fb4c48732c72 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:33:35.398832 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e426cb-396c-49d9-9012-fb4c48732c72 None None] PATH_INFO: `/` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:33:35.400518 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 773/1532] 10.222.0.117 () {54 vars in 965 bytes} [Tue Jan 25 02:33:35 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:33:35.405495 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0637e2d4-3024-4d84-9b02-8ce94a5a69e0 None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:33:35.405928 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0637e2d4-3024-4d84-9b02-8ce94a5a69e0 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:33:35.406039 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0637e2d4-3024-4d84-9b02-8ce94a5a69e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:33:35.424847 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-0637e2d4-3024-4d84-9b02-8ce94a5a69e0 None None] MFA Rules not processed for user `890151a6bf2840f0a0a00f45dd2d38a4`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:33:35.426033 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-0637e2d4-3024-4d84-9b02-8ce94a5a69e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:33:35.434588 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 760/1533] 10.222.0.117 () {58 vars in 1062 bytes} [Tue Jan 25 02:33:35 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:33:35.443330 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e426cb-396c-49d9-9012-fb4c48732c72 None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:33:35.456514 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e426cb-396c-49d9-9012-fb4c48732c72 None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:33:35.461924 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b0f2fe-cc1d-48c6-ba1e-0ac5781eb8ea service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '890151a6bf2840f0a0a00f45dd2d38a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:33:35.462556 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b0f2fe-cc1d-48c6-ba1e-0ac5781eb8ea service placement] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:33:35.462845 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b0f2fe-cc1d-48c6-ba1e-0ac5781eb8ea service placement] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:33:35.463124 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b0f2fe-cc1d-48c6-ba1e-0ac5781eb8ea service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:33:35.471623 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b0f2fe-cc1d-48c6-ba1e-0ac5781eb8ea service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:33:35.473137 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b0f2fe-cc1d-48c6-ba1e-0ac5781eb8ea service placement] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:33:35.483990 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 774/1534] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:33:35 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:33:39.676975 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d59390-0453-450f-a98d-521e8d7e9ad2 None None] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:33:39.677572 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d59390-0453-450f-a98d-521e8d7e9ad2 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:33:39.677572 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d59390-0453-450f-a98d-521e8d7e9ad2 None None] PATH_INFO: `/` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:33:39.679306 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 761/1535] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jan 25 02:33:39 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:33:39.684251 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c19e63-79c3-47ba-ac16-54a5999b6ab1 None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:33:39.684685 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c19e63-79c3-47ba-ac16-54a5999b6ab1 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:33:39.684811 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c19e63-79c3-47ba-ac16-54a5999b6ab1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:33:39.703269 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-57c19e63-79c3-47ba-ac16-54a5999b6ab1 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:33:39.704486 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-57c19e63-79c3-47ba-ac16-54a5999b6ab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:33:39.712986 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 775/1536] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jan 25 02:33:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:33:39.868549 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d59390-0453-450f-a98d-521e8d7e9ad2 None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:33:39.883513 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d59390-0453-450f-a98d-521e8d7e9ad2 None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:33:39.888913 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee152285-74b9-43af-acce-c0cac8d71188 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9ad6269900346458050063c12cac299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:33:39.889545 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee152285-74b9-43af-acce-c0cac8d71188 service nova] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:33:39.889834 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee152285-74b9-43af-acce-c0cac8d71188 service nova] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:33:39.890110 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee152285-74b9-43af-acce-c0cac8d71188 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:33:39.898788 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee152285-74b9-43af-acce-c0cac8d71188 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:33:39.900450 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee152285-74b9-43af-acce-c0cac8d71188 service nova] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:33:39.909576 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 762/1537] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:33:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:33:41.203144 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360b897d-462c-4a44-a337-c51be0ace387 None None] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:33:41.203713 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360b897d-462c-4a44-a337-c51be0ace387 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:33:41.203713 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360b897d-462c-4a44-a337-c51be0ace387 None None] PATH_INFO: `/` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:33:41.206106 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 776/1538] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jan 25 02:33:41 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:33:41.211441 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512bf2db-2962-4caf-bd1c-a31b0d2c94e6 None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:33:41.211863 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512bf2db-2962-4caf-bd1c-a31b0d2c94e6 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:33:41.212026 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512bf2db-2962-4caf-bd1c-a31b0d2c94e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:33:41.230524 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-512bf2db-2962-4caf-bd1c-a31b0d2c94e6 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:33:41.231716 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-512bf2db-2962-4caf-bd1c-a31b0d2c94e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:33:41.239746 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 763/1539] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jan 25 02:33:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:33:41.394604 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360b897d-462c-4a44-a337-c51be0ace387 None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:33:41.409510 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360b897d-462c-4a44-a337-c51be0ace387 None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:33:41.415653 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf18ac2-18cd-4b80-9392-23d7fc54104e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9ad6269900346458050063c12cac299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:33:41.416333 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf18ac2-18cd-4b80-9392-23d7fc54104e service nova] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:33:41.416623 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf18ac2-18cd-4b80-9392-23d7fc54104e service nova] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:33:41.416905 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf18ac2-18cd-4b80-9392-23d7fc54104e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:33:41.425896 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf18ac2-18cd-4b80-9392-23d7fc54104e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:33:41.427503 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf18ac2-18cd-4b80-9392-23d7fc54104e service nova] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:33:41.436720 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 777/1540] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:33:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:33:45.591665 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7f5bde-1738-4cd7-92af-e767509ad251 None None] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:33:45.592272 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7f5bde-1738-4cd7-92af-e767509ad251 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:33:45.592272 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7f5bde-1738-4cd7-92af-e767509ad251 None None] PATH_INFO: `/` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:33:45.594037 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 764/1541] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jan 25 02:33:45 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:33:45.599426 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64954c58-6cd7-4793-845f-742e3c904093 None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:33:45.599851 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64954c58-6cd7-4793-845f-742e3c904093 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:33:45.599991 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64954c58-6cd7-4793-845f-742e3c904093 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:33:45.618468 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-64954c58-6cd7-4793-845f-742e3c904093 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:33:45.619650 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-64954c58-6cd7-4793-845f-742e3c904093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:33:45.628209 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 778/1542] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jan 25 02:33:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:33:45.664576 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7f5bde-1738-4cd7-92af-e767509ad251 None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:33:45.666247 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-4c7f5bde-1738-4cd7-92af-e767509ad251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:33:45.722268 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7f5bde-1738-4cd7-92af-e767509ad251 None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:33:45.725802 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871da5ed-285d-437d-8f8a-707ed0dd7bc6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca4071c5f8f4a31b5edb81fa66a43a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:33:45.726438 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871da5ed-285d-437d-8f8a-707ed0dd7bc6 service neutron] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:33:45.726720 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871da5ed-285d-437d-8f8a-707ed0dd7bc6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:33:45.726996 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871da5ed-285d-437d-8f8a-707ed0dd7bc6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:33:45.735750 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871da5ed-285d-437d-8f8a-707ed0dd7bc6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:33:45.737714 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871da5ed-285d-437d-8f8a-707ed0dd7bc6 service neutron] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:33:45.746945 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 765/1543] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:33:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:33:47.982405 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e448c1-f943-403a-9ef7-13f6ae12b21a None None] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:33:47.982951 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e448c1-f943-403a-9ef7-13f6ae12b21a None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:33:47.982951 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e448c1-f943-403a-9ef7-13f6ae12b21a None None] PATH_INFO: `/` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:33:47.984761 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 779/1544] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jan 25 02:33:47 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:33:47.990611 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e58ae7-dbae-4775-8b2e-817abe1b0924 None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:33:47.991050 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e58ae7-dbae-4775-8b2e-817abe1b0924 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:33:47.991192 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e58ae7-dbae-4775-8b2e-817abe1b0924 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:33:48.009383 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-97e58ae7-dbae-4775-8b2e-817abe1b0924 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:33:48.010599 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-97e58ae7-dbae-4775-8b2e-817abe1b0924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:33:48.018615 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 766/1545] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jan 25 02:33:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:33:48.055301 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e448c1-f943-403a-9ef7-13f6ae12b21a None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:33:48.066049 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e448c1-f943-403a-9ef7-13f6ae12b21a None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:33:48.069552 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbc2674-2e66-4619-88b8-0d973de022eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca4071c5f8f4a31b5edb81fa66a43a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:33:48.070180 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbc2674-2e66-4619-88b8-0d973de022eb service neutron] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:33:48.070467 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbc2674-2e66-4619-88b8-0d973de022eb service neutron] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:33:48.070746 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbc2674-2e66-4619-88b8-0d973de022eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:33:48.079395 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbc2674-2e66-4619-88b8-0d973de022eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:33:48.081178 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbc2674-2e66-4619-88b8-0d973de022eb service neutron] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:33:48.090824 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 780/1546] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:33:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 25 02:33:51.667211 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f929b1f0-1f88-46a8-ba1f-a13a14e2fbdc None None] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:33:51.667844 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f929b1f0-1f88-46a8-ba1f-a13a14e2fbdc None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:33:51.667950 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f929b1f0-1f88-46a8-ba1f-a13a14e2fbdc None None] PATH_INFO: `/` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:33:51.669683 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 767/1547] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jan 25 02:33:51 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:33:51.675733 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2802fccf-ef9c-409a-a396-3ccdc689f677 None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:33:51.676170 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2802fccf-ef9c-409a-a396-3ccdc689f677 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:33:51.676270 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2802fccf-ef9c-409a-a396-3ccdc689f677 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:33:51.693764 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-2802fccf-ef9c-409a-a396-3ccdc689f677 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:33:51.694967 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-2802fccf-ef9c-409a-a396-3ccdc689f677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:33:51.702919 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 781/1548] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jan 25 02:33:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:33:51.956255 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f929b1f0-1f88-46a8-ba1f-a13a14e2fbdc None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:33:51.957913 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-f929b1f0-1f88-46a8-ba1f-a13a14e2fbdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:33:52.013769 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f929b1f0-1f88-46a8-ba1f-a13a14e2fbdc None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:33:52.017279 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb83611d-94ec-4660-beda-65bbcd576e35 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cc5249aea09430080e232cf17757f86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:33:52.018612 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb83611d-94ec-4660-beda-65bbcd576e35 service cinder] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:33:52.018946 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb83611d-94ec-4660-beda-65bbcd576e35 service cinder] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:33:52.019221 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb83611d-94ec-4660-beda-65bbcd576e35 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:33:52.027921 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb83611d-94ec-4660-beda-65bbcd576e35 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:33:52.029342 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb83611d-94ec-4660-beda-65bbcd576e35 service cinder] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:33:52.038874 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 768/1549] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:33:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:33:54.310469 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afb63dd-13c6-433a-9da2-0ce115540f9c None None] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:33:54.311049 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afb63dd-13c6-433a-9da2-0ce115540f9c None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:33:54.311049 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afb63dd-13c6-433a-9da2-0ce115540f9c None None] PATH_INFO: `/` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:33:54.312816 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 782/1550] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jan 25 02:33:54 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:33:54.318715 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f971e3f6-ba52-4191-a426-9c39a773a529 None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:33:54.319111 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f971e3f6-ba52-4191-a426-9c39a773a529 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:33:54.319271 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f971e3f6-ba52-4191-a426-9c39a773a529 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:33:54.339424 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-f971e3f6-ba52-4191-a426-9c39a773a529 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:33:54.340644 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-f971e3f6-ba52-4191-a426-9c39a773a529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:33:54.348647 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 769/1551] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jan 25 02:33:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:33:54.606357 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20e3616-cb76-4957-a927-d3faff3525e3 None None] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:33:54.606562 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20e3616-cb76-4957-a927-d3faff3525e3 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:33:54.606832 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20e3616-cb76-4957-a927-d3faff3525e3 None None] PATH_INFO: `/` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:33:54.608618 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 783/1552] 10.222.0.117 () {54 vars in 968 bytes} [Tue Jan 25 02:33:54 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:33:54.613968 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc3db14-4634-4d24-b23d-e8b357034b6c None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:33:54.614262 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc3db14-4634-4d24-b23d-e8b357034b6c None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:33:54.614544 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc3db14-4634-4d24-b23d-e8b357034b6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:33:54.632424 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-2dc3db14-4634-4d24-b23d-e8b357034b6c None None] MFA Rules not processed for user `1cc5249aea09430080e232cf17757f86`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:33:54.633608 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-2dc3db14-4634-4d24-b23d-e8b357034b6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:33:54.639979 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 770/1553] 10.222.0.117 () {58 vars in 1065 bytes} [Tue Jan 25 02:33:54 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:33:54.647592 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20e3616-cb76-4957-a927-d3faff3525e3 None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:33:54.657829 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20e3616-cb76-4957-a927-d3faff3525e3 None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:33:54.662087 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079598e3-a35b-4448-9eb6-ad53b6f23b66 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cc5249aea09430080e232cf17757f86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:33:54.662711 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079598e3-a35b-4448-9eb6-ad53b6f23b66 service cinder] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:33:54.662993 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079598e3-a35b-4448-9eb6-ad53b6f23b66 service cinder] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:33:54.663268 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079598e3-a35b-4448-9eb6-ad53b6f23b66 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:33:54.671939 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079598e3-a35b-4448-9eb6-ad53b6f23b66 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:33:54.673393 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079598e3-a35b-4448-9eb6-ad53b6f23b66 service cinder] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:33:54.683474 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 784/1554] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:33:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 25 02:35:18.726854 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecc2bd3-cb3a-4844-be62-6cdd493a36a5 None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:18.728006 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecc2bd3-cb3a-4844-be62-6cdd493a36a5 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:18.728726 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecc2bd3-cb3a-4844-be62-6cdd493a36a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:18.748385 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d13dc0-e2b8-495b-bf82-ae0ba4e21c6e None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:18.749473 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d13dc0-e2b8-495b-bf82-ae0ba4e21c6e None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:18.750142 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d13dc0-e2b8-495b-bf82-ae0ba4e21c6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:18.763738 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-cecc2bd3-cb3a-4844-be62-6cdd493a36a5 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:35:18.763738 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-cecc2bd3-cb3a-4844-be62-6cdd493a36a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:35:18.776720 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 771/1555] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:35:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:35:18.780765 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadbfbce-2c26-40d4-8450-e8426b9d38da None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:18.781060 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadbfbce-2c26-40d4-8450-e8426b9d38da None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:18.781342 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadbfbce-2c26-40d4-8450-e8426b9d38da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:18.781575 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-09d13dc0-e2b8-495b-bf82-ae0ba4e21c6e None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:35:18.783032 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-09d13dc0-e2b8-495b-bf82-ae0ba4e21c6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:35:18.798504 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 785/1556] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:35:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 25 02:35:18.800104 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de100bcb-79b0-44e9-a9aa-7ece573d8271 None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:18.800564 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de100bcb-79b0-44e9-a9aa-7ece573d8271 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:18.800985 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de100bcb-79b0-44e9-a9aa-7ece573d8271 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:18.829409 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-aadbfbce-2c26-40d4-8450-e8426b9d38da None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:35:18.831131 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-aadbfbce-2c26-40d4-8450-e8426b9d38da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:35:18.837378 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-de100bcb-79b0-44e9-a9aa-7ece573d8271 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:35:18.838653 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-de100bcb-79b0-44e9-a9aa-7ece573d8271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:35:18.858864 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 786/1557] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:35:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:35:18.860223 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb322574-001f-4fd7-b9aa-454dc2dcc1e2 None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:18.860513 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb322574-001f-4fd7-b9aa-454dc2dcc1e2 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:18.860794 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb322574-001f-4fd7-b9aa-454dc2dcc1e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:18.861090 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 772/1558] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:35:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:35:18.862675 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a5154a-eb5a-4ec0-86d0-12d8a281e00d None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:18.863145 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a5154a-eb5a-4ec0-86d0-12d8a281e00d None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:18.863316 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a5154a-eb5a-4ec0-86d0-12d8a281e00d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:18.898450 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-eb322574-001f-4fd7-b9aa-454dc2dcc1e2 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:35:18.899871 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-eb322574-001f-4fd7-b9aa-454dc2dcc1e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:35:18.903403 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-e7a5154a-eb5a-4ec0-86d0-12d8a281e00d None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:35:18.904646 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-e7a5154a-eb5a-4ec0-86d0-12d8a281e00d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:35:18.911126 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 787/1559] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:35:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:35:18.912332 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb322574-001f-4fd7-b9aa-454dc2dcc1e2 None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:18.919399 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 773/1560] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:35:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:35:18.920745 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c533a730-1b82-4d04-9ede-053bd2b68bc4 None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:18.921273 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c533a730-1b82-4d04-9ede-053bd2b68bc4 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:18.921817 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c533a730-1b82-4d04-9ede-053bd2b68bc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:18.922875 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb322574-001f-4fd7-b9aa-454dc2dcc1e2 None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:18.927500 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4ecda8-9695-4241-b5df-d0f09a0a7565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:18.928166 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4ecda8-9695-4241-b5df-d0f09a0a7565 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:18.928448 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4ecda8-9695-4241-b5df-d0f09a0a7565 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:18.928900 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4ecda8-9695-4241-b5df-d0f09a0a7565 admin admin] PATH_INFO: `/v3/domains` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:18.929992 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4ecda8-9695-4241-b5df-d0f09a0a7565 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:35:18.930294 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4ecda8-9695-4241-b5df-d0f09a0a7565 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:18.932012 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4ecda8-9695-4241-b5df-d0f09a0a7565 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:18.941393 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-c533a730-1b82-4d04-9ede-053bd2b68bc4 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:35:18.942572 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-c533a730-1b82-4d04-9ede-053bd2b68bc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:35:18.943392 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 788/1561] 10.222.0.117 () {58 vars in 1157 bytes} [Tue Jan 25 02:35:18 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:35:18.944680 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978bf8be-a7b8-47e4-89fa-6e2e8546cf14 None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:18.945589 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978bf8be-a7b8-47e4-89fa-6e2e8546cf14 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:18.945868 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978bf8be-a7b8-47e4-89fa-6e2e8546cf14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:18.954706 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 774/1562] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:35:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:35:18.956022 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b536ef6-94ab-4516-aad3-fae201394d93 None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:18.956312 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b536ef6-94ab-4516-aad3-fae201394d93 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:18.956589 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b536ef6-94ab-4516-aad3-fae201394d93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:18.965089 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-978bf8be-a7b8-47e4-89fa-6e2e8546cf14 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:35:18.966293 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-978bf8be-a7b8-47e4-89fa-6e2e8546cf14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:35:18.975107 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 789/1563] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:35:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:35:18.977333 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-6b536ef6-94ab-4516-aad3-fae201394d93 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:35:18.977897 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99049fbd-3e80-4b6d-8537-f58471d3e13f None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:18.978196 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99049fbd-3e80-4b6d-8537-f58471d3e13f None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:18.978478 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99049fbd-3e80-4b6d-8537-f58471d3e13f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:18.978660 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-6b536ef6-94ab-4516-aad3-fae201394d93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:35:18.987010 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 775/1564] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:35:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:35:18.988387 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b37cae-91e5-4b29-a555-f208d27ca654 None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:18.988676 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b37cae-91e5-4b29-a555-f208d27ca654 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:18.988952 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b37cae-91e5-4b29-a555-f208d27ca654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:18.997586 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-99049fbd-3e80-4b6d-8537-f58471d3e13f None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:35:18.998787 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-99049fbd-3e80-4b6d-8537-f58471d3e13f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:35:19.006629 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 790/1565] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:35:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:35:19.008465 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e80ace0-48d3-4797-a7f5-b11612bea761 None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:19.008911 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e80ace0-48d3-4797-a7f5-b11612bea761 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:19.009197 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e80ace0-48d3-4797-a7f5-b11612bea761 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:19.010309 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-43b37cae-91e5-4b29-a555-f208d27ca654 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:35:19.011643 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-43b37cae-91e5-4b29-a555-f208d27ca654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:35:19.019452 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 776/1566] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:35:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:35:19.020314 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b37cae-91e5-4b29-a555-f208d27ca654 None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:19.027373 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-6e80ace0-48d3-4797-a7f5-b11612bea761 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:35:19.028662 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-6e80ace0-48d3-4797-a7f5-b11612bea761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:35:19.030354 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b37cae-91e5-4b29-a555-f208d27ca654 None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:19.034826 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4f92fe-5e83-4c1a-a2e7-46db16fba84b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:19.035468 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4f92fe-5e83-4c1a-a2e7-46db16fba84b admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:19.035778 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4f92fe-5e83-4c1a-a2e7-46db16fba84b admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:19.036056 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4f92fe-5e83-4c1a-a2e7-46db16fba84b admin admin] PATH_INFO: `/v3/domains` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:19.036377 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 791/1567] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:35:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:35:19.036862 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4f92fe-5e83-4c1a-a2e7-46db16fba84b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:35:19.037122 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e80ace0-48d3-4797-a7f5-b11612bea761 None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:19.037256 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4f92fe-5e83-4c1a-a2e7-46db16fba84b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:19.039490 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4f92fe-5e83-4c1a-a2e7-46db16fba84b admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:19.058462 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 777/1568] 10.222.0.117 () {58 vars in 1157 bytes} [Tue Jan 25 02:35:19 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:35:19.058462 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4f92fe-5e83-4c1a-a2e7-46db16fba84b admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:19.058754 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e80ace0-48d3-4797-a7f5-b11612bea761 None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:19.058754 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c983dc10-591d-4ba5-8adf-b87824ff5127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:19.058754 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c983dc10-591d-4ba5-8adf-b87824ff5127 admin admin] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:19.058995 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c983dc10-591d-4ba5-8adf-b87824ff5127 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:19.059252 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c983dc10-591d-4ba5-8adf-b87824ff5127 admin admin] PATH_INFO: `/v3/projects` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:19.059991 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c983dc10-591d-4ba5-8adf-b87824ff5127 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:19.061862 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4f92fe-5e83-4c1a-a2e7-46db16fba84b admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:19.061981 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c983dc10-591d-4ba5-8adf-b87824ff5127 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:19.066342 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dbf05f-bbc4-434b-a8bd-bf3669772d75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:19.066974 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dbf05f-bbc4-434b-a8bd-bf3669772d75 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:19.067255 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dbf05f-bbc4-434b-a8bd-bf3669772d75 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:19.067532 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dbf05f-bbc4-434b-a8bd-bf3669772d75 admin admin] PATH_INFO: `/v3/domains` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:19.068291 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dbf05f-bbc4-434b-a8bd-bf3669772d75 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:35:19.068594 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dbf05f-bbc4-434b-a8bd-bf3669772d75 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:19.070347 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dbf05f-bbc4-434b-a8bd-bf3669772d75 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:19.082666 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 778/1569] 10.222.0.117 () {58 vars in 1157 bytes} [Tue Jan 25 02:35:19 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:35:19.084074 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5855dca4-7168-4db8-9003-97f526836e2b None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:19.084637 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5855dca4-7168-4db8-9003-97f526836e2b None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:19.084912 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5855dca4-7168-4db8-9003-97f526836e2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:19.088844 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 792/1570] 10.222.0.117 () {60 vars in 1157 bytes} [Tue Jan 25 02:35:19 2022] POST /identity/v3/projects => generated 394 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 02:35:19.090304 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2606716-ac88-4a28-b24f-742632f4c9bf None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:19.093680 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2606716-ac88-4a28-b24f-742632f4c9bf None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:19.093680 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2606716-ac88-4a28-b24f-742632f4c9bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:19.106914 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-5855dca4-7168-4db8-9003-97f526836e2b None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:35:19.108185 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-5855dca4-7168-4db8-9003-97f526836e2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:35:19.111826 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-e2606716-ac88-4a28-b24f-742632f4c9bf None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:35:19.113076 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-e2606716-ac88-4a28-b24f-742632f4c9bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:35:19.166675 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 779/1571] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:35:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:35:19.167530 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5855dca4-7168-4db8-9003-97f526836e2b None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:19.172690 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 793/1572] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:35:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:35:19.173996 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca2aaf9-eb39-40eb-8ef2-af7af2a18631 None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:19.174285 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca2aaf9-eb39-40eb-8ef2-af7af2a18631 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:19.174574 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca2aaf9-eb39-40eb-8ef2-af7af2a18631 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:19.176830 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5855dca4-7168-4db8-9003-97f526836e2b None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:19.183327 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe26a9c3-ef3e-4ac7-a7f9-bd600eff0fcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:19.183959 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe26a9c3-ef3e-4ac7-a7f9-bd600eff0fcf admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:19.184243 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe26a9c3-ef3e-4ac7-a7f9-bd600eff0fcf admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:19.184518 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe26a9c3-ef3e-4ac7-a7f9-bd600eff0fcf admin admin] PATH_INFO: `/v3/domains` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:19.185329 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe26a9c3-ef3e-4ac7-a7f9-bd600eff0fcf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:35:19.185635 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe26a9c3-ef3e-4ac7-a7f9-bd600eff0fcf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:19.187362 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe26a9c3-ef3e-4ac7-a7f9-bd600eff0fcf admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:19.193656 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-2ca2aaf9-eb39-40eb-8ef2-af7af2a18631 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:35:19.194870 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-2ca2aaf9-eb39-40eb-8ef2-af7af2a18631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:35:19.200023 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 780/1573] 10.222.0.117 () {58 vars in 1157 bytes} [Tue Jan 25 02:35:19 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:35:19.201273 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500dca57-9ea0-4e4d-b1d7-9b307c91ee00 None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:19.201565 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500dca57-9ea0-4e4d-b1d7-9b307c91ee00 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:19.201848 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500dca57-9ea0-4e4d-b1d7-9b307c91ee00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:19.211034 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 794/1574] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:35:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:35:19.212062 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca2aaf9-eb39-40eb-8ef2-af7af2a18631 None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:19.219063 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-500dca57-9ea0-4e4d-b1d7-9b307c91ee00 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:35:19.220287 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-500dca57-9ea0-4e4d-b1d7-9b307c91ee00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:35:19.224015 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca2aaf9-eb39-40eb-8ef2-af7af2a18631 None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:19.228877 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 781/1575] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:35:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:35:19.229114 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85610f15-15aa-4a45-a052-8f2c5361566d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:19.229767 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85610f15-15aa-4a45-a052-8f2c5361566d admin admin] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:19.230051 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85610f15-15aa-4a45-a052-8f2c5361566d admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:19.230326 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85610f15-15aa-4a45-a052-8f2c5361566d admin admin] PATH_INFO: `/v3/projects` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:19.231031 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85610f15-15aa-4a45-a052-8f2c5361566d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:19.232757 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500dca57-9ea0-4e4d-b1d7-9b307c91ee00 None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:19.232995 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85610f15-15aa-4a45-a052-8f2c5361566d admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:19.242763 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500dca57-9ea0-4e4d-b1d7-9b307c91ee00 None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:19.247681 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1d775a-ac7c-4fcf-80bb-3be6fa4e4d38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:19.248230 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1d775a-ac7c-4fcf-80bb-3be6fa4e4d38 admin admin] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:19.248549 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1d775a-ac7c-4fcf-80bb-3be6fa4e4d38 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:19.248853 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1d775a-ac7c-4fcf-80bb-3be6fa4e4d38 admin admin] PATH_INFO: `/v3/projects` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:19.249727 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1d775a-ac7c-4fcf-80bb-3be6fa4e4d38 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:19.252132 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1d775a-ac7c-4fcf-80bb-3be6fa4e4d38 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:19.259133 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 795/1576] 10.222.0.117 () {60 vars in 1157 bytes} [Tue Jan 25 02:35:19 2022] POST /identity/v3/projects => generated 370 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 02:35:19.262458 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85610f15-15aa-4a45-a052-8f2c5361566d admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:19.279241 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 782/1577] 10.222.0.117 () {60 vars in 1157 bytes} [Tue Jan 25 02:35:19 2022] POST /identity/v3/projects => generated 380 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 02:35:19.280146 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1d775a-ac7c-4fcf-80bb-3be6fa4e4d38 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:19.323425 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85610f15-15aa-4a45-a052-8f2c5361566d admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:19.341291 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1d775a-ac7c-4fcf-80bb-3be6fa4e4d38 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:19.345868 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe24ba4-d039-43d0-9e06-704e9c240eca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:19.346520 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe24ba4-d039-43d0-9e06-704e9c240eca admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:19.346803 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe24ba4-d039-43d0-9e06-704e9c240eca admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:19.347077 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe24ba4-d039-43d0-9e06-704e9c240eca admin admin] PATH_INFO: `/v3/domains` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:19.347843 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe24ba4-d039-43d0-9e06-704e9c240eca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:35:19.348151 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe24ba4-d039-43d0-9e06-704e9c240eca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:19.349763 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe24ba4-d039-43d0-9e06-704e9c240eca admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:19.361201 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 783/1578] 10.222.0.117 () {58 vars in 1157 bytes} [Tue Jan 25 02:35:19 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:35:19.362006 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe24ba4-d039-43d0-9e06-704e9c240eca admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:19.371687 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe24ba4-d039-43d0-9e06-704e9c240eca admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:19.376263 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4257721-7895-4c02-a69a-2fe7bba5069c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:19.376904 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4257721-7895-4c02-a69a-2fe7bba5069c admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:19.377186 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4257721-7895-4c02-a69a-2fe7bba5069c admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:19.377488 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4257721-7895-4c02-a69a-2fe7bba5069c admin admin] PATH_INFO: `/v3/domains` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:19.378210 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4257721-7895-4c02-a69a-2fe7bba5069c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:35:19.378511 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4257721-7895-4c02-a69a-2fe7bba5069c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:19.380116 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4257721-7895-4c02-a69a-2fe7bba5069c admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:19.380287 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a4978d-860f-4b0e-b996-b5c0b85b06ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:19.380961 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a4978d-860f-4b0e-b996-b5c0b85b06ea admin admin] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:19.381247 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a4978d-860f-4b0e-b996-b5c0b85b06ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:19.381525 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a4978d-860f-4b0e-b996-b5c0b85b06ea admin admin] PATH_INFO: `/v3/users` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:19.382258 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a4978d-860f-4b0e-b996-b5c0b85b06ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:19.384264 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a4978d-860f-4b0e-b996-b5c0b85b06ea admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:19.391684 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 784/1579] 10.222.0.117 () {58 vars in 1157 bytes} [Tue Jan 25 02:35:19 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:35:19.392480 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4257721-7895-4c02-a69a-2fe7bba5069c admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:19.403627 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 796/1580] 10.222.0.117 () {60 vars in 1148 bytes} [Tue Jan 25 02:35:19 2022] POST /identity/v3/users => generated 298 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 02:35:19.404686 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a4978d-860f-4b0e-b996-b5c0b85b06ea admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:19.408914 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4257721-7895-4c02-a69a-2fe7bba5069c admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:19.413470 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93acddf1-9062-4f3f-bb35-a7d136cdd9b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:19.414689 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93acddf1-9062-4f3f-bb35-a7d136cdd9b0 admin admin] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:19.414974 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93acddf1-9062-4f3f-bb35-a7d136cdd9b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:19.415245 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93acddf1-9062-4f3f-bb35-a7d136cdd9b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:19.415973 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a4978d-860f-4b0e-b996-b5c0b85b06ea admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:19.416075 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93acddf1-9062-4f3f-bb35-a7d136cdd9b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:19.417876 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93acddf1-9062-4f3f-bb35-a7d136cdd9b0 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:19.420501 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6165860c-6757-4f15-8827-bbb44ecf7a12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:19.421133 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6165860c-6757-4f15-8827-bbb44ecf7a12 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:19.421415 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6165860c-6757-4f15-8827-bbb44ecf7a12 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:19.421691 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6165860c-6757-4f15-8827-bbb44ecf7a12 admin admin] PATH_INFO: `/v3/domains` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:19.422418 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6165860c-6757-4f15-8827-bbb44ecf7a12 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:35:19.422723 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6165860c-6757-4f15-8827-bbb44ecf7a12 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:19.424354 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6165860c-6757-4f15-8827-bbb44ecf7a12 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:19.437797 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 797/1581] 10.222.0.117 () {58 vars in 1157 bytes} [Tue Jan 25 02:35:19 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:35:19.438929 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6165860c-6757-4f15-8827-bbb44ecf7a12 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:19.445865 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 785/1582] 10.222.0.117 () {60 vars in 1157 bytes} [Tue Jan 25 02:35:19 2022] POST /identity/v3/projects => generated 374 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 02:35:19.445865 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93acddf1-9062-4f3f-bb35-a7d136cdd9b0 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:19.450423 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6165860c-6757-4f15-8827-bbb44ecf7a12 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:19.505659 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97e47ba-203f-49ec-a1a0-6c30515fd363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:19.506143 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93acddf1-9062-4f3f-bb35-a7d136cdd9b0 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:19.506320 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97e47ba-203f-49ec-a1a0-6c30515fd363 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:19.506597 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97e47ba-203f-49ec-a1a0-6c30515fd363 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:19.506868 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97e47ba-203f-49ec-a1a0-6c30515fd363 admin admin] PATH_INFO: `/v3/domains` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:19.507916 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97e47ba-203f-49ec-a1a0-6c30515fd363 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:35:19.508231 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97e47ba-203f-49ec-a1a0-6c30515fd363 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:19.509837 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97e47ba-203f-49ec-a1a0-6c30515fd363 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:19.511024 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414f4559-8cb7-4530-b72f-08907acd1434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:19.511706 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414f4559-8cb7-4530-b72f-08907acd1434 admin admin] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:19.512001 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414f4559-8cb7-4530-b72f-08907acd1434 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:19.512282 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414f4559-8cb7-4530-b72f-08907acd1434 admin admin] PATH_INFO: `/v3/users` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:19.512993 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414f4559-8cb7-4530-b72f-08907acd1434 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:19.514906 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414f4559-8cb7-4530-b72f-08907acd1434 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:19.521142 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 798/1583] 10.222.0.117 () {58 vars in 1157 bytes} [Tue Jan 25 02:35:19 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:35:19.521994 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97e47ba-203f-49ec-a1a0-6c30515fd363 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:19.537305 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 786/1584] 10.222.0.117 () {60 vars in 1148 bytes} [Tue Jan 25 02:35:19 2022] POST /identity/v3/users => generated 286 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 02:35:19.537305 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414f4559-8cb7-4530-b72f-08907acd1434 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:19.538512 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97e47ba-203f-49ec-a1a0-6c30515fd363 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:19.543873 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebae70e4-b95d-4c45-af2d-32f469bb7839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:19.544518 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebae70e4-b95d-4c45-af2d-32f469bb7839 admin admin] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:19.544802 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebae70e4-b95d-4c45-af2d-32f469bb7839 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:19.545079 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebae70e4-b95d-4c45-af2d-32f469bb7839 admin admin] PATH_INFO: `/v3/users` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:19.545397 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414f4559-8cb7-4530-b72f-08907acd1434 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:19.545777 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebae70e4-b95d-4c45-af2d-32f469bb7839 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:19.547736 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebae70e4-b95d-4c45-af2d-32f469bb7839 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:19.549968 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27be8865-353f-4b84-b382-a9eecbb6446e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:19.550595 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27be8865-353f-4b84-b382-a9eecbb6446e admin admin] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:19.550876 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27be8865-353f-4b84-b382-a9eecbb6446e admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:19.551150 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27be8865-353f-4b84-b382-a9eecbb6446e admin admin] PATH_INFO: `/v3/projects` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:19.551877 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27be8865-353f-4b84-b382-a9eecbb6446e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:19.553758 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27be8865-353f-4b84-b382-a9eecbb6446e admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:19.572263 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 799/1585] 10.222.0.117 () {60 vars in 1148 bytes} [Tue Jan 25 02:35:19 2022] POST /identity/v3/users => generated 291 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 02:35:19.572263 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebae70e4-b95d-4c45-af2d-32f469bb7839 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:19.581422 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebae70e4-b95d-4c45-af2d-32f469bb7839 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:19.589099 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 787/1586] 10.222.0.117 () {60 vars in 1157 bytes} [Tue Jan 25 02:35:19 2022] POST /identity/v3/projects => generated 384 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 02:35:19.589099 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27be8865-353f-4b84-b382-a9eecbb6446e admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:19.589340 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffea06cc-424f-418f-9135-2d740b01d760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:19.589340 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffea06cc-424f-418f-9135-2d740b01d760 admin admin] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:19.589340 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffea06cc-424f-418f-9135-2d740b01d760 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:19.589340 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffea06cc-424f-418f-9135-2d740b01d760 admin admin] PATH_INFO: `/v3/projects` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:19.589666 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffea06cc-424f-418f-9135-2d740b01d760 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:19.591256 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffea06cc-424f-418f-9135-2d740b01d760 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:19.620112 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 800/1587] 10.222.0.117 () {60 vars in 1157 bytes} [Tue Jan 25 02:35:19 2022] POST /identity/v3/projects => generated 384 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 02:35:19.620112 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffea06cc-424f-418f-9135-2d740b01d760 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:19.646887 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27be8865-353f-4b84-b382-a9eecbb6446e admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:19.681151 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffea06cc-424f-418f-9135-2d740b01d760 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:19.685904 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24e3625-d9ae-4eaf-8345-f625d9087fa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:19.686515 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24e3625-d9ae-4eaf-8345-f625d9087fa9 admin admin] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:19.686798 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24e3625-d9ae-4eaf-8345-f625d9087fa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:19.687076 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24e3625-d9ae-4eaf-8345-f625d9087fa9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:19.687915 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24e3625-d9ae-4eaf-8345-f625d9087fa9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:19.689798 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24e3625-d9ae-4eaf-8345-f625d9087fa9 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:19.704083 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdf9d7d-00f3-4684-b476-37d04938d9f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:19.704777 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdf9d7d-00f3-4684-b476-37d04938d9f9 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:19.705072 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdf9d7d-00f3-4684-b476-37d04938d9f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:19.705382 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdf9d7d-00f3-4684-b476-37d04938d9f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:19.706062 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdf9d7d-00f3-4684-b476-37d04938d9f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:19.707654 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdf9d7d-00f3-4684-b476-37d04938d9f9 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:19.716421 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 801/1588] 10.222.0.117 () {60 vars in 1157 bytes} [Tue Jan 25 02:35:19 2022] POST /identity/v3/projects => generated 390 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 02:35:19.717351 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24e3625-d9ae-4eaf-8345-f625d9087fa9 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:19.721611 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 788/1589] 10.222.0.117 () {58 vars in 1126 bytes} [Tue Jan 25 02:35:19 2022] GET /identity/v3/roles => generated 1427 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 02:35:19.721611 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdf9d7d-00f3-4684-b476-37d04938d9f9 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:19.730688 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdf9d7d-00f3-4684-b476-37d04938d9f9 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:19.779784 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24e3625-d9ae-4eaf-8345-f625d9087fa9 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:19.784410 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb0fb3d-f7de-4ae9-aa28-b2b14d6d9f20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:19.785072 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb0fb3d-f7de-4ae9-aa28-b2b14d6d9f20 admin admin] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:19.785354 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb0fb3d-f7de-4ae9-aa28-b2b14d6d9f20 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:19.785628 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb0fb3d-f7de-4ae9-aa28-b2b14d6d9f20 admin admin] PATH_INFO: `/v3/users` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:19.785774 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba28818c-5040-4d40-aa32-19779072815c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:19.786323 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb0fb3d-f7de-4ae9-aa28-b2b14d6d9f20 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:19.786466 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba28818c-5040-4d40-aa32-19779072815c admin admin] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:19.786828 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba28818c-5040-4d40-aa32-19779072815c admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:19.787049 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba28818c-5040-4d40-aa32-19779072815c admin admin] PATH_INFO: `/v3/projects` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:19.787792 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba28818c-5040-4d40-aa32-19779072815c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:19.788682 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb0fb3d-f7de-4ae9-aa28-b2b14d6d9f20 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:19.789973 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba28818c-5040-4d40-aa32-19779072815c admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:19.810296 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 802/1590] 10.222.0.117 () {60 vars in 1148 bytes} [Tue Jan 25 02:35:19 2022] POST /identity/v3/users => generated 288 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 02:35:19.811192 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb0fb3d-f7de-4ae9-aa28-b2b14d6d9f20 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:19.821179 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 789/1591] 10.222.0.117 () {60 vars in 1157 bytes} [Tue Jan 25 02:35:19 2022] POST /identity/v3/projects => generated 380 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 02:35:19.821993 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba28818c-5040-4d40-aa32-19779072815c admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:19.822633 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb0fb3d-f7de-4ae9-aa28-b2b14d6d9f20 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:19.877290 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607d8ae0-7b8d-4aa3-8a8d-ac1a7accf5ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:19.877977 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607d8ae0-7b8d-4aa3-8a8d-ac1a7accf5ad admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:19.878324 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607d8ae0-7b8d-4aa3-8a8d-ac1a7accf5ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:19.878606 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607d8ae0-7b8d-4aa3-8a8d-ac1a7accf5ad admin admin] PATH_INFO: `/v3/roles` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:19.879382 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607d8ae0-7b8d-4aa3-8a8d-ac1a7accf5ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:19.881059 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607d8ae0-7b8d-4aa3-8a8d-ac1a7accf5ad admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:19.881487 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba28818c-5040-4d40-aa32-19779072815c admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:19.887096 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884191ac-ea50-496f-bdd0-3979d55b3d26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:19.887789 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884191ac-ea50-496f-bdd0-3979d55b3d26 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:19.888076 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884191ac-ea50-496f-bdd0-3979d55b3d26 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:19.888381 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884191ac-ea50-496f-bdd0-3979d55b3d26 admin admin] PATH_INFO: `/v3/roles` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:19.889128 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884191ac-ea50-496f-bdd0-3979d55b3d26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:19.890733 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884191ac-ea50-496f-bdd0-3979d55b3d26 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:19.891419 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 803/1592] 10.222.0.117 () {58 vars in 1126 bytes} [Tue Jan 25 02:35:19 2022] GET /identity/v3/roles => generated 1427 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 02:35:19.892254 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607d8ae0-7b8d-4aa3-8a8d-ac1a7accf5ad admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:19.901104 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 790/1593] 10.222.0.117 () {58 vars in 1126 bytes} [Tue Jan 25 02:35:19 2022] GET /identity/v3/roles => generated 1427 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 02:35:19.902993 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607d8ae0-7b8d-4aa3-8a8d-ac1a7accf5ad admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:19.904702 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884191ac-ea50-496f-bdd0-3979d55b3d26 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:19.907629 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6005ad6-dae6-41b2-b65b-beff11de8e8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:19.908306 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6005ad6-dae6-41b2-b65b-beff11de8e8c admin admin] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:19.908591 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6005ad6-dae6-41b2-b65b-beff11de8e8c admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:19.908868 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6005ad6-dae6-41b2-b65b-beff11de8e8c admin admin] PATH_INFO: `/v3/users` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:19.909565 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6005ad6-dae6-41b2-b65b-beff11de8e8c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:19.911497 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6005ad6-dae6-41b2-b65b-beff11de8e8c admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:19.913929 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884191ac-ea50-496f-bdd0-3979d55b3d26 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:19.918541 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67070166-854f-48ea-9218-61063a69cba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:19.919190 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67070166-854f-48ea-9218-61063a69cba5 admin admin] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:19.919468 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67070166-854f-48ea-9218-61063a69cba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:19.919772 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67070166-854f-48ea-9218-61063a69cba5 admin admin] PATH_INFO: `/v3/users` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:19.920470 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67070166-854f-48ea-9218-61063a69cba5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:19.922353 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67070166-854f-48ea-9218-61063a69cba5 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:19.931608 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 804/1594] 10.222.0.117 () {60 vars in 1148 bytes} [Tue Jan 25 02:35:19 2022] POST /identity/v3/users => generated 293 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 02:35:19.932441 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6005ad6-dae6-41b2-b65b-beff11de8e8c admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:19.942139 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6005ad6-dae6-41b2-b65b-beff11de8e8c admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:19.946492 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 791/1595] 10.222.0.117 () {60 vars in 1148 bytes} [Tue Jan 25 02:35:19 2022] POST /identity/v3/users => generated 293 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 02:35:19.947498 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67070166-854f-48ea-9218-61063a69cba5 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:19.947647 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86dd31b-faa1-48ad-a9b9-f563a9e0b5cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:19.948389 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86dd31b-faa1-48ad-a9b9-f563a9e0b5cd admin admin] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:19.948729 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86dd31b-faa1-48ad-a9b9-f563a9e0b5cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:19.949013 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86dd31b-faa1-48ad-a9b9-f563a9e0b5cd admin admin] PATH_INFO: `/v3/users` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:19.949800 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86dd31b-faa1-48ad-a9b9-f563a9e0b5cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:19.951761 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86dd31b-faa1-48ad-a9b9-f563a9e0b5cd admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:19.957242 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67070166-854f-48ea-9218-61063a69cba5 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:19.962447 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1b11f9-553b-45b4-ba3f-0e4d11793922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:19.963107 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1b11f9-553b-45b4-ba3f-0e4d11793922 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:19.963393 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1b11f9-553b-45b4-ba3f-0e4d11793922 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:19.963662 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1b11f9-553b-45b4-ba3f-0e4d11793922 admin admin] PATH_INFO: `/v3/roles` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:19.964432 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1b11f9-553b-45b4-ba3f-0e4d11793922 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:19.966061 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1b11f9-553b-45b4-ba3f-0e4d11793922 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:19.973629 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 805/1596] 10.222.0.117 () {60 vars in 1148 bytes} [Tue Jan 25 02:35:19 2022] POST /identity/v3/users => generated 296 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 02:35:19.976928 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86dd31b-faa1-48ad-a9b9-f563a9e0b5cd admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:19.980914 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 792/1597] 10.222.0.117 () {58 vars in 1126 bytes} [Tue Jan 25 02:35:19 2022] GET /identity/v3/roles => generated 1427 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 02:35:19.981611 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1b11f9-553b-45b4-ba3f-0e4d11793922 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:19.986426 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86dd31b-faa1-48ad-a9b9-f563a9e0b5cd admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:19.991038 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ec170d-93f3-4f58-9820-69fca2413678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:19.991721 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1b11f9-553b-45b4-ba3f-0e4d11793922 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:19.992443 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ec170d-93f3-4f58-9820-69fca2413678 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:19.992644 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ec170d-93f3-4f58-9820-69fca2413678 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:19.992942 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ec170d-93f3-4f58-9820-69fca2413678 admin admin] PATH_INFO: `/v3/roles` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:19.993681 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ec170d-93f3-4f58-9820-69fca2413678 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:19.995279 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ec170d-93f3-4f58-9820-69fca2413678 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:19.997532 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64282257-c01f-448a-bbe7-4c7dde8ace46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:19.998195 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64282257-c01f-448a-bbe7-4c7dde8ace46 admin admin] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:19.998482 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64282257-c01f-448a-bbe7-4c7dde8ace46 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:19.998761 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64282257-c01f-448a-bbe7-4c7dde8ace46 admin admin] PATH_INFO: `/v3/users` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:19.999462 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64282257-c01f-448a-bbe7-4c7dde8ace46 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:20.001410 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64282257-c01f-448a-bbe7-4c7dde8ace46 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:20.008619 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 806/1598] 10.222.0.117 () {58 vars in 1126 bytes} [Tue Jan 25 02:35:19 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 02:35:20.008619 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ec170d-93f3-4f58-9820-69fca2413678 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:20.016588 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ec170d-93f3-4f58-9820-69fca2413678 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:20.021225 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b5919b-90ce-4cf9-9c74-52693e57d6c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:20.021869 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b5919b-90ce-4cf9-9c74-52693e57d6c4 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:20.022152 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b5919b-90ce-4cf9-9c74-52693e57d6c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:20.022430 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b5919b-90ce-4cf9-9c74-52693e57d6c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:20.026188 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 793/1599] 10.222.0.117 () {60 vars in 1148 bytes} [Tue Jan 25 02:35:19 2022] POST /identity/v3/users => generated 291 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 02:35:20.026188 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64282257-c01f-448a-bbe7-4c7dde8ace46 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:20.026359 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b5919b-90ce-4cf9-9c74-52693e57d6c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:20.026359 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b5919b-90ce-4cf9-9c74-52693e57d6c4 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:20.033295 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64282257-c01f-448a-bbe7-4c7dde8ace46 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:20.035576 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 807/1600] 10.222.0.117 () {58 vars in 1126 bytes} [Tue Jan 25 02:35:20 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 02:35:20.036451 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b5919b-90ce-4cf9-9c74-52693e57d6c4 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:20.041321 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41099beb-bb79-489b-b1f5-d93e8c071a48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:20.041986 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41099beb-bb79-489b-b1f5-d93e8c071a48 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:20.042275 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41099beb-bb79-489b-b1f5-d93e8c071a48 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:20.042553 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41099beb-bb79-489b-b1f5-d93e8c071a48 admin admin] PATH_INFO: `/v3/roles` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:20.043296 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41099beb-bb79-489b-b1f5-d93e8c071a48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:20.044949 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41099beb-bb79-489b-b1f5-d93e8c071a48 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:20.046065 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b5919b-90ce-4cf9-9c74-52693e57d6c4 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:20.050573 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0a651e-e92d-439a-bcdc-5ad92f43b4dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:20.051205 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0a651e-e92d-439a-bcdc-5ad92f43b4dd admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:20.051487 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0a651e-e92d-439a-bcdc-5ad92f43b4dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:20.051793 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0a651e-e92d-439a-bcdc-5ad92f43b4dd admin admin] PATH_INFO: `/v3/roles` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:20.052516 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0a651e-e92d-439a-bcdc-5ad92f43b4dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:20.054088 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0a651e-e92d-439a-bcdc-5ad92f43b4dd admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:20.054860 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 794/1601] 10.222.0.117 () {58 vars in 1126 bytes} [Tue Jan 25 02:35:20 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 02:35:20.055653 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41099beb-bb79-489b-b1f5-d93e8c071a48 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:20.067550 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 808/1602] 10.222.0.117 () {58 vars in 1126 bytes} [Tue Jan 25 02:35:20 2022] GET /identity/v3/roles => generated 1427 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 02:35:20.067728 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41099beb-bb79-489b-b1f5-d93e8c071a48 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:20.067857 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0a651e-e92d-439a-bcdc-5ad92f43b4dd admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:20.072559 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a070b813-b6f1-4138-8ea1-ac984c52d9dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:20.073187 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a070b813-b6f1-4138-8ea1-ac984c52d9dd admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:20.073914 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a070b813-b6f1-4138-8ea1-ac984c52d9dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:20.073914 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a070b813-b6f1-4138-8ea1-ac984c52d9dd admin admin] PATH_INFO: `/v3/roles` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:20.074450 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a070b813-b6f1-4138-8ea1-ac984c52d9dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:20.076085 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a070b813-b6f1-4138-8ea1-ac984c52d9dd admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:20.077065 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0a651e-e92d-439a-bcdc-5ad92f43b4dd admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:20.081569 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754878b7-2787-4012-8a48-018c9cec2e5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:20.082197 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754878b7-2787-4012-8a48-018c9cec2e5d admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:20.082478 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754878b7-2787-4012-8a48-018c9cec2e5d admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:20.082753 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754878b7-2787-4012-8a48-018c9cec2e5d admin admin] PATH_INFO: `/v3/roles` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:20.083473 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754878b7-2787-4012-8a48-018c9cec2e5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:20.086019 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754878b7-2787-4012-8a48-018c9cec2e5d admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:20.087174 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 795/1603] 10.222.0.117 () {58 vars in 1126 bytes} [Tue Jan 25 02:35:20 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 02:35:20.087962 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a070b813-b6f1-4138-8ea1-ac984c52d9dd admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:20.099306 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 809/1604] 10.222.0.117 () {58 vars in 1126 bytes} [Tue Jan 25 02:35:20 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 02:35:20.099477 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a070b813-b6f1-4138-8ea1-ac984c52d9dd admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:20.099593 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754878b7-2787-4012-8a48-018c9cec2e5d admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:20.104128 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989e4798-0654-4536-8a86-4d686c5e5d0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:20.105003 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989e4798-0654-4536-8a86-4d686c5e5d0e admin admin] REQUEST_METHOD: `PUT` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:20.105288 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989e4798-0654-4536-8a86-4d686c5e5d0e admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:20.105568 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989e4798-0654-4536-8a86-4d686c5e5d0e admin admin] PATH_INFO: `/v3/projects/feffe01cf3f84eb1800d246f235af06f/users/ee5b954a34da4c95aab352015a7c551c/roles/33a8e87420ed423f9cb29e0084eab5d2` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:20.109341 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754878b7-2787-4012-8a48-018c9cec2e5d admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:20.115604 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e727eada-26e6-424f-874c-db8f690f7a72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:20.116295 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e727eada-26e6-424f-874c-db8f690f7a72 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:20.116608 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e727eada-26e6-424f-874c-db8f690f7a72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:20.117476 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e727eada-26e6-424f-874c-db8f690f7a72 admin admin] PATH_INFO: `/v3/roles` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:20.118500 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e727eada-26e6-424f-874c-db8f690f7a72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:20.120190 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e727eada-26e6-424f-874c-db8f690f7a72 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:20.124560 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989e4798-0654-4536-8a86-4d686c5e5d0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=feffe01cf3f84eb1800d246f235af06f, user_id=ee5b954a34da4c95aab352015a7c551c, role_id=33a8e87420ed423f9cb29e0084eab5d2)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:20.127354 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989e4798-0654-4536-8a86-4d686c5e5d0e admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:20.132506 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 810/1605] 10.222.0.117 () {58 vars in 1126 bytes} [Tue Jan 25 02:35:20 2022] GET /identity/v3/roles => generated 1427 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 02:35:20.134152 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e727eada-26e6-424f-874c-db8f690f7a72 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:20.146877 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e727eada-26e6-424f-874c-db8f690f7a72 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:20.152458 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4020fba-5867-4c69-a3f7-2f8a991cfa38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:20.153112 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4020fba-5867-4c69-a3f7-2f8a991cfa38 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:20.153395 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4020fba-5867-4c69-a3f7-2f8a991cfa38 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:20.153813 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4020fba-5867-4c69-a3f7-2f8a991cfa38 admin admin] PATH_INFO: `/v3/roles` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:20.154519 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4020fba-5867-4c69-a3f7-2f8a991cfa38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:20.156251 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4020fba-5867-4c69-a3f7-2f8a991cfa38 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:20.158867 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 796/1606] 10.222.0.117 () {60 vars in 1487 bytes} [Tue Jan 25 02:35:20 2022] PUT /identity/v3/projects/feffe01cf3f84eb1800d246f235af06f/users/ee5b954a34da4c95aab352015a7c551c/roles/33a8e87420ed423f9cb29e0084eab5d2 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:35:20.159615 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989e4798-0654-4536-8a86-4d686c5e5d0e admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:20.167394 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 811/1607] 10.222.0.117 () {58 vars in 1126 bytes} [Tue Jan 25 02:35:20 2022] GET /identity/v3/roles => generated 1427 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 02:35:20.168341 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4020fba-5867-4c69-a3f7-2f8a991cfa38 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:20.178189 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4020fba-5867-4c69-a3f7-2f8a991cfa38 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:20.223050 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989e4798-0654-4536-8a86-4d686c5e5d0e admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:20.227825 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0e8f06-e0ea-44e6-b561-4b35c15e0209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:20.228719 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0e8f06-e0ea-44e6-b561-4b35c15e0209 admin admin] REQUEST_METHOD: `PUT` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:20.229001 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0e8f06-e0ea-44e6-b561-4b35c15e0209 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:20.229278 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0e8f06-e0ea-44e6-b561-4b35c15e0209 admin admin] PATH_INFO: `/v3/projects/762ca0aed045494f8c8d429eabf7c1fe/users/c62106d6fef2410fa97b840a91bb8db8/roles/33a8e87420ed423f9cb29e0084eab5d2` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:20.237966 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796c756d-43ee-4f2a-bd1e-cbaac14493c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:20.238845 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796c756d-43ee-4f2a-bd1e-cbaac14493c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:20.239129 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796c756d-43ee-4f2a-bd1e-cbaac14493c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:20.239404 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796c756d-43ee-4f2a-bd1e-cbaac14493c2 admin admin] PATH_INFO: `/v3/projects/d513cd7c4380444d8bcc26c9829072b5/users/dccf7cdc56b6472c923290df90b69700/roles/33a8e87420ed423f9cb29e0084eab5d2` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:20.244980 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0e8f06-e0ea-44e6-b561-4b35c15e0209 admin admin] RBAC: Authorizing `identity:create_grant(project_id=762ca0aed045494f8c8d429eabf7c1fe, user_id=c62106d6fef2410fa97b840a91bb8db8, role_id=33a8e87420ed423f9cb29e0084eab5d2)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:20.247714 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0e8f06-e0ea-44e6-b561-4b35c15e0209 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:20.253748 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796c756d-43ee-4f2a-bd1e-cbaac14493c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d513cd7c4380444d8bcc26c9829072b5, user_id=dccf7cdc56b6472c923290df90b69700, role_id=33a8e87420ed423f9cb29e0084eab5d2)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:20.256463 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796c756d-43ee-4f2a-bd1e-cbaac14493c2 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:20.262316 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 797/1608] 10.222.0.117 () {60 vars in 1487 bytes} [Tue Jan 25 02:35:20 2022] PUT /identity/v3/projects/762ca0aed045494f8c8d429eabf7c1fe/users/c62106d6fef2410fa97b840a91bb8db8/roles/33a8e87420ed423f9cb29e0084eab5d2 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:35:20.263275 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0e8f06-e0ea-44e6-b561-4b35c15e0209 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:20.283729 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 812/1609] 10.222.0.117 () {60 vars in 1487 bytes} [Tue Jan 25 02:35:20 2022] PUT /identity/v3/projects/d513cd7c4380444d8bcc26c9829072b5/users/dccf7cdc56b6472c923290df90b69700/roles/33a8e87420ed423f9cb29e0084eab5d2 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:35:20.283729 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796c756d-43ee-4f2a-bd1e-cbaac14493c2 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:20.345281 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796c756d-43ee-4f2a-bd1e-cbaac14493c2 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:20.349838 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ac7bda-2c31-44e8-af78-dd7ca958b6cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:20.350496 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ac7bda-2c31-44e8-af78-dd7ca958b6cc admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:20.350788 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ac7bda-2c31-44e8-af78-dd7ca958b6cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:20.351097 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ac7bda-2c31-44e8-af78-dd7ca958b6cc admin admin] PATH_INFO: `/v3/roles` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:20.351969 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ac7bda-2c31-44e8-af78-dd7ca958b6cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:20.353581 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ac7bda-2c31-44e8-af78-dd7ca958b6cc admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:20.354577 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0e8f06-e0ea-44e6-b561-4b35c15e0209 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:20.359188 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f51603-4a8c-4e9d-9659-37e9b560ba9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:20.359863 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f51603-4a8c-4e9d-9659-37e9b560ba9c admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:20.360224 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f51603-4a8c-4e9d-9659-37e9b560ba9c admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:20.360416 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f51603-4a8c-4e9d-9659-37e9b560ba9c admin admin] PATH_INFO: `/v3/roles` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:20.361138 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f51603-4a8c-4e9d-9659-37e9b560ba9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:20.362695 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f51603-4a8c-4e9d-9659-37e9b560ba9c admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:20.363310 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 813/1610] 10.222.0.117 () {58 vars in 1126 bytes} [Tue Jan 25 02:35:20 2022] GET /identity/v3/roles => generated 1427 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 02:35:20.364281 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ac7bda-2c31-44e8-af78-dd7ca958b6cc admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:20.376806 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 798/1611] 10.222.0.117 () {58 vars in 1126 bytes} [Tue Jan 25 02:35:20 2022] GET /identity/v3/roles => generated 1427 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 02:35:20.376999 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ac7bda-2c31-44e8-af78-dd7ca958b6cc admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:20.377109 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f51603-4a8c-4e9d-9659-37e9b560ba9c admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:20.379027 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052e06c4-58d3-4c23-861d-49c955e6b8a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:20.379663 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052e06c4-58d3-4c23-861d-49c955e6b8a8 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:20.379972 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052e06c4-58d3-4c23-861d-49c955e6b8a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:20.380246 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052e06c4-58d3-4c23-861d-49c955e6b8a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:20.381006 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052e06c4-58d3-4c23-861d-49c955e6b8a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:20.383528 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052e06c4-58d3-4c23-861d-49c955e6b8a8 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:20.384723 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f51603-4a8c-4e9d-9659-37e9b560ba9c admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:20.389498 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848ff9a4-5f4e-4269-bb1d-33ff7e1dd9d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:20.390350 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848ff9a4-5f4e-4269-bb1d-33ff7e1dd9d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:20.390636 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848ff9a4-5f4e-4269-bb1d-33ff7e1dd9d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:20.391034 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848ff9a4-5f4e-4269-bb1d-33ff7e1dd9d8 admin admin] PATH_INFO: `/v3/projects/a9d5550476224f8593125e43a115ad18/users/923c0bf7a63345b78438dc2836f678b2/roles/33a8e87420ed423f9cb29e0084eab5d2` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:20.393502 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 814/1612] 10.222.0.117 () {58 vars in 1126 bytes} [Tue Jan 25 02:35:20 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 02:35:20.394785 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c6a3bf-b796-49e3-ac9e-9755ba23a074 None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:20.395074 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c6a3bf-b796-49e3-ac9e-9755ba23a074 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:20.395345 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c6a3bf-b796-49e3-ac9e-9755ba23a074 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:20.406254 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848ff9a4-5f4e-4269-bb1d-33ff7e1dd9d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9d5550476224f8593125e43a115ad18, user_id=923c0bf7a63345b78438dc2836f678b2, role_id=33a8e87420ed423f9cb29e0084eab5d2)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:20.408952 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848ff9a4-5f4e-4269-bb1d-33ff7e1dd9d8 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:20.412894 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-c0c6a3bf-b796-49e3-ac9e-9755ba23a074 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:35:20.415425 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-c0c6a3bf-b796-49e3-ac9e-9755ba23a074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:35:20.422509 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 799/1613] 10.222.0.117 () {60 vars in 1487 bytes} [Tue Jan 25 02:35:20 2022] PUT /identity/v3/projects/a9d5550476224f8593125e43a115ad18/users/923c0bf7a63345b78438dc2836f678b2/roles/33a8e87420ed423f9cb29e0084eab5d2 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:35:20.423330 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848ff9a4-5f4e-4269-bb1d-33ff7e1dd9d8 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:20.499577 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 815/1614] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:35:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:35:20.499808 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f06cc27-7f5b-4a1c-b9f6-405e0bcb252e None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:20.500120 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f06cc27-7f5b-4a1c-b9f6-405e0bcb252e None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:20.503066 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f06cc27-7f5b-4a1c-b9f6-405e0bcb252e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:20.503771 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848ff9a4-5f4e-4269-bb1d-33ff7e1dd9d8 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:20.507180 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daf4781-20ed-4b49-865f-623d5eb9ebf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:20.508087 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daf4781-20ed-4b49-865f-623d5eb9ebf9 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:20.508655 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daf4781-20ed-4b49-865f-623d5eb9ebf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:20.508953 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daf4781-20ed-4b49-865f-623d5eb9ebf9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:20.509854 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2daf4781-20ed-4b49-865f-623d5eb9ebf9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:20.511459 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2daf4781-20ed-4b49-865f-623d5eb9ebf9 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:20.521730 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 800/1615] 10.222.0.117 () {58 vars in 1126 bytes} [Tue Jan 25 02:35:20 2022] GET /identity/v3/roles => generated 1427 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 02:35:20.522909 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdce8aa4-c574-45c4-84f3-850d8fbf53e8 None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:20.523873 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdce8aa4-c574-45c4-84f3-850d8fbf53e8 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:20.524335 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdce8aa4-c574-45c4-84f3-850d8fbf53e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:20.531911 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-7f06cc27-7f5b-4a1c-b9f6-405e0bcb252e None None] MFA Rules not processed for user `c62106d6fef2410fa97b840a91bb8db8`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:35:20.533115 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-7f06cc27-7f5b-4a1c-b9f6-405e0bcb252e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:35:20.550313 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-cdce8aa4-c574-45c4-84f3-850d8fbf53e8 None None] MFA Rules not processed for user `dccf7cdc56b6472c923290df90b69700`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:35:20.551548 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-cdce8aa4-c574-45c4-84f3-850d8fbf53e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:35:20.599148 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 816/1616] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:35:20 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:35:20.604157 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f06cc27-7f5b-4a1c-b9f6-405e0bcb252e None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:20.614210 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f06cc27-7f5b-4a1c-b9f6-405e0bcb252e None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:20.618029 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 801/1617] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:35:20 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:35:20.619479 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2a2ea8-a566-4b0b-8868-c38fb3ef9b73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:20.620395 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2a2ea8-a566-4b0b-8868-c38fb3ef9b73 admin admin] REQUEST_METHOD: `PUT` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:20.620678 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2a2ea8-a566-4b0b-8868-c38fb3ef9b73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:20.620951 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2a2ea8-a566-4b0b-8868-c38fb3ef9b73 admin admin] PATH_INFO: `/v3/projects/ad779fdd393a496c8ba005741bbb7381/users/9283ac3af88a4b908355467a35b52871/roles/33a8e87420ed423f9cb29e0084eab5d2` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:20.622322 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdce8aa4-c574-45c4-84f3-850d8fbf53e8 None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:20.632149 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdce8aa4-c574-45c4-84f3-850d8fbf53e8 None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:20.635849 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2a2ea8-a566-4b0b-8868-c38fb3ef9b73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad779fdd393a496c8ba005741bbb7381, user_id=9283ac3af88a4b908355467a35b52871, role_id=33a8e87420ed423f9cb29e0084eab5d2)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:20.637479 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c221f0-7083-4a19-b3f7-a0a84cfdd039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:20.638353 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c221f0-7083-4a19-b3f7-a0a84cfdd039 admin admin] REQUEST_METHOD: `PUT` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:20.638508 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2a2ea8-a566-4b0b-8868-c38fb3ef9b73 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:20.638702 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c221f0-7083-4a19-b3f7-a0a84cfdd039 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:20.638906 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c221f0-7083-4a19-b3f7-a0a84cfdd039 admin admin] PATH_INFO: `/v3/projects/6d1acc2413564b368f3c2ec812ffe6ef/users/63855c1cdc7b46548312f2e14d99cfe1/roles/33a8e87420ed423f9cb29e0084eab5d2` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:20.652039 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 817/1618] 10.222.0.117 () {60 vars in 1487 bytes} [Tue Jan 25 02:35:20 2022] PUT /identity/v3/projects/ad779fdd393a496c8ba005741bbb7381/users/9283ac3af88a4b908355467a35b52871/roles/33a8e87420ed423f9cb29e0084eab5d2 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:35:20.652817 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2a2ea8-a566-4b0b-8868-c38fb3ef9b73 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:20.659641 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c221f0-7083-4a19-b3f7-a0a84cfdd039 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d1acc2413564b368f3c2ec812ffe6ef, user_id=63855c1cdc7b46548312f2e14d99cfe1, role_id=33a8e87420ed423f9cb29e0084eab5d2)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:20.662419 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c221f0-7083-4a19-b3f7-a0a84cfdd039 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:20.683443 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 802/1619] 10.222.0.117 () {60 vars in 1487 bytes} [Tue Jan 25 02:35:20 2022] PUT /identity/v3/projects/6d1acc2413564b368f3c2ec812ffe6ef/users/63855c1cdc7b46548312f2e14d99cfe1/roles/33a8e87420ed423f9cb29e0084eab5d2 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:35:20.685655 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344b5335-479e-4a3c-972c-379990d7b987 None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:20.686125 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344b5335-479e-4a3c-972c-379990d7b987 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:20.686563 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344b5335-479e-4a3c-972c-379990d7b987 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:20.717360 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-344b5335-479e-4a3c-972c-379990d7b987 None None] MFA Rules not processed for user `923c0bf7a63345b78438dc2836f678b2`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:35:20.718567 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-344b5335-479e-4a3c-972c-379990d7b987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:35:20.734082 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2a2ea8-a566-4b0b-8868-c38fb3ef9b73 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:20.781740 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 803/1620] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:35:20 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:35:20.782501 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344b5335-479e-4a3c-972c-379990d7b987 None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:20.790870 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b9ab81-6d7e-452d-b9d7-8b8daab69dd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:20.791802 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b9ab81-6d7e-452d-b9d7-8b8daab69dd1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:20.792115 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b9ab81-6d7e-452d-b9d7-8b8daab69dd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:20.792397 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b9ab81-6d7e-452d-b9d7-8b8daab69dd1 admin admin] PATH_INFO: `/v3/projects/461a94a96965493aa3c9fdfcd43258c5/users/a366d243b91b479cac0fa7f3238cbafa/roles/33a8e87420ed423f9cb29e0084eab5d2` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:20.807083 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b9ab81-6d7e-452d-b9d7-8b8daab69dd1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=461a94a96965493aa3c9fdfcd43258c5, user_id=a366d243b91b479cac0fa7f3238cbafa, role_id=33a8e87420ed423f9cb29e0084eab5d2)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:20.809801 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b9ab81-6d7e-452d-b9d7-8b8daab69dd1 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:20.823503 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 818/1621] 10.222.0.117 () {60 vars in 1487 bytes} [Tue Jan 25 02:35:20 2022] PUT /identity/v3/projects/461a94a96965493aa3c9fdfcd43258c5/users/a366d243b91b479cac0fa7f3238cbafa/roles/33a8e87420ed423f9cb29e0084eab5d2 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:35:20.824408 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b9ab81-6d7e-452d-b9d7-8b8daab69dd1 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:20.847532 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344b5335-479e-4a3c-972c-379990d7b987 None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:20.894920 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b9ab81-6d7e-452d-b9d7-8b8daab69dd1 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:20.899040 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7c405c-341a-4d6d-b05b-1f9d3907937c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca4071c5f8f4a31b5edb81fa66a43a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:20.899717 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7c405c-341a-4d6d-b05b-1f9d3907937c service neutron] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:20.900010 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7c405c-341a-4d6d-b05b-1f9d3907937c service neutron] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:20.900292 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7c405c-341a-4d6d-b05b-1f9d3907937c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:20.901017 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dad22a-a1c0-497c-9fa1-ff46b4cebd6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:20.901908 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dad22a-a1c0-497c-9fa1-ff46b4cebd6e admin admin] REQUEST_METHOD: `PUT` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:20.902193 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dad22a-a1c0-497c-9fa1-ff46b4cebd6e admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:20.902470 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dad22a-a1c0-497c-9fa1-ff46b4cebd6e admin admin] PATH_INFO: `/v3/projects/cc7d18886cee4c49abf6786916eff689/users/6ae7d43612964e46947d52e67a4725ff/roles/33a8e87420ed423f9cb29e0084eab5d2` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:20.909923 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7c405c-341a-4d6d-b05b-1f9d3907937c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:20.911368 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7c405c-341a-4d6d-b05b-1f9d3907937c service neutron] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:20.917635 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dad22a-a1c0-497c-9fa1-ff46b4cebd6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc7d18886cee4c49abf6786916eff689, user_id=6ae7d43612964e46947d52e67a4725ff, role_id=33a8e87420ed423f9cb29e0084eab5d2)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:20.920468 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dad22a-a1c0-497c-9fa1-ff46b4cebd6e admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:20.921627 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 804/1622] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:35:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:35:20.922481 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7c405c-341a-4d6d-b05b-1f9d3907937c service neutron] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:20.932543 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7c405c-341a-4d6d-b05b-1f9d3907937c service neutron] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:20.935341 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 819/1623] 10.222.0.117 () {60 vars in 1487 bytes} [Tue Jan 25 02:35:20 2022] PUT /identity/v3/projects/cc7d18886cee4c49abf6786916eff689/users/6ae7d43612964e46947d52e67a4725ff/roles/33a8e87420ed423f9cb29e0084eab5d2 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:35:20.936338 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dad22a-a1c0-497c-9fa1-ff46b4cebd6e admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:20.995204 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b433be0-babb-4ac8-8b2d-b88f5b4b13ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:20.995899 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b433be0-babb-4ac8-8b2d-b88f5b4b13ab admin admin] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:20.996182 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b433be0-babb-4ac8-8b2d-b88f5b4b13ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:20.996450 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b433be0-babb-4ac8-8b2d-b88f5b4b13ab admin admin] PATH_INFO: `/v3/projects` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:20.997158 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b433be0-babb-4ac8-8b2d-b88f5b4b13ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:20.999086 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b433be0-babb-4ac8-8b2d-b88f5b4b13ab admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:21.007000 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dad22a-a1c0-497c-9fa1-ff46b4cebd6e admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:21.016068 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0923f06a-1234-4aa4-aab3-b631c69956d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:21.016908 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0923f06a-1234-4aa4-aab3-b631c69956d0 admin admin] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:21.017196 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0923f06a-1234-4aa4-aab3-b631c69956d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:21.017643 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0923f06a-1234-4aa4-aab3-b631c69956d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:21.018455 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0923f06a-1234-4aa4-aab3-b631c69956d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:21.020656 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0923f06a-1234-4aa4-aab3-b631c69956d0 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:21.033462 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 805/1624] 10.222.0.117 () {60 vars in 1157 bytes} [Tue Jan 25 02:35:20 2022] POST /identity/v3/projects => generated 368 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 02:35:21.033462 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7894c8-ec33-47c5-ad49-251e13f93b71 None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:21.033462 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7894c8-ec33-47c5-ad49-251e13f93b71 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:21.033462 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7894c8-ec33-47c5-ad49-251e13f93b71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:21.054269 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 820/1625] 10.222.0.117 () {60 vars in 1157 bytes} [Tue Jan 25 02:35:20 2022] POST /identity/v3/projects => generated 380 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 02:35:21.054269 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e66e0b-f3cc-420c-bae2-7a7b30fba7b1 None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:21.054269 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e66e0b-f3cc-420c-bae2-7a7b30fba7b1 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:21.054269 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e66e0b-f3cc-420c-bae2-7a7b30fba7b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:21.056749 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-2c7894c8-ec33-47c5-ad49-251e13f93b71 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:35:21.058004 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-2c7894c8-ec33-47c5-ad49-251e13f93b71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:35:21.084540 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-61e66e0b-f3cc-420c-bae2-7a7b30fba7b1 None None] MFA Rules not processed for user `9283ac3af88a4b908355467a35b52871`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:35:21.086617 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-61e66e0b-f3cc-420c-bae2-7a7b30fba7b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:35:21.144168 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 806/1626] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:35:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:35:21.145066 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7894c8-ec33-47c5-ad49-251e13f93b71 None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:21.156504 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7894c8-ec33-47c5-ad49-251e13f93b71 None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:21.158095 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 821/1627] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:35:21 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:35:21.159548 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025c9290-feb1-4964-b5cd-3084d12b4cc0 None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:21.160134 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025c9290-feb1-4964-b5cd-3084d12b4cc0 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:21.160630 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025c9290-feb1-4964-b5cd-3084d12b4cc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:21.162636 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2559e131-bdf2-4d0a-8458-c2c120babe3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:21.163169 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2559e131-bdf2-4d0a-8458-c2c120babe3a admin admin] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:21.163459 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2559e131-bdf2-4d0a-8458-c2c120babe3a admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:21.164091 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2559e131-bdf2-4d0a-8458-c2c120babe3a admin admin] PATH_INFO: `/v3/projects` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:21.165101 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2559e131-bdf2-4d0a-8458-c2c120babe3a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:21.167072 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2559e131-bdf2-4d0a-8458-c2c120babe3a admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:21.188520 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-025c9290-feb1-4964-b5cd-3084d12b4cc0 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:35:21.190214 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-025c9290-feb1-4964-b5cd-3084d12b4cc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:35:21.206093 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 822/1628] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:35:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:35:21.206093 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeb1a0b-12ca-4748-95ad-cf4035ebd413 None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:21.206093 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeb1a0b-12ca-4748-95ad-cf4035ebd413 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:21.206093 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeb1a0b-12ca-4748-95ad-cf4035ebd413 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:21.207588 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 807/1629] 10.222.0.117 () {60 vars in 1157 bytes} [Tue Jan 25 02:35:21 2022] POST /identity/v3/projects => generated 372 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 02:35:21.208751 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2559e131-bdf2-4d0a-8458-c2c120babe3a admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:21.225030 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-5aeb1a0b-12ca-4748-95ad-cf4035ebd413 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:35:21.226928 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-5aeb1a0b-12ca-4748-95ad-cf4035ebd413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:35:21.283204 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2559e131-bdf2-4d0a-8458-c2c120babe3a admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:21.289749 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd43135-01d9-4d3e-8cb9-19ca7823ea44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:21.290518 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd43135-01d9-4d3e-8cb9-19ca7823ea44 admin admin] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:21.290847 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd43135-01d9-4d3e-8cb9-19ca7823ea44 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:21.291128 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd43135-01d9-4d3e-8cb9-19ca7823ea44 admin admin] PATH_INFO: `/v3/users` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:21.291886 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd43135-01d9-4d3e-8cb9-19ca7823ea44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:21.293849 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd43135-01d9-4d3e-8cb9-19ca7823ea44 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:21.294187 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 823/1630] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:35:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:35:21.295709 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aeb1a0b-12ca-4748-95ad-cf4035ebd413 None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:21.307286 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aeb1a0b-12ca-4748-95ad-cf4035ebd413 None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:21.316644 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82a94c1-b6d0-46db-8ddf-f5386f1ca654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:21.317991 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 808/1631] 10.222.0.117 () {60 vars in 1148 bytes} [Tue Jan 25 02:35:21 2022] POST /identity/v3/users => generated 291 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 02:35:21.318521 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82a94c1-b6d0-46db-8ddf-f5386f1ca654 admin admin] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:21.318830 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd43135-01d9-4d3e-8cb9-19ca7823ea44 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:21.319787 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82a94c1-b6d0-46db-8ddf-f5386f1ca654 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:21.321540 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-bfd43135-01d9-4d3e-8cb9-19ca7823ea44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:35:21.322833 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82a94c1-b6d0-46db-8ddf-f5386f1ca654 admin admin] PATH_INFO: `/v3/users` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:21.323929 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82a94c1-b6d0-46db-8ddf-f5386f1ca654 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:21.326157 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82a94c1-b6d0-46db-8ddf-f5386f1ca654 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:21.357418 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 824/1632] 10.222.0.117 () {60 vars in 1148 bytes} [Tue Jan 25 02:35:21 2022] POST /identity/v3/users => generated 297 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 02:35:21.358780 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2937d5e-4a8e-42c2-a9a1-b98a0969281f None None] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:21.358917 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2937d5e-4a8e-42c2-a9a1-b98a0969281f None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:21.359144 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2937d5e-4a8e-42c2-a9a1-b98a0969281f None None] PATH_INFO: `/` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:21.361191 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 825/1633] 10.222.0.117 () {54 vars in 966 bytes} [Tue Jan 25 02:35:21 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:35:21.362045 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2937d5e-4a8e-42c2-a9a1-b98a0969281f None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:21.381456 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2937d5e-4a8e-42c2-a9a1-b98a0969281f None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:21.390407 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a932b9d-412b-484b-a84e-2601b6ebdf03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:21.391905 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a932b9d-412b-484b-a84e-2601b6ebdf03 admin admin] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:21.392262 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a932b9d-412b-484b-a84e-2601b6ebdf03 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:21.392617 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a932b9d-412b-484b-a84e-2601b6ebdf03 admin admin] PATH_INFO: `/v3/users` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:21.393410 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a932b9d-412b-484b-a84e-2601b6ebdf03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:21.395354 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a932b9d-412b-484b-a84e-2601b6ebdf03 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:21.397517 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd43135-01d9-4d3e-8cb9-19ca7823ea44 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:21.402122 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c220235-bf78-47d6-aa88-6234352d80a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca4071c5f8f4a31b5edb81fa66a43a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:21.402858 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c220235-bf78-47d6-aa88-6234352d80a9 service neutron] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:21.403796 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c220235-bf78-47d6-aa88-6234352d80a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:21.404085 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c220235-bf78-47d6-aa88-6234352d80a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:21.414529 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c220235-bf78-47d6-aa88-6234352d80a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:21.415990 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c220235-bf78-47d6-aa88-6234352d80a9 service neutron] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:21.417190 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 826/1634] 10.222.0.117 () {60 vars in 1148 bytes} [Tue Jan 25 02:35:21 2022] POST /identity/v3/users => generated 293 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 02:35:21.418015 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a932b9d-412b-484b-a84e-2601b6ebdf03 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:21.428162 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 809/1635] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:35:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:35:21.429803 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c220235-bf78-47d6-aa88-6234352d80a9 service neutron] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:21.440212 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a932b9d-412b-484b-a84e-2601b6ebdf03 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:21.443188 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c220235-bf78-47d6-aa88-6234352d80a9 service neutron] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:21.450561 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f58fad-1fc4-4484-b258-b6fb7d8ac45c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca4071c5f8f4a31b5edb81fa66a43a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:21.450783 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a8df82-5af9-4f82-a3b0-99710f259d73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca4071c5f8f4a31b5edb81fa66a43a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:21.451222 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f58fad-1fc4-4484-b258-b6fb7d8ac45c service neutron] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:21.451550 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a8df82-5af9-4f82-a3b0-99710f259d73 service neutron] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:21.451666 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f58fad-1fc4-4484-b258-b6fb7d8ac45c service neutron] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:21.451917 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f58fad-1fc4-4484-b258-b6fb7d8ac45c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:21.452027 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a8df82-5af9-4f82-a3b0-99710f259d73 service neutron] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:21.452289 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a8df82-5af9-4f82-a3b0-99710f259d73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:21.463411 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a8df82-5af9-4f82-a3b0-99710f259d73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:21.464913 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a8df82-5af9-4f82-a3b0-99710f259d73 service neutron] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:21.466075 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f58fad-1fc4-4484-b258-b6fb7d8ac45c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:21.468261 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f58fad-1fc4-4484-b258-b6fb7d8ac45c service neutron] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:21.475962 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 827/1636] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:35:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:35:21.477358 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a8df82-5af9-4f82-a3b0-99710f259d73 service neutron] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:21.487197 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a8df82-5af9-4f82-a3b0-99710f259d73 service neutron] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:21.487986 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 810/1637] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:35:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:35:21.488885 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f58fad-1fc4-4484-b258-b6fb7d8ac45c service neutron] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:21.492884 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac211ec-0eb0-49df-a5a8-01d6c8ea5fd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:21.493715 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac211ec-0eb0-49df-a5a8-01d6c8ea5fd2 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:21.494006 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac211ec-0eb0-49df-a5a8-01d6c8ea5fd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:21.494281 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac211ec-0eb0-49df-a5a8-01d6c8ea5fd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:21.495076 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac211ec-0eb0-49df-a5a8-01d6c8ea5fd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:21.496754 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac211ec-0eb0-49df-a5a8-01d6c8ea5fd2 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:21.501598 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f58fad-1fc4-4484-b258-b6fb7d8ac45c service neutron] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:21.507968 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e637786-2469-4ed2-8e0b-bacb16a6d7e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:21.508648 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e637786-2469-4ed2-8e0b-bacb16a6d7e4 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:21.508934 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e637786-2469-4ed2-8e0b-bacb16a6d7e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:21.509263 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e637786-2469-4ed2-8e0b-bacb16a6d7e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:21.510005 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e637786-2469-4ed2-8e0b-bacb16a6d7e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:21.513747 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 828/1638] 10.222.0.117 () {58 vars in 1126 bytes} [Tue Jan 25 02:35:21 2022] GET /identity/v3/roles => generated 1427 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 02:35:21.513902 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e637786-2469-4ed2-8e0b-bacb16a6d7e4 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:21.513995 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd6d7a2-a6d9-4206-a5c5-5fbb8e83aaa9 None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:21.513995 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd6d7a2-a6d9-4206-a5c5-5fbb8e83aaa9 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:21.513995 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd6d7a2-a6d9-4206-a5c5-5fbb8e83aaa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:21.533659 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 811/1639] 10.222.0.117 () {58 vars in 1126 bytes} [Tue Jan 25 02:35:21 2022] GET /identity/v3/roles => generated 1427 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 02:35:21.534550 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e637786-2469-4ed2-8e0b-bacb16a6d7e4 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:21.541945 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-2dd6d7a2-a6d9-4206-a5c5-5fbb8e83aaa9 None None] MFA Rules not processed for user `d9ad6269900346458050063c12cac299`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:35:21.543281 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-2dd6d7a2-a6d9-4206-a5c5-5fbb8e83aaa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:35:21.548199 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e637786-2469-4ed2-8e0b-bacb16a6d7e4 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:21.557333 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0510c94-96b8-4b28-83ec-e089579c6840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:21.558374 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0510c94-96b8-4b28-83ec-e089579c6840 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:21.558872 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0510c94-96b8-4b28-83ec-e089579c6840 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:21.559405 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0510c94-96b8-4b28-83ec-e089579c6840 admin admin] PATH_INFO: `/v3/roles` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:21.561334 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0510c94-96b8-4b28-83ec-e089579c6840 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:21.562935 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0510c94-96b8-4b28-83ec-e089579c6840 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:21.579918 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 812/1640] 10.222.0.117 () {58 vars in 1126 bytes} [Tue Jan 25 02:35:21 2022] GET /identity/v3/roles => generated 1427 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 02:35:21.580833 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0510c94-96b8-4b28-83ec-e089579c6840 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:21.609051 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0510c94-96b8-4b28-83ec-e089579c6840 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:21.619263 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d00d7e-27d8-4246-b677-037feb453113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:21.620429 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d00d7e-27d8-4246-b677-037feb453113 admin admin] REQUEST_METHOD: `PUT` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:21.620721 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d00d7e-27d8-4246-b677-037feb453113 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:21.621052 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d00d7e-27d8-4246-b677-037feb453113 admin admin] PATH_INFO: `/v3/projects/78c41827a68f4f1e9864a0e8dbc16c95/users/febad9f52154498d9fb3d6bdd429ff36/roles/d8dbc6d83d9d41d28c3feb8b3485b291` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:21.642259 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d00d7e-27d8-4246-b677-037feb453113 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78c41827a68f4f1e9864a0e8dbc16c95, user_id=febad9f52154498d9fb3d6bdd429ff36, role_id=d8dbc6d83d9d41d28c3feb8b3485b291)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:21.645218 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d00d7e-27d8-4246-b677-037feb453113 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:21.647647 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 829/1641] 10.222.0.117 () {58 vars in 1063 bytes} [Tue Jan 25 02:35:21 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:35:21.648933 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd6d7a2-a6d9-4206-a5c5-5fbb8e83aaa9 None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:21.661115 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd6d7a2-a6d9-4206-a5c5-5fbb8e83aaa9 None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:21.666417 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 813/1642] 10.222.0.117 () {60 vars in 1487 bytes} [Tue Jan 25 02:35:21 2022] PUT /identity/v3/projects/78c41827a68f4f1e9864a0e8dbc16c95/users/febad9f52154498d9fb3d6bdd429ff36/roles/d8dbc6d83d9d41d28c3feb8b3485b291 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:35:21.669423 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d00d7e-27d8-4246-b677-037feb453113 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:21.727788 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d5d921-794a-4b14-86b0-83605e21d221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:21.728758 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d5d921-794a-4b14-86b0-83605e21d221 admin admin] REQUEST_METHOD: `PUT` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:21.729042 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d5d921-794a-4b14-86b0-83605e21d221 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:21.729366 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d5d921-794a-4b14-86b0-83605e21d221 admin admin] PATH_INFO: `/v3/projects/c9860c2b7c5e4e60bf5887bb3c101fa2/users/8f3f1442f5b4407b823548f35b672074/roles/d8dbc6d83d9d41d28c3feb8b3485b291` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:21.745532 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d5d921-794a-4b14-86b0-83605e21d221 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9860c2b7c5e4e60bf5887bb3c101fa2, user_id=8f3f1442f5b4407b823548f35b672074, role_id=d8dbc6d83d9d41d28c3feb8b3485b291)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:21.748315 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d5d921-794a-4b14-86b0-83605e21d221 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:21.764898 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d00d7e-27d8-4246-b677-037feb453113 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:21.765144 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 830/1643] 10.222.0.117 () {60 vars in 1487 bytes} [Tue Jan 25 02:35:21 2022] PUT /identity/v3/projects/c9860c2b7c5e4e60bf5887bb3c101fa2/users/8f3f1442f5b4407b823548f35b672074/roles/d8dbc6d83d9d41d28c3feb8b3485b291 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:35:21.769136 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d5d921-794a-4b14-86b0-83605e21d221 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:21.854962 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e3140d-ea25-4ad5-8724-e90d06d252b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:21.857790 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e3140d-ea25-4ad5-8724-e90d06d252b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:21.858522 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e3140d-ea25-4ad5-8724-e90d06d252b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:21.859010 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e3140d-ea25-4ad5-8724-e90d06d252b8 admin admin] PATH_INFO: `/v3/projects/52e1af3907ee4ffb8bd9123484067971/users/97db193dd38744feb8b9f49951fe115c/roles/d8dbc6d83d9d41d28c3feb8b3485b291` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:21.879043 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e3140d-ea25-4ad5-8724-e90d06d252b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52e1af3907ee4ffb8bd9123484067971, user_id=97db193dd38744feb8b9f49951fe115c, role_id=d8dbc6d83d9d41d28c3feb8b3485b291)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:21.882789 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e3140d-ea25-4ad5-8724-e90d06d252b8 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:21.900788 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d5d921-794a-4b14-86b0-83605e21d221 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:21.904166 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 814/1644] 10.222.0.117 () {60 vars in 1487 bytes} [Tue Jan 25 02:35:21 2022] PUT /identity/v3/projects/52e1af3907ee4ffb8bd9123484067971/users/97db193dd38744feb8b9f49951fe115c/roles/d8dbc6d83d9d41d28c3feb8b3485b291 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:35:21.905329 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e3140d-ea25-4ad5-8724-e90d06d252b8 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:21.982828 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e3140d-ea25-4ad5-8724-e90d06d252b8 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:21.997096 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbf6791-cdaf-4fe3-8f80-4ab7db38e801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:21.998115 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbf6791-cdaf-4fe3-8f80-4ab7db38e801 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:21.998602 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbf6791-cdaf-4fe3-8f80-4ab7db38e801 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:21.999091 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbf6791-cdaf-4fe3-8f80-4ab7db38e801 admin admin] PATH_INFO: `/v3/roles` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:22.000272 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbf6791-cdaf-4fe3-8f80-4ab7db38e801 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:22.002676 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbf6791-cdaf-4fe3-8f80-4ab7db38e801 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:22.020786 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 815/1645] 10.222.0.117 () {58 vars in 1126 bytes} [Tue Jan 25 02:35:21 2022] GET /identity/v3/roles => generated 1427 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 02:35:22.021730 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbf6791-cdaf-4fe3-8f80-4ab7db38e801 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:22.033982 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbf6791-cdaf-4fe3-8f80-4ab7db38e801 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:22.049094 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b69e2eb-4cc2-4522-a6e1-a6e7a7030cbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:22.049782 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b69e2eb-4cc2-4522-a6e1-a6e7a7030cbd admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:22.050116 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b69e2eb-4cc2-4522-a6e1-a6e7a7030cbd admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:22.050339 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b69e2eb-4cc2-4522-a6e1-a6e7a7030cbd admin admin] PATH_INFO: `/v3/roles` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:22.051094 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b69e2eb-4cc2-4522-a6e1-a6e7a7030cbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:22.052734 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b69e2eb-4cc2-4522-a6e1-a6e7a7030cbd admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:22.060511 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee54f68-2a83-4711-a68a-04244df1d52e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9ad6269900346458050063c12cac299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:22.061190 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee54f68-2a83-4711-a68a-04244df1d52e service nova] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:22.061475 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee54f68-2a83-4711-a68a-04244df1d52e service nova] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:22.061748 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee54f68-2a83-4711-a68a-04244df1d52e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:22.065286 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 816/1646] 10.222.0.117 () {58 vars in 1126 bytes} [Tue Jan 25 02:35:22 2022] GET /identity/v3/roles => generated 1427 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 02:35:22.066226 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b69e2eb-4cc2-4522-a6e1-a6e7a7030cbd admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:22.117474 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b69e2eb-4cc2-4522-a6e1-a6e7a7030cbd admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:22.136597 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da213a4d-dde5-4a4f-9877-089657b8bcbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:22.137284 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da213a4d-dde5-4a4f-9877-089657b8bcbd admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:22.137568 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da213a4d-dde5-4a4f-9877-089657b8bcbd admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:22.138085 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da213a4d-dde5-4a4f-9877-089657b8bcbd admin admin] PATH_INFO: `/v3/roles` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:22.139717 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da213a4d-dde5-4a4f-9877-089657b8bcbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:22.141514 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da213a4d-dde5-4a4f-9877-089657b8bcbd admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:22.169711 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 817/1647] 10.222.0.117 () {58 vars in 1126 bytes} [Tue Jan 25 02:35:22 2022] GET /identity/v3/roles => generated 1427 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 02:35:22.175984 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da213a4d-dde5-4a4f-9877-089657b8bcbd admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:22.189651 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee54f68-2a83-4711-a68a-04244df1d52e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:22.192972 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee54f68-2a83-4711-a68a-04244df1d52e service nova] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:22.203417 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da213a4d-dde5-4a4f-9877-089657b8bcbd admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:22.209066 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d328326-6d74-4123-aab8-4ffcb2df75f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:22.209917 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d328326-6d74-4123-aab8-4ffcb2df75f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:22.210101 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d328326-6d74-4123-aab8-4ffcb2df75f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:22.210517 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d328326-6d74-4123-aab8-4ffcb2df75f7 admin admin] PATH_INFO: `/v3/projects/78c41827a68f4f1e9864a0e8dbc16c95/users/febad9f52154498d9fb3d6bdd429ff36/roles/d8dbc6d83d9d41d28c3feb8b3485b291` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:22.217868 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 831/1648] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:35:21 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:35:22.218474 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee54f68-2a83-4711-a68a-04244df1d52e service nova] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:22.219804 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d328326-6d74-4123-aab8-4ffcb2df75f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78c41827a68f4f1e9864a0e8dbc16c95, user_id=febad9f52154498d9fb3d6bdd429ff36, role_id=d8dbc6d83d9d41d28c3feb8b3485b291)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:22.222936 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d328326-6d74-4123-aab8-4ffcb2df75f7 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:22.247982 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee54f68-2a83-4711-a68a-04244df1d52e service nova] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:22.249880 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 818/1649] 10.222.0.117 () {60 vars in 1487 bytes} [Tue Jan 25 02:35:22 2022] PUT /identity/v3/projects/78c41827a68f4f1e9864a0e8dbc16c95/users/febad9f52154498d9fb3d6bdd429ff36/roles/d8dbc6d83d9d41d28c3feb8b3485b291 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:35:22.250844 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d328326-6d74-4123-aab8-4ffcb2df75f7 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:22.375093 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b604a73-126d-42a4-a7d5-26a3c05a4c23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:22.376244 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b604a73-126d-42a4-a7d5-26a3c05a4c23 admin admin] REQUEST_METHOD: `PUT` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:22.376494 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b604a73-126d-42a4-a7d5-26a3c05a4c23 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:22.379274 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b604a73-126d-42a4-a7d5-26a3c05a4c23 admin admin] PATH_INFO: `/v3/projects/c9860c2b7c5e4e60bf5887bb3c101fa2/users/8f3f1442f5b4407b823548f35b672074/roles/d8dbc6d83d9d41d28c3feb8b3485b291` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:22.382930 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b604a73-126d-42a4-a7d5-26a3c05a4c23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9860c2b7c5e4e60bf5887bb3c101fa2, user_id=8f3f1442f5b4407b823548f35b672074, role_id=d8dbc6d83d9d41d28c3feb8b3485b291)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:22.387263 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b604a73-126d-42a4-a7d5-26a3c05a4c23 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:22.392837 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d328326-6d74-4123-aab8-4ffcb2df75f7 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:22.403900 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7a826d-31f3-401a-a2fe-36314324d946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:22.404965 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7a826d-31f3-401a-a2fe-36314324d946 admin admin] REQUEST_METHOD: `PUT` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:22.405258 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7a826d-31f3-401a-a2fe-36314324d946 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:22.405540 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7a826d-31f3-401a-a2fe-36314324d946 admin admin] PATH_INFO: `/v3/projects/52e1af3907ee4ffb8bd9123484067971/users/97db193dd38744feb8b9f49951fe115c/roles/d8dbc6d83d9d41d28c3feb8b3485b291` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:22.409197 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 832/1650] 10.222.0.117 () {60 vars in 1487 bytes} [Tue Jan 25 02:35:22 2022] PUT /identity/v3/projects/c9860c2b7c5e4e60bf5887bb3c101fa2/users/8f3f1442f5b4407b823548f35b672074/roles/d8dbc6d83d9d41d28c3feb8b3485b291 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:35:22.410301 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf57973-8cc6-4cae-a8a6-66e2d1d15695 None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:22.410591 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf57973-8cc6-4cae-a8a6-66e2d1d15695 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:22.410870 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf57973-8cc6-4cae-a8a6-66e2d1d15695 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:22.412922 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7a826d-31f3-401a-a2fe-36314324d946 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52e1af3907ee4ffb8bd9123484067971, user_id=97db193dd38744feb8b9f49951fe115c, role_id=d8dbc6d83d9d41d28c3feb8b3485b291)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:22.416659 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7a826d-31f3-401a-a2fe-36314324d946 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:22.447175 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 819/1651] 10.222.0.117 () {60 vars in 1487 bytes} [Tue Jan 25 02:35:22 2022] PUT /identity/v3/projects/52e1af3907ee4ffb8bd9123484067971/users/97db193dd38744feb8b9f49951fe115c/roles/d8dbc6d83d9d41d28c3feb8b3485b291 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:35:22.447175 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c971e3-afd6-4e32-aadb-cefbc1c6a904 None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:22.447175 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c971e3-afd6-4e32-aadb-cefbc1c6a904 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:22.447175 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c971e3-afd6-4e32-aadb-cefbc1c6a904 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:22.472341 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-bdf57973-8cc6-4cae-a8a6-66e2d1d15695 None None] MFA Rules not processed for user `febad9f52154498d9fb3d6bdd429ff36`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:35:22.472850 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-33c971e3-afd6-4e32-aadb-cefbc1c6a904 None None] MFA Rules not processed for user `8f3f1442f5b4407b823548f35b672074`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:35:22.473603 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-bdf57973-8cc6-4cae-a8a6-66e2d1d15695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:35:22.475459 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-33c971e3-afd6-4e32-aadb-cefbc1c6a904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:35:22.579213 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 820/1652] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:35:22 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:35:22.581528 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be39b20-9ee9-48db-8b42-3b2298aac595 None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:22.582274 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be39b20-9ee9-48db-8b42-3b2298aac595 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:22.582907 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be39b20-9ee9-48db-8b42-3b2298aac595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:22.614598 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 833/1653] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:35:22 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:35:22.616256 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d56d0d-7273-4366-bc7a-4cc32191f230 None None] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:22.616546 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d56d0d-7273-4366-bc7a-4cc32191f230 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:22.616857 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d56d0d-7273-4366-bc7a-4cc32191f230 None None] PATH_INFO: `/` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:22.622783 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 834/1654] 10.222.0.117 () {54 vars in 917 bytes} [Tue Jan 25 02:35:22 2022] GET /identity => generated 271 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:35:22.623858 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d56d0d-7273-4366-bc7a-4cc32191f230 None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:22.637294 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-6be39b20-9ee9-48db-8b42-3b2298aac595 None None] MFA Rules not processed for user `97db193dd38744feb8b9f49951fe115c`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:35:22.639338 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-6be39b20-9ee9-48db-8b42-3b2298aac595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:35:22.687769 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d56d0d-7273-4366-bc7a-4cc32191f230 None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:22.693178 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d4a7dc-3260-4c7e-9055-a6de4052bbd9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cc5249aea09430080e232cf17757f86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:22.694005 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d4a7dc-3260-4c7e-9055-a6de4052bbd9 service cinder] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:22.694453 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d4a7dc-3260-4c7e-9055-a6de4052bbd9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:22.694813 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d4a7dc-3260-4c7e-9055-a6de4052bbd9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:22.716366 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d4a7dc-3260-4c7e-9055-a6de4052bbd9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:22.720357 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d4a7dc-3260-4c7e-9055-a6de4052bbd9 service cinder] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:22.734859 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 835/1655] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:35:22 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:35:22.736272 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9842447-10e1-44f6-bc94-e3db7300b771 None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:22.736565 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9842447-10e1-44f6-bc94-e3db7300b771 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:22.737153 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9842447-10e1-44f6-bc94-e3db7300b771 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:22.744863 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 821/1656] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:35:22 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:35:22.746049 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be39b20-9ee9-48db-8b42-3b2298aac595 None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:22.758774 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be39b20-9ee9-48db-8b42-3b2298aac595 None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:22.763891 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c55605c-5445-4a43-90e5-3d11657420b6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cc5249aea09430080e232cf17757f86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:22.764899 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c55605c-5445-4a43-90e5-3d11657420b6 service cinder] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:22.765961 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c55605c-5445-4a43-90e5-3d11657420b6 service cinder] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:22.766538 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c55605c-5445-4a43-90e5-3d11657420b6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:22.775018 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-f9842447-10e1-44f6-bc94-e3db7300b771 None None] MFA Rules not processed for user `d9ad6269900346458050063c12cac299`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:35:22.777214 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-f9842447-10e1-44f6-bc94-e3db7300b771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:35:22.781177 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c55605c-5445-4a43-90e5-3d11657420b6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:22.782990 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c55605c-5445-4a43-90e5-3d11657420b6 service cinder] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:22.795547 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 822/1657] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:35:22 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:35:22.801678 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c55605c-5445-4a43-90e5-3d11657420b6 service cinder] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:22.813238 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c55605c-5445-4a43-90e5-3d11657420b6 service cinder] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:22.817765 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5202b9-daaa-4f5f-8198-72f27746075f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cc5249aea09430080e232cf17757f86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:22.819208 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5202b9-daaa-4f5f-8198-72f27746075f service cinder] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:22.819208 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5202b9-daaa-4f5f-8198-72f27746075f service cinder] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:22.819726 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5202b9-daaa-4f5f-8198-72f27746075f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:22.832950 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5202b9-daaa-4f5f-8198-72f27746075f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:22.835303 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5202b9-daaa-4f5f-8198-72f27746075f service cinder] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:22.847744 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 823/1658] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:35:22 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:35:22.916913 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 836/1659] 10.222.0.117 () {58 vars in 1014 bytes} [Tue Jan 25 02:35:22 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:35:22.946871 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5202b9-daaa-4f5f-8198-72f27746075f service cinder] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:22.956687 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5202b9-daaa-4f5f-8198-72f27746075f service cinder] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:22.970491 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1554c2-2517-437e-a6d3-d62703c30bd6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cc5249aea09430080e232cf17757f86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:22.971931 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1554c2-2517-437e-a6d3-d62703c30bd6 service cinder] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:22.971931 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1554c2-2517-437e-a6d3-d62703c30bd6 service cinder] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:22.972840 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1554c2-2517-437e-a6d3-d62703c30bd6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:22.993874 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9842447-10e1-44f6-bc94-e3db7300b771 None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:23.010124 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9842447-10e1-44f6-bc94-e3db7300b771 None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:23.022162 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fb009f-4d6e-4ef5-87db-1c0f81e9594f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cc5249aea09430080e232cf17757f86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:23.023227 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fb009f-4d6e-4ef5-87db-1c0f81e9594f service cinder] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:23.024204 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fb009f-4d6e-4ef5-87db-1c0f81e9594f service cinder] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:23.024659 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fb009f-4d6e-4ef5-87db-1c0f81e9594f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:23.057229 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fb009f-4d6e-4ef5-87db-1c0f81e9594f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:23.062723 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fb009f-4d6e-4ef5-87db-1c0f81e9594f service cinder] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:23.077172 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1554c2-2517-437e-a6d3-d62703c30bd6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:23.080143 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1554c2-2517-437e-a6d3-d62703c30bd6 service cinder] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:23.096354 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 837/1660] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:35:22 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 25 02:35:23.111423 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 824/1661] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:35:22 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:35:23.250205 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a390fbfa-5fc1-4025-9c3e-d2d1302e9e88 None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:23.251582 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a390fbfa-5fc1-4025-9c3e-d2d1302e9e88 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:23.251582 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a390fbfa-5fc1-4025-9c3e-d2d1302e9e88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:23.303397 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-a390fbfa-5fc1-4025-9c3e-d2d1302e9e88 None None] MFA Rules not processed for user `63855c1cdc7b46548312f2e14d99cfe1`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:35:23.306119 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-a390fbfa-5fc1-4025-9c3e-d2d1302e9e88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:35:23.459817 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 838/1662] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:35:23 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:35:23.472003 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf67e24-5f07-4dd7-a232-8785d13b3234 None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:23.472358 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf67e24-5f07-4dd7-a232-8785d13b3234 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:23.472615 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf67e24-5f07-4dd7-a232-8785d13b3234 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:23.511815 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-fdf67e24-5f07-4dd7-a232-8785d13b3234 None None] MFA Rules not processed for user `63855c1cdc7b46548312f2e14d99cfe1`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:35:23.513115 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-fdf67e24-5f07-4dd7-a232-8785d13b3234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:35:23.549607 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 825/1663] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:35:23 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:35:23.552336 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f35cfb-1b51-4ac3-9655-48d3d700fb35 None None] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:23.553099 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f35cfb-1b51-4ac3-9655-48d3d700fb35 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:23.553099 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f35cfb-1b51-4ac3-9655-48d3d700fb35 None None] PATH_INFO: `/` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:23.555454 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 839/1664] 10.222.0.117 () {54 vars in 966 bytes} [Tue Jan 25 02:35:23 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:35:23.570906 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f9c18d-903b-4774-a6cf-26d8324630b4 None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:23.571727 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f9c18d-903b-4774-a6cf-26d8324630b4 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:23.572043 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f9c18d-903b-4774-a6cf-26d8324630b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:23.609245 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-22f9c18d-903b-4774-a6cf-26d8324630b4 None None] MFA Rules not processed for user `d9ad6269900346458050063c12cac299`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:35:23.610666 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-22f9c18d-903b-4774-a6cf-26d8324630b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:35:23.625150 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 826/1665] 10.222.0.117 () {58 vars in 1063 bytes} [Tue Jan 25 02:35:23 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:35:23.637122 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f35cfb-1b51-4ac3-9655-48d3d700fb35 None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:23.655861 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f35cfb-1b51-4ac3-9655-48d3d700fb35 None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:23.663456 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39ee0ff-11ab-47f1-818a-e49f335b8211 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9ad6269900346458050063c12cac299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:23.677484 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39ee0ff-11ab-47f1-818a-e49f335b8211 service nova] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:23.677484 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39ee0ff-11ab-47f1-818a-e49f335b8211 service nova] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:23.677484 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39ee0ff-11ab-47f1-818a-e49f335b8211 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:23.698381 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39ee0ff-11ab-47f1-818a-e49f335b8211 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:23.718957 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39ee0ff-11ab-47f1-818a-e49f335b8211 service nova] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:23.744049 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 840/1666] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:35:23 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:35:23.761297 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0d573a-6739-4b57-be94-6e8d2f4e573b None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:23.762074 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0d573a-6739-4b57-be94-6e8d2f4e573b None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:23.762587 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0d573a-6739-4b57-be94-6e8d2f4e573b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:23.822422 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-0b0d573a-6739-4b57-be94-6e8d2f4e573b None None] MFA Rules not processed for user `6ae7d43612964e46947d52e67a4725ff`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:35:23.824140 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-0b0d573a-6739-4b57-be94-6e8d2f4e573b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:35:23.968564 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 827/1667] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:35:23 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 25 02:35:23.981729 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba3fc17-e02c-4fb7-80e0-704dc8918ada None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:23.982340 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba3fc17-e02c-4fb7-80e0-704dc8918ada None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:23.982564 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba3fc17-e02c-4fb7-80e0-704dc8918ada None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:24.018741 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-dba3fc17-e02c-4fb7-80e0-704dc8918ada None None] MFA Rules not processed for user `6ae7d43612964e46947d52e67a4725ff`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:35:24.021821 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-dba3fc17-e02c-4fb7-80e0-704dc8918ada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:35:24.047899 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 841/1668] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:35:23 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:35:24.186058 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0d573a-6739-4b57-be94-6e8d2f4e573b None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:24.200825 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0d573a-6739-4b57-be94-6e8d2f4e573b None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:24.214571 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42ad3a8-8c64-43e2-b55e-d167aba6c34a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cc5249aea09430080e232cf17757f86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:24.215238 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42ad3a8-8c64-43e2-b55e-d167aba6c34a service cinder] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:24.215452 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42ad3a8-8c64-43e2-b55e-d167aba6c34a service cinder] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:24.215883 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42ad3a8-8c64-43e2-b55e-d167aba6c34a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:24.314895 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42ad3a8-8c64-43e2-b55e-d167aba6c34a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:24.316409 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42ad3a8-8c64-43e2-b55e-d167aba6c34a service cinder] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:24.347460 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 828/1669] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:35:24 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:35:24.373009 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba3fc17-e02c-4fb7-80e0-704dc8918ada None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:24.376932 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f302a295-000d-481f-9a59-6efcca48a7a3 None None] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:24.377225 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f302a295-000d-481f-9a59-6efcca48a7a3 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:24.377558 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f302a295-000d-481f-9a59-6efcca48a7a3 None None] PATH_INFO: `/` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:24.380295 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 829/1670] 10.222.0.117 () {54 vars in 917 bytes} [Tue Jan 25 02:35:24 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:35:24.389806 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47486f27-e29b-45cd-9f9e-0bf8ee5653b0 None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:24.390107 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47486f27-e29b-45cd-9f9e-0bf8ee5653b0 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:24.390448 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47486f27-e29b-45cd-9f9e-0bf8ee5653b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:24.410286 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba3fc17-e02c-4fb7-80e0-704dc8918ada None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:24.434961 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08001f64-2054-4379-a1e1-fc2b17e80384 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9ad6269900346458050063c12cac299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:24.435856 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08001f64-2054-4379-a1e1-fc2b17e80384 service nova] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:24.436146 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08001f64-2054-4379-a1e1-fc2b17e80384 service nova] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:24.436429 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08001f64-2054-4379-a1e1-fc2b17e80384 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:24.447166 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-47486f27-e29b-45cd-9f9e-0bf8ee5653b0 None None] MFA Rules not processed for user `d9ad6269900346458050063c12cac299`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:35:24.452223 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-47486f27-e29b-45cd-9f9e-0bf8ee5653b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:35:24.463635 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08001f64-2054-4379-a1e1-fc2b17e80384 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:24.467494 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08001f64-2054-4379-a1e1-fc2b17e80384 service nova] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:24.487950 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 830/1671] 10.222.0.117 () {58 vars in 1014 bytes} [Tue Jan 25 02:35:24 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:35:24.501303 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47486f27-e29b-45cd-9f9e-0bf8ee5653b0 None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:24.506784 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-47486f27-e29b-45cd-9f9e-0bf8ee5653b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:35:24.512655 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 842/1672] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:35:24 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:35:24.665041 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47486f27-e29b-45cd-9f9e-0bf8ee5653b0 None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:24.683667 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c5eb28-48af-4f4b-b3d2-deac656c112c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db3663416137459d9da4a71032505b0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:24.684421 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c5eb28-48af-4f4b-b3d2-deac656c112c service glance] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:24.684709 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c5eb28-48af-4f4b-b3d2-deac656c112c service glance] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:24.684986 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c5eb28-48af-4f4b-b3d2-deac656c112c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:24.724923 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c5eb28-48af-4f4b-b3d2-deac656c112c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:24.736734 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c5eb28-48af-4f4b-b3d2-deac656c112c service glance] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:24.791976 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 831/1673] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:35:24 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:35:25.145214 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08001f64-2054-4379-a1e1-fc2b17e80384 service nova] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:25.262729 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08001f64-2054-4379-a1e1-fc2b17e80384 service nova] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:25.274002 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f7eec6-f8c3-4013-bf25-f18f89330ef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:25.275082 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f7eec6-f8c3-4013-bf25-f18f89330ef9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:25.275429 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f7eec6-f8c3-4013-bf25-f18f89330ef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:25.275806 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f7eec6-f8c3-4013-bf25-f18f89330ef9 admin admin] PATH_INFO: `/v3/users/923c0bf7a63345b78438dc2836f678b2` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:25.277195 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f7eec6-f8c3-4013-bf25-f18f89330ef9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=923c0bf7a63345b78438dc2836f678b2)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:25.278727 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: WARNING py.warnings [None req-b5f7eec6-f8c3-4013-bf25-f18f89330ef9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 25 02:35:25.278727 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: warnings.warn(msg) Jan 25 02:35:25.278727 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: Jan 25 02:35:25.280278 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f7eec6-f8c3-4013-bf25-f18f89330ef9 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:25.387931 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-b5f7eec6-f8c3-4013-bf25-f18f89330ef9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '923c0bf7a63345b78438dc2836f678b2'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:35:25.388884 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-b5f7eec6-f8c3-4013-bf25-f18f89330ef9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '923c0bf7a63345b78438dc2836f678b2'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:35:25.415596 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-b5f7eec6-f8c3-4013-bf25-f18f89330ef9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '923c0bf7a63345b78438dc2836f678b2'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:35:25.418468 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-b5f7eec6-f8c3-4013-bf25-f18f89330ef9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '923c0bf7a63345b78438dc2836f678b2'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:35:25.434876 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-b5f7eec6-f8c3-4013-bf25-f18f89330ef9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '923c0bf7a63345b78438dc2836f678b2'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:35:25.477254 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 843/1674] 10.222.0.117 () {58 vars in 1228 bytes} [Tue Jan 25 02:35:25 2022] DELETE /identity/v3/users/923c0bf7a63345b78438dc2836f678b2 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:35:25.481989 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1298c91-e762-40e0-9b2b-6c19b83afc0e None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:25.482548 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1298c91-e762-40e0-9b2b-6c19b83afc0e None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:25.482548 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1298c91-e762-40e0-9b2b-6c19b83afc0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:25.590408 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b010845f-a049-4e3b-ba10-561a38973f59 None None] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:25.590408 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b010845f-a049-4e3b-ba10-561a38973f59 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:25.590408 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b010845f-a049-4e3b-ba10-561a38973f59 None None] PATH_INFO: `/` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:25.590408 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 844/1675] 10.222.0.117 () {54 vars in 917 bytes} [Tue Jan 25 02:35:25 2022] GET /identity => generated 271 bytes in 21 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:35:25.590408 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e1cb7e-a397-4895-bb0a-8bed77a73545 None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:25.590408 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e1cb7e-a397-4895-bb0a-8bed77a73545 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:25.591151 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e1cb7e-a397-4895-bb0a-8bed77a73545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:25.591379 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-d1298c91-e762-40e0-9b2b-6c19b83afc0e None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:35:25.591379 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-d1298c91-e762-40e0-9b2b-6c19b83afc0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:35:25.651516 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-73e1cb7e-a397-4895-bb0a-8bed77a73545 None None] MFA Rules not processed for user `9ca4071c5f8f4a31b5edb81fa66a43a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:35:25.658515 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-73e1cb7e-a397-4895-bb0a-8bed77a73545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:35:25.743789 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 832/1676] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:35:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:35:25.743789 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2853b97b-10c3-4d2f-a45b-255251b9c3b3 None None] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:25.743789 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2853b97b-10c3-4d2f-a45b-255251b9c3b3 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:25.744222 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2853b97b-10c3-4d2f-a45b-255251b9c3b3 None None] PATH_INFO: `/` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:25.745995 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 833/1677] 10.222.0.117 () {54 vars in 917 bytes} [Tue Jan 25 02:35:25 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:35:25.751786 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89be9f9a-9479-401b-b9e7-54ac65d3d97b None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:25.752081 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89be9f9a-9479-401b-b9e7-54ac65d3d97b None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:25.752364 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89be9f9a-9479-401b-b9e7-54ac65d3d97b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:25.781099 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-89be9f9a-9479-401b-b9e7-54ac65d3d97b None None] MFA Rules not processed for user `9ca4071c5f8f4a31b5edb81fa66a43a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:35:25.782418 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-89be9f9a-9479-401b-b9e7-54ac65d3d97b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:35:25.854126 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 834/1678] 10.222.0.117 () {58 vars in 1014 bytes} [Tue Jan 25 02:35:25 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 25 02:35:25.855003 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89be9f9a-9479-401b-b9e7-54ac65d3d97b None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:25.856384 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-89be9f9a-9479-401b-b9e7-54ac65d3d97b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:35:25.867219 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89be9f9a-9479-401b-b9e7-54ac65d3d97b None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:25.869576 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 845/1679] 10.222.0.117 () {58 vars in 1014 bytes} [Tue Jan 25 02:35:25 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:35:25.871814 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a958c3-ff26-4708-b4c5-61981a05a2b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca4071c5f8f4a31b5edb81fa66a43a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:25.872521 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a958c3-ff26-4708-b4c5-61981a05a2b3 service neutron] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:25.872808 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a958c3-ff26-4708-b4c5-61981a05a2b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:25.873084 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a958c3-ff26-4708-b4c5-61981a05a2b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:25.883553 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a958c3-ff26-4708-b4c5-61981a05a2b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:25.885128 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a958c3-ff26-4708-b4c5-61981a05a2b3 service neutron] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:25.897445 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 835/1680] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:35:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:35:25.898945 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e1cb7e-a397-4895-bb0a-8bed77a73545 None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:25.900873 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-73e1cb7e-a397-4895-bb0a-8bed77a73545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:35:25.901952 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a958c3-ff26-4708-b4c5-61981a05a2b3 service neutron] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:25.917187 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e1cb7e-a397-4895-bb0a-8bed77a73545 None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:25.923749 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a958c3-ff26-4708-b4c5-61981a05a2b3 service neutron] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:25.928656 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955a2b61-2e62-47ce-8187-b3f1c6306a6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca4071c5f8f4a31b5edb81fa66a43a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:25.929837 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955a2b61-2e62-47ce-8187-b3f1c6306a6e service neutron] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:25.930228 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955a2b61-2e62-47ce-8187-b3f1c6306a6e service neutron] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:25.930548 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955a2b61-2e62-47ce-8187-b3f1c6306a6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:25.933337 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58b36b1-79f0-411f-9393-87f4a8f4649d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca4071c5f8f4a31b5edb81fa66a43a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:25.934002 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58b36b1-79f0-411f-9393-87f4a8f4649d service neutron] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:25.934291 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58b36b1-79f0-411f-9393-87f4a8f4649d service neutron] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:25.934575 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58b36b1-79f0-411f-9393-87f4a8f4649d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:25.949164 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955a2b61-2e62-47ce-8187-b3f1c6306a6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:25.950546 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955a2b61-2e62-47ce-8187-b3f1c6306a6e service neutron] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:25.954596 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58b36b1-79f0-411f-9393-87f4a8f4649d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:25.956592 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58b36b1-79f0-411f-9393-87f4a8f4649d service neutron] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:25.971562 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 846/1681] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:35:25 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 25 02:35:25.972459 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 836/1682] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:35:25 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:35:27.100509 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955a2b61-2e62-47ce-8187-b3f1c6306a6e service neutron] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:27.101924 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-955a2b61-2e62-47ce-8187-b3f1c6306a6e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:35:27.300923 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955a2b61-2e62-47ce-8187-b3f1c6306a6e service neutron] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:27.323617 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc972822-a72c-4d20-9f7d-c8c31be6d748 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '890151a6bf2840f0a0a00f45dd2d38a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:27.324751 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df891b55-f7d5-404c-bfa4-5f6bb1558d95 None None] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:27.325304 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df891b55-f7d5-404c-bfa4-5f6bb1558d95 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:27.325304 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df891b55-f7d5-404c-bfa4-5f6bb1558d95 None None] PATH_INFO: `/` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:27.327471 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 837/1683] 10.222.0.117 () {54 vars in 965 bytes} [Tue Jan 25 02:35:27 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jan 25 02:35:27.384706 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc972822-a72c-4d20-9f7d-c8c31be6d748 service placement] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:27.386904 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc972822-a72c-4d20-9f7d-c8c31be6d748 service placement] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:27.387314 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc972822-a72c-4d20-9f7d-c8c31be6d748 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:27.395884 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da579d71-32a4-4cfe-8d9f-3e9467167589 None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:27.396616 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da579d71-32a4-4cfe-8d9f-3e9467167589 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:27.397072 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da579d71-32a4-4cfe-8d9f-3e9467167589 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:27.398401 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-dc972822-a72c-4d20-9f7d-c8c31be6d748 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:35:27.441072 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc972822-a72c-4d20-9f7d-c8c31be6d748 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:27.441759 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-da579d71-32a4-4cfe-8d9f-3e9467167589 None None] MFA Rules not processed for user `890151a6bf2840f0a0a00f45dd2d38a4`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:35:27.442995 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc972822-a72c-4d20-9f7d-c8c31be6d748 service placement] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:27.443527 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-da579d71-32a4-4cfe-8d9f-3e9467167589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:35:27.466015 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 838/1684] 10.222.0.117 () {58 vars in 1062 bytes} [Tue Jan 25 02:35:27 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:35:27.466783 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 847/1685] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:35:27 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:35:27.472982 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da579d71-32a4-4cfe-8d9f-3e9467167589 None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:27.515058 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da579d71-32a4-4cfe-8d9f-3e9467167589 None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:27.552387 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9dd545-c08f-4b13-917a-795e4339b807 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '890151a6bf2840f0a0a00f45dd2d38a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:27.553310 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9dd545-c08f-4b13-917a-795e4339b807 service placement] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:27.554732 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9dd545-c08f-4b13-917a-795e4339b807 service placement] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:27.558451 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9dd545-c08f-4b13-917a-795e4339b807 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:27.608664 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9dd545-c08f-4b13-917a-795e4339b807 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:27.610540 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9dd545-c08f-4b13-917a-795e4339b807 service placement] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:27.663947 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 839/1686] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:35:27 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:35:27.730366 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc972822-a72c-4d20-9f7d-c8c31be6d748 service placement] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:27.731868 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-dc972822-a72c-4d20-9f7d-c8c31be6d748 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:35:27.768497 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc972822-a72c-4d20-9f7d-c8c31be6d748 service placement] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:27.782766 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012d73c5-a339-43e4-8ce5-7d5e516aa846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:27.783873 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012d73c5-a339-43e4-8ce5-7d5e516aa846 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:27.784315 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012d73c5-a339-43e4-8ce5-7d5e516aa846 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:27.784600 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012d73c5-a339-43e4-8ce5-7d5e516aa846 admin admin] PATH_INFO: `/v3/projects/a9d5550476224f8593125e43a115ad18` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:27.790631 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012d73c5-a339-43e4-8ce5-7d5e516aa846 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9d5550476224f8593125e43a115ad18)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:27.800739 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012d73c5-a339-43e4-8ce5-7d5e516aa846 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:28.033876 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-012d73c5-a339-43e4-8ce5-7d5e516aa846 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9d5550476224f8593125e43a115ad18', 'request_id': 'req-012d73c5-a339-43e4-8ce5-7d5e516aa846'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:35:28.061363 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-012d73c5-a339-43e4-8ce5-7d5e516aa846 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9d5550476224f8593125e43a115ad18', 'request_id': 'req-012d73c5-a339-43e4-8ce5-7d5e516aa846'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:35:28.102047 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-012d73c5-a339-43e4-8ce5-7d5e516aa846 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9d5550476224f8593125e43a115ad18', 'request_id': 'req-012d73c5-a339-43e4-8ce5-7d5e516aa846'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:35:28.136295 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-012d73c5-a339-43e4-8ce5-7d5e516aa846 admin admin] The token cache is being invalidate because project a9d5550476224f8593125e43a115ad18 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79121) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 25 02:35:28.138940 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-012d73c5-a339-43e4-8ce5-7d5e516aa846 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:35:28.140178 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-012d73c5-a339-43e4-8ce5-7d5e516aa846 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:35:28.159248 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 848/1687] 10.222.0.117 () {58 vars in 1237 bytes} [Tue Jan 25 02:35:27 2022] DELETE /identity/v3/projects/a9d5550476224f8593125e43a115ad18 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:35:28.163423 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9dd545-c08f-4b13-917a-795e4339b807 service placement] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:28.186656 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9dd545-c08f-4b13-917a-795e4339b807 service placement] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:28.324830 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7200b83-2c0c-477c-a909-c39cc8abae17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:28.325392 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7200b83-2c0c-477c-a909-c39cc8abae17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:28.325653 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7200b83-2c0c-477c-a909-c39cc8abae17 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:28.326114 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7200b83-2c0c-477c-a909-c39cc8abae17 admin admin] PATH_INFO: `/v3/users/97db193dd38744feb8b9f49951fe115c` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:28.328478 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7200b83-2c0c-477c-a909-c39cc8abae17 admin admin] RBAC: Authorizing `identity:delete_user(user_id=97db193dd38744feb8b9f49951fe115c)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:28.335154 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7200b83-2c0c-477c-a909-c39cc8abae17 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:28.452637 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-f7200b83-2c0c-477c-a909-c39cc8abae17 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97db193dd38744feb8b9f49951fe115c'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:35:28.467660 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-f7200b83-2c0c-477c-a909-c39cc8abae17 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97db193dd38744feb8b9f49951fe115c'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:35:28.468846 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-f7200b83-2c0c-477c-a909-c39cc8abae17 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97db193dd38744feb8b9f49951fe115c'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:35:28.470124 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-f7200b83-2c0c-477c-a909-c39cc8abae17 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97db193dd38744feb8b9f49951fe115c'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:35:28.508136 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-f7200b83-2c0c-477c-a909-c39cc8abae17 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97db193dd38744feb8b9f49951fe115c'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:35:28.575748 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 840/1688] 10.222.0.117 () {58 vars in 1228 bytes} [Tue Jan 25 02:35:28 2022] DELETE /identity/v3/users/97db193dd38744feb8b9f49951fe115c => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:35:29.401901 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012d73c5-a339-43e4-8ce5-7d5e516aa846 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:29.403577 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-012d73c5-a339-43e4-8ce5-7d5e516aa846 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:35:29.429513 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012d73c5-a339-43e4-8ce5-7d5e516aa846 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:29.559077 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc16fea-fedc-4969-bb28-956998ed5d87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:29.560812 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc16fea-fedc-4969-bb28-956998ed5d87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:29.561279 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc16fea-fedc-4969-bb28-956998ed5d87 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:29.561757 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc16fea-fedc-4969-bb28-956998ed5d87 admin admin] PATH_INFO: `/v3/users/c62106d6fef2410fa97b840a91bb8db8` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:29.563400 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc16fea-fedc-4969-bb28-956998ed5d87 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c62106d6fef2410fa97b840a91bb8db8)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:29.565715 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc16fea-fedc-4969-bb28-956998ed5d87 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:29.659842 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-adc16fea-fedc-4969-bb28-956998ed5d87 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c62106d6fef2410fa97b840a91bb8db8'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:35:29.667576 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-adc16fea-fedc-4969-bb28-956998ed5d87 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c62106d6fef2410fa97b840a91bb8db8'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:35:29.690184 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-adc16fea-fedc-4969-bb28-956998ed5d87 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c62106d6fef2410fa97b840a91bb8db8'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:35:29.691410 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-adc16fea-fedc-4969-bb28-956998ed5d87 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c62106d6fef2410fa97b840a91bb8db8'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:35:29.706770 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-adc16fea-fedc-4969-bb28-956998ed5d87 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c62106d6fef2410fa97b840a91bb8db8'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:35:29.744137 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdfdb08-dc1f-43a3-9c97-052cd00367cd None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:29.744644 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdfdb08-dc1f-43a3-9c97-052cd00367cd None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:29.744750 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdfdb08-dc1f-43a3-9c97-052cd00367cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:29.780079 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 849/1689] 10.222.0.117 () {58 vars in 1228 bytes} [Tue Jan 25 02:35:29 2022] DELETE /identity/v3/users/c62106d6fef2410fa97b840a91bb8db8 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:35:29.784127 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-ebdfdb08-dc1f-43a3-9c97-052cd00367cd None None] MFA Rules not processed for user `ee5b954a34da4c95aab352015a7c551c`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:35:29.785358 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300f96bd-39a7-45af-bfc3-995fd90260b7 None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:29.785651 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300f96bd-39a7-45af-bfc3-995fd90260b7 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:29.785928 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300f96bd-39a7-45af-bfc3-995fd90260b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:29.786468 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-ebdfdb08-dc1f-43a3-9c97-052cd00367cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:35:29.830681 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-300f96bd-39a7-45af-bfc3-995fd90260b7 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:35:29.836725 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-300f96bd-39a7-45af-bfc3-995fd90260b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:35:29.909961 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 841/1690] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:35:29 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 25 02:35:29.921402 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fcebf1-e56e-49c0-9fc8-60cc9aa4f19c None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:29.922416 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fcebf1-e56e-49c0-9fc8-60cc9aa4f19c None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:29.922851 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fcebf1-e56e-49c0-9fc8-60cc9aa4f19c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:29.945157 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-38fcebf1-e56e-49c0-9fc8-60cc9aa4f19c None None] MFA Rules not processed for user `ee5b954a34da4c95aab352015a7c551c`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:35:29.946652 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-38fcebf1-e56e-49c0-9fc8-60cc9aa4f19c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:35:29.979483 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 842/1691] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:35:29 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:35:29.995572 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 850/1692] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:35:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:35:30.010925 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fcebf1-e56e-49c0-9fc8-60cc9aa4f19c None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:30.013353 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-38fcebf1-e56e-49c0-9fc8-60cc9aa4f19c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:35:30.034803 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300f96bd-39a7-45af-bfc3-995fd90260b7 None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:30.037029 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-300f96bd-39a7-45af-bfc3-995fd90260b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:35:30.057101 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300f96bd-39a7-45af-bfc3-995fd90260b7 None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:30.074421 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d77bb3a-7a86-4732-95c2-1b2cdd15a5f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:30.074421 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d77bb3a-7a86-4732-95c2-1b2cdd15a5f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:30.074421 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d77bb3a-7a86-4732-95c2-1b2cdd15a5f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:30.074421 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d77bb3a-7a86-4732-95c2-1b2cdd15a5f4 admin admin] PATH_INFO: `/v3/projects/52e1af3907ee4ffb8bd9123484067971` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:30.076438 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d77bb3a-7a86-4732-95c2-1b2cdd15a5f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=52e1af3907ee4ffb8bd9123484067971)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:30.087775 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d77bb3a-7a86-4732-95c2-1b2cdd15a5f4 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:30.098631 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fcebf1-e56e-49c0-9fc8-60cc9aa4f19c None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:30.103275 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0622baaf-3abc-45e2-8657-af68e10d4c9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca4071c5f8f4a31b5edb81fa66a43a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:30.104194 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0622baaf-3abc-45e2-8657-af68e10d4c9f service neutron] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:30.104698 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0622baaf-3abc-45e2-8657-af68e10d4c9f service neutron] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:30.105142 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0622baaf-3abc-45e2-8657-af68e10d4c9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:30.123684 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0622baaf-3abc-45e2-8657-af68e10d4c9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:30.125301 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0622baaf-3abc-45e2-8657-af68e10d4c9f service neutron] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:30.145095 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 843/1693] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:35:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:35:30.152838 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-9d77bb3a-7a86-4732-95c2-1b2cdd15a5f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52e1af3907ee4ffb8bd9123484067971', 'request_id': 'req-9d77bb3a-7a86-4732-95c2-1b2cdd15a5f4'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:35:30.159829 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-9d77bb3a-7a86-4732-95c2-1b2cdd15a5f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52e1af3907ee4ffb8bd9123484067971', 'request_id': 'req-9d77bb3a-7a86-4732-95c2-1b2cdd15a5f4'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:35:30.170575 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-9d77bb3a-7a86-4732-95c2-1b2cdd15a5f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52e1af3907ee4ffb8bd9123484067971', 'request_id': 'req-9d77bb3a-7a86-4732-95c2-1b2cdd15a5f4'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:35:30.204674 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-9d77bb3a-7a86-4732-95c2-1b2cdd15a5f4 admin admin] The token cache is being invalidate because project 52e1af3907ee4ffb8bd9123484067971 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79121) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 25 02:35:30.205109 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-9d77bb3a-7a86-4732-95c2-1b2cdd15a5f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:35:30.206207 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-9d77bb3a-7a86-4732-95c2-1b2cdd15a5f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:35:30.215815 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 851/1694] 10.222.0.117 () {58 vars in 1237 bytes} [Tue Jan 25 02:35:30 2022] DELETE /identity/v3/projects/52e1af3907ee4ffb8bd9123484067971 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:35:30.217651 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245b8dab-99f7-4c22-bee0-c5a8ccc8afb4 None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:30.217883 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245b8dab-99f7-4c22-bee0-c5a8ccc8afb4 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:30.218347 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245b8dab-99f7-4c22-bee0-c5a8ccc8afb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:30.237741 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-245b8dab-99f7-4c22-bee0-c5a8ccc8afb4 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:35:30.239237 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-245b8dab-99f7-4c22-bee0-c5a8ccc8afb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:35:30.294373 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d77bb3a-7a86-4732-95c2-1b2cdd15a5f4 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:30.296201 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-9d77bb3a-7a86-4732-95c2-1b2cdd15a5f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:35:30.330887 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 844/1695] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:35:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:35:30.341101 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ca898b-1f87-4ed3-a040-a2cdda67d8c5 None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:30.341699 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ca898b-1f87-4ed3-a040-a2cdda67d8c5 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:30.342216 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ca898b-1f87-4ed3-a040-a2cdda67d8c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:30.367456 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-24ca898b-1f87-4ed3-a040-a2cdda67d8c5 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:35:30.369111 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-24ca898b-1f87-4ed3-a040-a2cdda67d8c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:35:30.383628 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 845/1696] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:35:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:35:30.384986 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ca898b-1f87-4ed3-a040-a2cdda67d8c5 None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:30.394592 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ca898b-1f87-4ed3-a040-a2cdda67d8c5 None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:30.408301 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a28730-c54a-44bd-bef2-73a46b3ac4a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:30.409157 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a28730-c54a-44bd-bef2-73a46b3ac4a6 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:30.409578 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a28730-c54a-44bd-bef2-73a46b3ac4a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:30.410093 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a28730-c54a-44bd-bef2-73a46b3ac4a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:30.410963 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a28730-c54a-44bd-bef2-73a46b3ac4a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:35:30.411407 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a28730-c54a-44bd-bef2-73a46b3ac4a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:30.413233 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a28730-c54a-44bd-bef2-73a46b3ac4a6 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:30.420777 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d77bb3a-7a86-4732-95c2-1b2cdd15a5f4 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:30.441093 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5f2473-a7b7-4965-86dd-a933255f4954 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9ad6269900346458050063c12cac299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:30.441939 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5f2473-a7b7-4965-86dd-a933255f4954 service nova] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:30.442340 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5f2473-a7b7-4965-86dd-a933255f4954 service nova] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:30.442737 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5f2473-a7b7-4965-86dd-a933255f4954 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:30.446259 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-2b5f2473-a7b7-4965-86dd-a933255f4954 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:35:30.454121 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 846/1697] 10.222.0.117 () {58 vars in 1157 bytes} [Tue Jan 25 02:35:30 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:35:30.456757 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a28730-c54a-44bd-bef2-73a46b3ac4a6 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:30.487764 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a28730-c54a-44bd-bef2-73a46b3ac4a6 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:30.504547 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b411492f-1098-4860-88b3-0aaf22bb889a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:30.505454 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b411492f-1098-4860-88b3-0aaf22bb889a admin admin] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:30.506010 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b411492f-1098-4860-88b3-0aaf22bb889a admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:30.506572 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b411492f-1098-4860-88b3-0aaf22bb889a admin admin] PATH_INFO: `/v3/projects` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:30.507855 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b411492f-1098-4860-88b3-0aaf22bb889a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:30.512518 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b411492f-1098-4860-88b3-0aaf22bb889a admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:30.576064 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 847/1698] 10.222.0.117 () {60 vars in 1157 bytes} [Tue Jan 25 02:35:30 2022] POST /identity/v3/projects => generated 386 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 02:35:30.577543 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b411492f-1098-4860-88b3-0aaf22bb889a admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:30.589800 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5f2473-a7b7-4965-86dd-a933255f4954 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:30.592137 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5f2473-a7b7-4965-86dd-a933255f4954 service nova] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:30.608987 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 852/1699] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:35:30 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 25 02:35:30.674369 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b411492f-1098-4860-88b3-0aaf22bb889a admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:30.684009 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bc0675-4c5f-4ba4-beee-f1717cfea141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:30.684961 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bc0675-4c5f-4ba4-beee-f1717cfea141 admin admin] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:30.685419 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bc0675-4c5f-4ba4-beee-f1717cfea141 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:30.685851 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bc0675-4c5f-4ba4-beee-f1717cfea141 admin admin] PATH_INFO: `/v3/users` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:30.686748 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bc0675-4c5f-4ba4-beee-f1717cfea141 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:30.689269 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bc0675-4c5f-4ba4-beee-f1717cfea141 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:30.722496 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 848/1700] 10.222.0.117 () {60 vars in 1148 bytes} [Tue Jan 25 02:35:30 2022] POST /identity/v3/users => generated 294 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 02:35:30.724017 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5f2473-a7b7-4965-86dd-a933255f4954 service nova] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:30.738280 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5f2473-a7b7-4965-86dd-a933255f4954 service nova] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:30.746527 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217e727f-59a6-4685-98a1-c84b0308de5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:30.747222 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217e727f-59a6-4685-98a1-c84b0308de5b admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:30.749077 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217e727f-59a6-4685-98a1-c84b0308de5b admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:30.749392 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217e727f-59a6-4685-98a1-c84b0308de5b admin admin] PATH_INFO: `/v3/roles` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:30.750352 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217e727f-59a6-4685-98a1-c84b0308de5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:30.753644 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217e727f-59a6-4685-98a1-c84b0308de5b admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:30.773303 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 853/1701] 10.222.0.117 () {58 vars in 1126 bytes} [Tue Jan 25 02:35:30 2022] GET /identity/v3/roles => generated 1427 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 02:35:30.774664 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bc0675-4c5f-4ba4-beee-f1717cfea141 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:30.790610 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bc0675-4c5f-4ba4-beee-f1717cfea141 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:30.795783 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919bf2f0-58da-4358-b508-9fca05850cf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:30.796705 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919bf2f0-58da-4358-b508-9fca05850cf5 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:30.797279 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919bf2f0-58da-4358-b508-9fca05850cf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:30.797703 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919bf2f0-58da-4358-b508-9fca05850cf5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:30.799283 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919bf2f0-58da-4358-b508-9fca05850cf5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:30.801268 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919bf2f0-58da-4358-b508-9fca05850cf5 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:30.816972 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 849/1702] 10.222.0.117 () {58 vars in 1126 bytes} [Tue Jan 25 02:35:30 2022] GET /identity/v3/roles => generated 1427 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 25 02:35:30.821231 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217e727f-59a6-4685-98a1-c84b0308de5b admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:30.834001 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217e727f-59a6-4685-98a1-c84b0308de5b admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:30.843047 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85addbba-035a-4af3-b3b4-1c7120c56bed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:30.844922 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85addbba-035a-4af3-b3b4-1c7120c56bed admin admin] REQUEST_METHOD: `PUT` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:30.844922 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85addbba-035a-4af3-b3b4-1c7120c56bed admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:30.845382 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85addbba-035a-4af3-b3b4-1c7120c56bed admin admin] PATH_INFO: `/v3/projects/5d5aa42dc189485698ed74ebbd1567c7/users/a7fceca9e8c5447ca477d39ad806fcec/roles/33a8e87420ed423f9cb29e0084eab5d2` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:30.867600 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85addbba-035a-4af3-b3b4-1c7120c56bed admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d5aa42dc189485698ed74ebbd1567c7, user_id=a7fceca9e8c5447ca477d39ad806fcec, role_id=33a8e87420ed423f9cb29e0084eab5d2)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:30.870569 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85addbba-035a-4af3-b3b4-1c7120c56bed admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:30.904556 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 854/1703] 10.222.0.117 () {60 vars in 1487 bytes} [Tue Jan 25 02:35:30 2022] PUT /identity/v3/projects/5d5aa42dc189485698ed74ebbd1567c7/users/a7fceca9e8c5447ca477d39ad806fcec/roles/33a8e87420ed423f9cb29e0084eab5d2 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:35:30.907672 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b80b5d-c5dc-4319-a51e-000737ae18ea None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:30.907990 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b80b5d-c5dc-4319-a51e-000737ae18ea None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:30.908431 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b80b5d-c5dc-4319-a51e-000737ae18ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:30.955012 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-28b80b5d-c5dc-4319-a51e-000737ae18ea None None] MFA Rules not processed for user `a7fceca9e8c5447ca477d39ad806fcec`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:35:30.956358 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-28b80b5d-c5dc-4319-a51e-000737ae18ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:35:31.067844 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 850/1704] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:35:30 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:35:31.068935 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85addbba-035a-4af3-b3b4-1c7120c56bed admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:31.130991 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b80b5d-c5dc-4319-a51e-000737ae18ea None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:31.130991 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-28b80b5d-c5dc-4319-a51e-000737ae18ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:35:31.237458 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85addbba-035a-4af3-b3b4-1c7120c56bed admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:31.254610 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c78645c-ca77-4951-a103-a57562b7ba20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:31.255301 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c78645c-ca77-4951-a103-a57562b7ba20 admin admin] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:31.255616 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c78645c-ca77-4951-a103-a57562b7ba20 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:31.255876 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c78645c-ca77-4951-a103-a57562b7ba20 admin admin] PATH_INFO: `/v3/projects` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:31.256704 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c78645c-ca77-4951-a103-a57562b7ba20 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:31.268370 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c78645c-ca77-4951-a103-a57562b7ba20 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:31.308738 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b80b5d-c5dc-4319-a51e-000737ae18ea None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:31.331317 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5ddd48-3b87-4e34-b089-0b133d4d388a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:31.332413 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5ddd48-3b87-4e34-b089-0b133d4d388a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:31.332827 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5ddd48-3b87-4e34-b089-0b133d4d388a admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:31.333211 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5ddd48-3b87-4e34-b089-0b133d4d388a admin admin] PATH_INFO: `/v3/projects/762ca0aed045494f8c8d429eabf7c1fe` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:31.334946 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5ddd48-3b87-4e34-b089-0b133d4d388a admin admin] RBAC: Authorizing `identity:delete_project(project_id=762ca0aed045494f8c8d429eabf7c1fe)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:31.337402 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: WARNING py.warnings [None req-ea5ddd48-3b87-4e34-b089-0b133d4d388a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 25 02:35:31.337402 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: warnings.warn(msg) Jan 25 02:35:31.337402 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: Jan 25 02:35:31.338942 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5ddd48-3b87-4e34-b089-0b133d4d388a admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:31.340229 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 855/1705] 10.222.0.117 () {60 vars in 1157 bytes} [Tue Jan 25 02:35:31 2022] POST /identity/v3/projects => generated 388 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 02:35:31.344092 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c78645c-ca77-4951-a103-a57562b7ba20 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:31.438604 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c78645c-ca77-4951-a103-a57562b7ba20 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:31.455235 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-ea5ddd48-3b87-4e34-b089-0b133d4d388a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '762ca0aed045494f8c8d429eabf7c1fe', 'request_id': 'req-ea5ddd48-3b87-4e34-b089-0b133d4d388a'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:35:31.479558 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-ea5ddd48-3b87-4e34-b089-0b133d4d388a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '762ca0aed045494f8c8d429eabf7c1fe', 'request_id': 'req-ea5ddd48-3b87-4e34-b089-0b133d4d388a'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:35:31.515962 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-ea5ddd48-3b87-4e34-b089-0b133d4d388a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '762ca0aed045494f8c8d429eabf7c1fe', 'request_id': 'req-ea5ddd48-3b87-4e34-b089-0b133d4d388a'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:35:31.541367 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-ea5ddd48-3b87-4e34-b089-0b133d4d388a admin admin] The token cache is being invalidate because project 762ca0aed045494f8c8d429eabf7c1fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79120) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 25 02:35:31.544016 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-ea5ddd48-3b87-4e34-b089-0b133d4d388a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:35:31.545901 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-ea5ddd48-3b87-4e34-b089-0b133d4d388a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:35:31.554978 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 851/1706] 10.222.0.117 () {58 vars in 1237 bytes} [Tue Jan 25 02:35:31 2022] DELETE /identity/v3/projects/762ca0aed045494f8c8d429eabf7c1fe => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:35:31.556331 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5ddd48-3b87-4e34-b089-0b133d4d388a admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:31.558853 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-ea5ddd48-3b87-4e34-b089-0b133d4d388a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:35:31.560023 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf04249-1586-48d8-97b6-94e1baa85c78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:31.562503 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf04249-1586-48d8-97b6-94e1baa85c78 admin admin] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:31.562970 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf04249-1586-48d8-97b6-94e1baa85c78 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:31.564176 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf04249-1586-48d8-97b6-94e1baa85c78 admin admin] PATH_INFO: `/v3/users` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:31.565141 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf04249-1586-48d8-97b6-94e1baa85c78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:31.568259 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf04249-1586-48d8-97b6-94e1baa85c78 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:31.601619 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5ddd48-3b87-4e34-b089-0b133d4d388a admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:31.612953 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058432a0-841c-474a-8411-dcba45a1fbf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:31.614360 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058432a0-841c-474a-8411-dcba45a1fbf4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:31.621639 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058432a0-841c-474a-8411-dcba45a1fbf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:31.623225 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058432a0-841c-474a-8411-dcba45a1fbf4 admin admin] PATH_INFO: `/v3/users/febad9f52154498d9fb3d6bdd429ff36` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:31.626733 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058432a0-841c-474a-8411-dcba45a1fbf4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=febad9f52154498d9fb3d6bdd429ff36)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:31.634382 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058432a0-841c-474a-8411-dcba45a1fbf4 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:31.634921 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 856/1707] 10.222.0.117 () {60 vars in 1148 bytes} [Tue Jan 25 02:35:31 2022] POST /identity/v3/users => generated 301 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 02:35:31.638217 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf04249-1586-48d8-97b6-94e1baa85c78 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:31.642585 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-5cf04249-1586-48d8-97b6-94e1baa85c78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:35:31.715580 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf04249-1586-48d8-97b6-94e1baa85c78 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:31.734770 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf3f36f-b3ff-4691-bdf1-800052ca4870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:31.735484 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf3f36f-b3ff-4691-bdf1-800052ca4870 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:31.735775 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf3f36f-b3ff-4691-bdf1-800052ca4870 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:31.736050 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf3f36f-b3ff-4691-bdf1-800052ca4870 admin admin] PATH_INFO: `/v3/roles` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:31.736833 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf3f36f-b3ff-4691-bdf1-800052ca4870 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:31.740153 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf3f36f-b3ff-4691-bdf1-800052ca4870 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:31.761131 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 857/1708] 10.222.0.117 () {58 vars in 1126 bytes} [Tue Jan 25 02:35:31 2022] GET /identity/v3/roles => generated 1427 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 02:35:31.772188 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf3f36f-b3ff-4691-bdf1-800052ca4870 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:31.799518 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf3f36f-b3ff-4691-bdf1-800052ca4870 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:31.806521 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-058432a0-841c-474a-8411-dcba45a1fbf4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'febad9f52154498d9fb3d6bdd429ff36'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:35:31.819202 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027d2863-7ceb-4581-83de-86ded1ba4e24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:31.824636 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027d2863-7ceb-4581-83de-86ded1ba4e24 admin admin] REQUEST_METHOD: `PUT` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:31.826486 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-058432a0-841c-474a-8411-dcba45a1fbf4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'febad9f52154498d9fb3d6bdd429ff36'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:35:31.826887 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027d2863-7ceb-4581-83de-86ded1ba4e24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:31.827184 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027d2863-7ceb-4581-83de-86ded1ba4e24 admin admin] PATH_INFO: `/v3/projects/46d7bd9177ce4ba3950250c6c8a7e6b9/users/cfde4ffacf724d6caca154206ce39362/roles/d8dbc6d83d9d41d28c3feb8b3485b291` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:31.829865 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-058432a0-841c-474a-8411-dcba45a1fbf4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'febad9f52154498d9fb3d6bdd429ff36'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:35:31.831986 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-058432a0-841c-474a-8411-dcba45a1fbf4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'febad9f52154498d9fb3d6bdd429ff36'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:35:31.864648 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-058432a0-841c-474a-8411-dcba45a1fbf4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'febad9f52154498d9fb3d6bdd429ff36'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:35:31.873054 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027d2863-7ceb-4581-83de-86ded1ba4e24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46d7bd9177ce4ba3950250c6c8a7e6b9, user_id=cfde4ffacf724d6caca154206ce39362, role_id=d8dbc6d83d9d41d28c3feb8b3485b291)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:31.880667 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027d2863-7ceb-4581-83de-86ded1ba4e24 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:31.893247 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 852/1709] 10.222.0.117 () {58 vars in 1228 bytes} [Tue Jan 25 02:35:31 2022] DELETE /identity/v3/users/febad9f52154498d9fb3d6bdd429ff36 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:35:31.895203 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ffdc91-90b0-4b4c-960e-635d8def3b4a None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:31.895800 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ffdc91-90b0-4b4c-960e-635d8def3b4a None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:31.896213 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ffdc91-90b0-4b4c-960e-635d8def3b4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:31.909278 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 858/1710] 10.222.0.117 () {60 vars in 1487 bytes} [Tue Jan 25 02:35:31 2022] PUT /identity/v3/projects/46d7bd9177ce4ba3950250c6c8a7e6b9/users/cfde4ffacf724d6caca154206ce39362/roles/d8dbc6d83d9d41d28c3feb8b3485b291 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:35:31.912993 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027d2863-7ceb-4581-83de-86ded1ba4e24 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:31.917738 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-027d2863-7ceb-4581-83de-86ded1ba4e24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:35:31.924839 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-48ffdc91-90b0-4b4c-960e-635d8def3b4a None None] MFA Rules not processed for user `ee5b954a34da4c95aab352015a7c551c`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:35:31.926918 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-48ffdc91-90b0-4b4c-960e-635d8def3b4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:35:32.016681 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 853/1711] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:35:31 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:35:32.047997 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027d2863-7ceb-4581-83de-86ded1ba4e24 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:32.062204 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6095d040-d60a-48be-935a-ac1d1322907e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:32.063334 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6095d040-d60a-48be-935a-ac1d1322907e admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:32.064763 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6095d040-d60a-48be-935a-ac1d1322907e admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:32.065237 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6095d040-d60a-48be-935a-ac1d1322907e admin admin] PATH_INFO: `/v3/roles` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:32.068113 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6095d040-d60a-48be-935a-ac1d1322907e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:32.072631 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6095d040-d60a-48be-935a-ac1d1322907e admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:32.096200 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 859/1712] 10.222.0.117 () {58 vars in 1126 bytes} [Tue Jan 25 02:35:31 2022] GET /identity/v3/roles => generated 1427 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 25 02:35:32.096901 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ffdc91-90b0-4b4c-960e-635d8def3b4a None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:32.121121 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ffdc91-90b0-4b4c-960e-635d8def3b4a None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:32.135779 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dfa646-81fa-49a2-aa30-0e2e5c03551e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:32.136919 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dfa646-81fa-49a2-aa30-0e2e5c03551e admin admin] REQUEST_METHOD: `PUT` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:32.138605 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dfa646-81fa-49a2-aa30-0e2e5c03551e admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:32.139065 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dfa646-81fa-49a2-aa30-0e2e5c03551e admin admin] PATH_INFO: `/v3/projects/46d7bd9177ce4ba3950250c6c8a7e6b9/users/cfde4ffacf724d6caca154206ce39362/roles/d8dbc6d83d9d41d28c3feb8b3485b291` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:32.146096 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dfa646-81fa-49a2-aa30-0e2e5c03551e admin admin] RBAC: Authorizing `identity:create_grant(project_id=46d7bd9177ce4ba3950250c6c8a7e6b9, user_id=cfde4ffacf724d6caca154206ce39362, role_id=d8dbc6d83d9d41d28c3feb8b3485b291)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:32.153056 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dfa646-81fa-49a2-aa30-0e2e5c03551e admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:32.212023 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 854/1713] 10.222.0.117 () {60 vars in 1487 bytes} [Tue Jan 25 02:35:32 2022] PUT /identity/v3/projects/46d7bd9177ce4ba3950250c6c8a7e6b9/users/cfde4ffacf724d6caca154206ce39362/roles/d8dbc6d83d9d41d28c3feb8b3485b291 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 25 02:35:32.222603 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d078fa6-a6b1-437c-909e-2539e1e4d7a5 None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:32.222905 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d078fa6-a6b1-437c-909e-2539e1e4d7a5 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:32.223187 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d078fa6-a6b1-437c-909e-2539e1e4d7a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:32.270213 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-0d078fa6-a6b1-437c-909e-2539e1e4d7a5 None None] MFA Rules not processed for user `cfde4ffacf724d6caca154206ce39362`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:35:32.271514 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-0d078fa6-a6b1-437c-909e-2539e1e4d7a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:35:32.425111 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 860/1714] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:35:32 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:35:32.431983 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dfa646-81fa-49a2-aa30-0e2e5c03551e admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:32.433901 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-46dfa646-81fa-49a2-aa30-0e2e5c03551e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:35:32.614452 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dfa646-81fa-49a2-aa30-0e2e5c03551e admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:32.621570 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa6b390-c74b-4800-b079-a73ed0f8d7ff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cc5249aea09430080e232cf17757f86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:32.622999 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa6b390-c74b-4800-b079-a73ed0f8d7ff service cinder] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:32.622999 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa6b390-c74b-4800-b079-a73ed0f8d7ff service cinder] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:32.622999 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa6b390-c74b-4800-b079-a73ed0f8d7ff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:32.638409 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa6b390-c74b-4800-b079-a73ed0f8d7ff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:32.640935 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa6b390-c74b-4800-b079-a73ed0f8d7ff service cinder] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:32.675745 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 855/1715] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:35:32 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:35:33.010228 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d078fa6-a6b1-437c-909e-2539e1e4d7a5 None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:33.011746 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-0d078fa6-a6b1-437c-909e-2539e1e4d7a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:35:33.082567 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6f3172-e0ba-4862-814a-9c4a07b835d7 None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:33.083876 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6f3172-e0ba-4862-814a-9c4a07b835d7 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:33.084592 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6f3172-e0ba-4862-814a-9c4a07b835d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:33.167801 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-9c6f3172-e0ba-4862-814a-9c4a07b835d7 None None] MFA Rules not processed for user `a366d243b91b479cac0fa7f3238cbafa`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:35:33.169032 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-9c6f3172-e0ba-4862-814a-9c4a07b835d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:35:33.266773 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d078fa6-a6b1-437c-909e-2539e1e4d7a5 None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:33.272368 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db530462-ff90-4202-8020-0be9f6757499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:33.274507 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db530462-ff90-4202-8020-0be9f6757499 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:33.275013 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db530462-ff90-4202-8020-0be9f6757499 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:33.275572 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db530462-ff90-4202-8020-0be9f6757499 admin admin] PATH_INFO: `/v3/projects/78c41827a68f4f1e9864a0e8dbc16c95` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:33.277090 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db530462-ff90-4202-8020-0be9f6757499 admin admin] RBAC: Authorizing `identity:delete_project(project_id=78c41827a68f4f1e9864a0e8dbc16c95)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:33.281545 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db530462-ff90-4202-8020-0be9f6757499 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:33.355558 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 856/1716] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:35:33 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 25 02:35:33.356662 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6f3172-e0ba-4862-814a-9c4a07b835d7 None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:33.358437 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-9c6f3172-e0ba-4862-814a-9c4a07b835d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:35:33.383740 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-db530462-ff90-4202-8020-0be9f6757499 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78c41827a68f4f1e9864a0e8dbc16c95', 'request_id': 'req-db530462-ff90-4202-8020-0be9f6757499'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:35:33.405605 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-db530462-ff90-4202-8020-0be9f6757499 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78c41827a68f4f1e9864a0e8dbc16c95', 'request_id': 'req-db530462-ff90-4202-8020-0be9f6757499'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:35:33.431987 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-db530462-ff90-4202-8020-0be9f6757499 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78c41827a68f4f1e9864a0e8dbc16c95', 'request_id': 'req-db530462-ff90-4202-8020-0be9f6757499'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:35:33.456182 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-db530462-ff90-4202-8020-0be9f6757499 admin admin] The token cache is being invalidate because project 78c41827a68f4f1e9864a0e8dbc16c95 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79121) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 25 02:35:33.456466 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-db530462-ff90-4202-8020-0be9f6757499 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:35:33.458045 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-db530462-ff90-4202-8020-0be9f6757499 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:35:33.464171 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 861/1717] 10.222.0.117 () {58 vars in 1237 bytes} [Tue Jan 25 02:35:33 2022] DELETE /identity/v3/projects/78c41827a68f4f1e9864a0e8dbc16c95 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:35:33.471338 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c19492-bf98-41a8-8268-d9453a07c828 None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:33.474385 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c19492-bf98-41a8-8268-d9453a07c828 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:33.474812 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c19492-bf98-41a8-8268-d9453a07c828 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:33.512734 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-38c19492-bf98-41a8-8268-d9453a07c828 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:35:33.518212 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-38c19492-bf98-41a8-8268-d9453a07c828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:35:33.535846 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6f3172-e0ba-4862-814a-9c4a07b835d7 None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:33.636983 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 862/1718] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:35:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 25 02:35:33.644515 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d327896-a4e4-4b29-b543-ed4bba1cd910 None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:33.644957 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d327896-a4e4-4b29-b543-ed4bba1cd910 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:33.645381 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d327896-a4e4-4b29-b543-ed4bba1cd910 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:33.690700 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-3d327896-a4e4-4b29-b543-ed4bba1cd910 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:35:33.692191 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-3d327896-a4e4-4b29-b543-ed4bba1cd910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:35:33.699629 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0f39d3-c31e-4893-8cb5-2a86be58ea71 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9ad6269900346458050063c12cac299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:33.700492 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0f39d3-c31e-4893-8cb5-2a86be58ea71 service nova] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:33.700876 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0f39d3-c31e-4893-8cb5-2a86be58ea71 service nova] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:33.701464 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0f39d3-c31e-4893-8cb5-2a86be58ea71 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:33.704452 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-4d0f39d3-c31e-4893-8cb5-2a86be58ea71 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:35:33.718680 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 863/1719] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:35:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:35:33.722796 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d327896-a4e4-4b29-b543-ed4bba1cd910 None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:33.750060 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d327896-a4e4-4b29-b543-ed4bba1cd910 None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:33.759370 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbf677e-468a-4a23-bc97-a6259094ecf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:33.760288 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbf677e-468a-4a23-bc97-a6259094ecf4 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:33.760710 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbf677e-468a-4a23-bc97-a6259094ecf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:33.761117 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbf677e-468a-4a23-bc97-a6259094ecf4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:33.762016 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbf677e-468a-4a23-bc97-a6259094ecf4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:35:33.762456 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbf677e-468a-4a23-bc97-a6259094ecf4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:33.764255 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbf677e-468a-4a23-bc97-a6259094ecf4 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:33.779748 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 864/1720] 10.222.0.117 () {58 vars in 1157 bytes} [Tue Jan 25 02:35:33 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:35:33.794976 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbf677e-468a-4a23-bc97-a6259094ecf4 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:33.813798 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbf677e-468a-4a23-bc97-a6259094ecf4 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:33.830449 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98eabb8-4e17-4bc6-bf52-d4f5272bcf77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:33.831125 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98eabb8-4e17-4bc6-bf52-d4f5272bcf77 admin admin] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:33.831404 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98eabb8-4e17-4bc6-bf52-d4f5272bcf77 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:33.831678 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98eabb8-4e17-4bc6-bf52-d4f5272bcf77 admin admin] PATH_INFO: `/v3/projects` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:33.832414 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98eabb8-4e17-4bc6-bf52-d4f5272bcf77 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:33.834665 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98eabb8-4e17-4bc6-bf52-d4f5272bcf77 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:33.840194 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0f39d3-c31e-4893-8cb5-2a86be58ea71 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:33.841881 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0f39d3-c31e-4893-8cb5-2a86be58ea71 service nova] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:33.877743 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 857/1721] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:35:33 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 520 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:35:33.921652 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 865/1722] 10.222.0.117 () {60 vars in 1157 bytes} [Tue Jan 25 02:35:33 2022] POST /identity/v3/projects => generated 380 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 02:35:33.922841 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0f39d3-c31e-4893-8cb5-2a86be58ea71 service nova] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:33.949759 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0f39d3-c31e-4893-8cb5-2a86be58ea71 service nova] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:33.995176 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98eabb8-4e17-4bc6-bf52-d4f5272bcf77 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:33.996896 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-a98eabb8-4e17-4bc6-bf52-d4f5272bcf77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:35:34.065301 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684faff5-4649-45ea-972b-71defe571c3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:34.066372 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684faff5-4649-45ea-972b-71defe571c3c admin admin] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:34.066743 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684faff5-4649-45ea-972b-71defe571c3c admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:34.067292 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684faff5-4649-45ea-972b-71defe571c3c admin admin] PATH_INFO: `/v3/users` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:34.068042 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684faff5-4649-45ea-972b-71defe571c3c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:34.071347 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684faff5-4649-45ea-972b-71defe571c3c admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:34.082993 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98eabb8-4e17-4bc6-bf52-d4f5272bcf77 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:34.093763 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7913ca69-63d5-4eec-b952-1891e7ef4f77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:34.096204 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7913ca69-63d5-4eec-b952-1891e7ef4f77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:34.097277 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7913ca69-63d5-4eec-b952-1891e7ef4f77 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:34.097610 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7913ca69-63d5-4eec-b952-1891e7ef4f77 admin admin] PATH_INFO: `/v3/users/a7fceca9e8c5447ca477d39ad806fcec` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:34.100039 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7913ca69-63d5-4eec-b952-1891e7ef4f77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7fceca9e8c5447ca477d39ad806fcec)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:34.102876 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7913ca69-63d5-4eec-b952-1891e7ef4f77 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:34.104691 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 858/1723] 10.222.0.117 () {60 vars in 1148 bytes} [Tue Jan 25 02:35:33 2022] POST /identity/v3/users => generated 291 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 02:35:34.146952 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684faff5-4649-45ea-972b-71defe571c3c admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:34.185589 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684faff5-4649-45ea-972b-71defe571c3c admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:34.193269 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-7913ca69-63d5-4eec-b952-1891e7ef4f77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7fceca9e8c5447ca477d39ad806fcec'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:35:34.193993 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-7913ca69-63d5-4eec-b952-1891e7ef4f77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7fceca9e8c5447ca477d39ad806fcec'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:35:34.196965 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0285c485-2499-49af-bd5e-01ed897da1e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:34.197652 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0285c485-2499-49af-bd5e-01ed897da1e8 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:34.197936 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0285c485-2499-49af-bd5e-01ed897da1e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:34.198212 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0285c485-2499-49af-bd5e-01ed897da1e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:34.198967 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0285c485-2499-49af-bd5e-01ed897da1e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:34.200603 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0285c485-2499-49af-bd5e-01ed897da1e8 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:34.202344 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-7913ca69-63d5-4eec-b952-1891e7ef4f77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7fceca9e8c5447ca477d39ad806fcec'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:35:34.203196 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-7913ca69-63d5-4eec-b952-1891e7ef4f77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7fceca9e8c5447ca477d39ad806fcec'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:35:34.214732 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-7913ca69-63d5-4eec-b952-1891e7ef4f77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7fceca9e8c5447ca477d39ad806fcec'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:35:34.220414 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 859/1724] 10.222.0.117 () {58 vars in 1126 bytes} [Tue Jan 25 02:35:34 2022] GET /identity/v3/roles => generated 1427 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 02:35:34.232105 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0285c485-2499-49af-bd5e-01ed897da1e8 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:34.234993 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-0285c485-2499-49af-bd5e-01ed897da1e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:35:34.241067 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 866/1725] 10.222.0.117 () {58 vars in 1228 bytes} [Tue Jan 25 02:35:33 2022] DELETE /identity/v3/users/a7fceca9e8c5447ca477d39ad806fcec => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:35:34.246440 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a16f22c-69be-448a-8dbf-0035b14ad90e None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:34.246973 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a16f22c-69be-448a-8dbf-0035b14ad90e None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:34.247427 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a16f22c-69be-448a-8dbf-0035b14ad90e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:34.260360 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0285c485-2499-49af-bd5e-01ed897da1e8 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:34.269958 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-8a16f22c-69be-448a-8dbf-0035b14ad90e None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:35:34.271935 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-8a16f22c-69be-448a-8dbf-0035b14ad90e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:35:34.330081 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d4d71e-3cb0-4011-8687-aa4e7e54a3b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:34.330843 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d4d71e-3cb0-4011-8687-aa4e7e54a3b4 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:34.331451 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d4d71e-3cb0-4011-8687-aa4e7e54a3b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:34.331451 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d4d71e-3cb0-4011-8687-aa4e7e54a3b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:34.332386 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d4d71e-3cb0-4011-8687-aa4e7e54a3b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:34.334451 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d4d71e-3cb0-4011-8687-aa4e7e54a3b4 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:34.347633 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 860/1726] 10.222.0.117 () {58 vars in 1126 bytes} [Tue Jan 25 02:35:34 2022] GET /identity/v3/roles => generated 1427 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 02:35:34.352324 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d4d71e-3cb0-4011-8687-aa4e7e54a3b4 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:34.371847 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d4d71e-3cb0-4011-8687-aa4e7e54a3b4 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:34.382460 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cd468b-33a1-44cf-bf8b-1bbdd97d9693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:34.384833 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cd468b-33a1-44cf-bf8b-1bbdd97d9693 admin admin] REQUEST_METHOD: `PUT` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:34.385187 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cd468b-33a1-44cf-bf8b-1bbdd97d9693 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:34.386406 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cd468b-33a1-44cf-bf8b-1bbdd97d9693 admin admin] PATH_INFO: `/v3/projects/339f4b4d625941c1ac41f27a8bcef577/users/ca66a843be8348f1a8b7e4c1c113895b/roles/33a8e87420ed423f9cb29e0084eab5d2` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:34.393831 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 867/1727] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:35:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 25 02:35:34.409719 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a16f22c-69be-448a-8dbf-0035b14ad90e None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:34.414191 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-8a16f22c-69be-448a-8dbf-0035b14ad90e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:35:34.431952 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cd468b-33a1-44cf-bf8b-1bbdd97d9693 admin admin] RBAC: Authorizing `identity:create_grant(project_id=339f4b4d625941c1ac41f27a8bcef577, user_id=ca66a843be8348f1a8b7e4c1c113895b, role_id=33a8e87420ed423f9cb29e0084eab5d2)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:34.435199 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cd468b-33a1-44cf-bf8b-1bbdd97d9693 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:34.450544 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 861/1728] 10.222.0.117 () {60 vars in 1487 bytes} [Tue Jan 25 02:35:34 2022] PUT /identity/v3/projects/339f4b4d625941c1ac41f27a8bcef577/users/ca66a843be8348f1a8b7e4c1c113895b/roles/33a8e87420ed423f9cb29e0084eab5d2 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 25 02:35:34.462270 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63ab925-b5e4-45ff-8766-c4a6f4579c10 None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:34.462941 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63ab925-b5e4-45ff-8766-c4a6f4579c10 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:34.463470 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63ab925-b5e4-45ff-8766-c4a6f4579c10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:34.500974 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a16f22c-69be-448a-8dbf-0035b14ad90e None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:34.513026 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-a63ab925-b5e4-45ff-8766-c4a6f4579c10 None None] MFA Rules not processed for user `ca66a843be8348f1a8b7e4c1c113895b`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:35:34.515261 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-a63ab925-b5e4-45ff-8766-c4a6f4579c10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:35:34.583632 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d31d90d-a4f5-4465-a172-fcff34e84ae7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca4071c5f8f4a31b5edb81fa66a43a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:34.584468 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d31d90d-a4f5-4465-a172-fcff34e84ae7 service neutron] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:34.584742 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d31d90d-a4f5-4465-a172-fcff34e84ae7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:34.585727 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d31d90d-a4f5-4465-a172-fcff34e84ae7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:34.643407 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 862/1729] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:35:34 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 25 02:35:34.644530 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63ab925-b5e4-45ff-8766-c4a6f4579c10 None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:34.763258 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d31d90d-a4f5-4465-a172-fcff34e84ae7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:34.764838 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d31d90d-a4f5-4465-a172-fcff34e84ae7 service neutron] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:34.766731 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63ab925-b5e4-45ff-8766-c4a6f4579c10 None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:34.779183 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5a16b3-2874-401e-a1d1-939cb0e72ba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:34.779907 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5a16b3-2874-401e-a1d1-939cb0e72ba0 admin admin] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:34.784359 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5a16b3-2874-401e-a1d1-939cb0e72ba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:34.784678 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5a16b3-2874-401e-a1d1-939cb0e72ba0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:34.785424 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5a16b3-2874-401e-a1d1-939cb0e72ba0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:34.786203 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 868/1730] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:35:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:35:34.803643 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5a16b3-2874-401e-a1d1-939cb0e72ba0 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:34.895194 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 863/1731] 10.222.0.117 () {60 vars in 1157 bytes} [Tue Jan 25 02:35:34 2022] POST /identity/v3/projects => generated 380 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 02:35:34.899143 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d31d90d-a4f5-4465-a172-fcff34e84ae7 service neutron] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:34.916162 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d31d90d-a4f5-4465-a172-fcff34e84ae7 service neutron] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:35.144522 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4019e3-17c7-4b62-927d-f5c9f84f069e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:35.145379 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4019e3-17c7-4b62-927d-f5c9f84f069e admin admin] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:35.145758 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4019e3-17c7-4b62-927d-f5c9f84f069e admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:35.146138 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4019e3-17c7-4b62-927d-f5c9f84f069e admin admin] PATH_INFO: `/v3/users` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:35.147111 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4019e3-17c7-4b62-927d-f5c9f84f069e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:35.155717 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4019e3-17c7-4b62-927d-f5c9f84f069e admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:35.199113 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 869/1732] 10.222.0.117 () {60 vars in 1148 bytes} [Tue Jan 25 02:35:34 2022] POST /identity/v3/users => generated 291 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 25 02:35:35.203771 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5a16b3-2874-401e-a1d1-939cb0e72ba0 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:35.235389 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5a16b3-2874-401e-a1d1-939cb0e72ba0 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:35.243398 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c00977-e451-410f-8efc-061203e40418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:35.244313 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c00977-e451-410f-8efc-061203e40418 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:35.244733 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c00977-e451-410f-8efc-061203e40418 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:35.245321 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c00977-e451-410f-8efc-061203e40418 admin admin] PATH_INFO: `/v3/roles` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:35.246654 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c00977-e451-410f-8efc-061203e40418 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:35.248760 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c00977-e451-410f-8efc-061203e40418 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:35.298333 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 864/1733] 10.222.0.117 () {58 vars in 1126 bytes} [Tue Jan 25 02:35:35 2022] GET /identity/v3/roles => generated 1427 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 02:35:35.302796 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4019e3-17c7-4b62-927d-f5c9f84f069e admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:35.325053 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4019e3-17c7-4b62-927d-f5c9f84f069e admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:35.343535 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fd5252-f059-4cee-a271-3f537fe79f95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:35.345193 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fd5252-f059-4cee-a271-3f537fe79f95 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:35.345409 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fd5252-f059-4cee-a271-3f537fe79f95 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:35.345626 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fd5252-f059-4cee-a271-3f537fe79f95 admin admin] PATH_INFO: `/v3/roles` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:35.346475 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fd5252-f059-4cee-a271-3f537fe79f95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:35.350356 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fd5252-f059-4cee-a271-3f537fe79f95 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:35.401319 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c00977-e451-410f-8efc-061203e40418 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:35.403766 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 870/1734] 10.222.0.117 () {58 vars in 1126 bytes} [Tue Jan 25 02:35:35 2022] GET /identity/v3/roles => generated 1427 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 02:35:35.422958 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c00977-e451-410f-8efc-061203e40418 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:35.432083 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b07d01-198f-4455-93eb-8b8f0fd6d81c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:35.433469 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b07d01-198f-4455-93eb-8b8f0fd6d81c admin admin] REQUEST_METHOD: `PUT` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:35.433825 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b07d01-198f-4455-93eb-8b8f0fd6d81c admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:35.434175 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b07d01-198f-4455-93eb-8b8f0fd6d81c admin admin] PATH_INFO: `/v3/projects/77350c403d1f406fa35dd6be35350f42/users/a251cf3310fd49739fb6106cf62c36b9/roles/33a8e87420ed423f9cb29e0084eab5d2` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:35.484989 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b07d01-198f-4455-93eb-8b8f0fd6d81c admin admin] RBAC: Authorizing `identity:create_grant(project_id=77350c403d1f406fa35dd6be35350f42, user_id=a251cf3310fd49739fb6106cf62c36b9, role_id=33a8e87420ed423f9cb29e0084eab5d2)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:35.490006 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b07d01-198f-4455-93eb-8b8f0fd6d81c admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:35.521168 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 865/1735] 10.222.0.117 () {60 vars in 1487 bytes} [Tue Jan 25 02:35:35 2022] PUT /identity/v3/projects/77350c403d1f406fa35dd6be35350f42/users/a251cf3310fd49739fb6106cf62c36b9/roles/33a8e87420ed423f9cb29e0084eab5d2 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:35:35.531354 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e36a679-157e-4d9a-9741-baa01b933ac0 None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:35.531852 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e36a679-157e-4d9a-9741-baa01b933ac0 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:35.532156 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e36a679-157e-4d9a-9741-baa01b933ac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:35.573282 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-8e36a679-157e-4d9a-9741-baa01b933ac0 None None] MFA Rules not processed for user `a251cf3310fd49739fb6106cf62c36b9`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:35:35.574622 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-8e36a679-157e-4d9a-9741-baa01b933ac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:35:35.666455 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 871/1736] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:35:35 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:35:35.671019 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b07d01-198f-4455-93eb-8b8f0fd6d81c admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:35.762317 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e36a679-157e-4d9a-9741-baa01b933ac0 None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:35.763770 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-8e36a679-157e-4d9a-9741-baa01b933ac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:35:35.776874 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b07d01-198f-4455-93eb-8b8f0fd6d81c admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:35.782801 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad71e5a-5527-40a8-b160-bf27d7f5b136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:35.783864 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad71e5a-5527-40a8-b160-bf27d7f5b136 admin admin] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:35.784420 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad71e5a-5527-40a8-b160-bf27d7f5b136 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:35.784883 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad71e5a-5527-40a8-b160-bf27d7f5b136 admin admin] PATH_INFO: `/v3/projects` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:35.785816 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad71e5a-5527-40a8-b160-bf27d7f5b136 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:35.788543 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad71e5a-5527-40a8-b160-bf27d7f5b136 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:35.858944 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 866/1737] 10.222.0.117 () {60 vars in 1157 bytes} [Tue Jan 25 02:35:35 2022] POST /identity/v3/projects => generated 378 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 02:35:35.863731 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad71e5a-5527-40a8-b160-bf27d7f5b136 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:35.881554 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e36a679-157e-4d9a-9741-baa01b933ac0 None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:35.981153 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad71e5a-5527-40a8-b160-bf27d7f5b136 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:35.999417 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc0b2a9-289e-4264-9c3e-ab8b03f83e67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:36.001470 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc0b2a9-289e-4264-9c3e-ab8b03f83e67 admin admin] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:36.001924 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc0b2a9-289e-4264-9c3e-ab8b03f83e67 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:36.002432 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc0b2a9-289e-4264-9c3e-ab8b03f83e67 admin admin] PATH_INFO: `/v3/users` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:36.003455 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc0b2a9-289e-4264-9c3e-ab8b03f83e67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:36.011350 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc0b2a9-289e-4264-9c3e-ab8b03f83e67 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:36.013293 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb66a88-3c67-4793-861a-f717fdfe1fc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:36.014280 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb66a88-3c67-4793-861a-f717fdfe1fc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:36.014436 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb66a88-3c67-4793-861a-f717fdfe1fc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:36.014714 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb66a88-3c67-4793-861a-f717fdfe1fc0 admin admin] PATH_INFO: `/v3/projects/5d5aa42dc189485698ed74ebbd1567c7` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:36.016102 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb66a88-3c67-4793-861a-f717fdfe1fc0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d5aa42dc189485698ed74ebbd1567c7)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:36.019087 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb66a88-3c67-4793-861a-f717fdfe1fc0 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:36.080366 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 867/1738] 10.222.0.117 () {60 vars in 1148 bytes} [Tue Jan 25 02:35:35 2022] POST /identity/v3/users => generated 296 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 02:35:36.083270 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc0b2a9-289e-4264-9c3e-ab8b03f83e67 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:36.122303 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-4bb66a88-3c67-4793-861a-f717fdfe1fc0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d5aa42dc189485698ed74ebbd1567c7', 'request_id': 'req-4bb66a88-3c67-4793-861a-f717fdfe1fc0'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:35:36.127597 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc0b2a9-289e-4264-9c3e-ab8b03f83e67 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:36.135378 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-4bb66a88-3c67-4793-861a-f717fdfe1fc0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d5aa42dc189485698ed74ebbd1567c7', 'request_id': 'req-4bb66a88-3c67-4793-861a-f717fdfe1fc0'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:35:36.150031 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-4bb66a88-3c67-4793-861a-f717fdfe1fc0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d5aa42dc189485698ed74ebbd1567c7', 'request_id': 'req-4bb66a88-3c67-4793-861a-f717fdfe1fc0'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:35:36.169810 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-4bb66a88-3c67-4793-861a-f717fdfe1fc0 admin admin] The token cache is being invalidate because project 5d5aa42dc189485698ed74ebbd1567c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79121) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 25 02:35:36.171627 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-4bb66a88-3c67-4793-861a-f717fdfe1fc0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:35:36.172406 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-4bb66a88-3c67-4793-861a-f717fdfe1fc0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:35:36.174278 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 872/1739] 10.222.0.117 () {58 vars in 1237 bytes} [Tue Jan 25 02:35:35 2022] DELETE /identity/v3/projects/5d5aa42dc189485698ed74ebbd1567c7 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 25 02:35:36.177992 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb66a88-3c67-4793-861a-f717fdfe1fc0 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:36.188305 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-4bb66a88-3c67-4793-861a-f717fdfe1fc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:35:36.284976 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d8f2b3-4f43-4bb3-9c0b-db516803450b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:36.285729 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d8f2b3-4f43-4bb3-9c0b-db516803450b admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:36.286020 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d8f2b3-4f43-4bb3-9c0b-db516803450b admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:36.286295 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d8f2b3-4f43-4bb3-9c0b-db516803450b admin admin] PATH_INFO: `/v3/roles` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:36.287057 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d8f2b3-4f43-4bb3-9c0b-db516803450b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:36.294293 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d8f2b3-4f43-4bb3-9c0b-db516803450b admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:36.332088 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 868/1740] 10.222.0.117 () {58 vars in 1126 bytes} [Tue Jan 25 02:35:36 2022] GET /identity/v3/roles => generated 1427 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 25 02:35:36.337206 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d8f2b3-4f43-4bb3-9c0b-db516803450b admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:36.339604 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-97d8f2b3-4f43-4bb3-9c0b-db516803450b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:35:36.359031 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb66a88-3c67-4793-861a-f717fdfe1fc0 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:36.365927 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d8f2b3-4f43-4bb3-9c0b-db516803450b admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:36.376390 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026b1366-9340-4ed4-9634-5877dcc6fb2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:36.377361 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393abb25-6ec3-4729-92d1-a409febd21bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:36.378604 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393abb25-6ec3-4729-92d1-a409febd21bb admin admin] REQUEST_METHOD: `PUT` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:36.378745 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026b1366-9340-4ed4-9634-5877dcc6fb2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:36.378909 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026b1366-9340-4ed4-9634-5877dcc6fb2d admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:36.379095 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393abb25-6ec3-4729-92d1-a409febd21bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:36.379465 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393abb25-6ec3-4729-92d1-a409febd21bb admin admin] PATH_INFO: `/v3/projects/043bd2918ef24ecf91285ce48cc6d394/users/cabab8b9c5464d40855c12f56b0b71e9/roles/d8dbc6d83d9d41d28c3feb8b3485b291` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:36.382635 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026b1366-9340-4ed4-9634-5877dcc6fb2d admin admin] PATH_INFO: `/v3/users/cfde4ffacf724d6caca154206ce39362` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:36.385347 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026b1366-9340-4ed4-9634-5877dcc6fb2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=cfde4ffacf724d6caca154206ce39362)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:36.396516 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026b1366-9340-4ed4-9634-5877dcc6fb2d admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:36.402505 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393abb25-6ec3-4729-92d1-a409febd21bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=043bd2918ef24ecf91285ce48cc6d394, user_id=cabab8b9c5464d40855c12f56b0b71e9, role_id=d8dbc6d83d9d41d28c3feb8b3485b291)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:36.409195 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393abb25-6ec3-4729-92d1-a409febd21bb admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:36.438994 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 869/1741] 10.222.0.117 () {60 vars in 1487 bytes} [Tue Jan 25 02:35:36 2022] PUT /identity/v3/projects/043bd2918ef24ecf91285ce48cc6d394/users/cabab8b9c5464d40855c12f56b0b71e9/roles/d8dbc6d83d9d41d28c3feb8b3485b291 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 25 02:35:36.440715 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393abb25-6ec3-4729-92d1-a409febd21bb admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:36.534785 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-026b1366-9340-4ed4-9634-5877dcc6fb2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cfde4ffacf724d6caca154206ce39362'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:35:36.546514 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-026b1366-9340-4ed4-9634-5877dcc6fb2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cfde4ffacf724d6caca154206ce39362'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:35:36.563413 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-026b1366-9340-4ed4-9634-5877dcc6fb2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cfde4ffacf724d6caca154206ce39362'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:35:36.564470 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-026b1366-9340-4ed4-9634-5877dcc6fb2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cfde4ffacf724d6caca154206ce39362'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:35:36.575559 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-026b1366-9340-4ed4-9634-5877dcc6fb2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cfde4ffacf724d6caca154206ce39362'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:35:36.600280 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 873/1742] 10.222.0.117 () {58 vars in 1228 bytes} [Tue Jan 25 02:35:36 2022] DELETE /identity/v3/users/cfde4ffacf724d6caca154206ce39362 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:35:36.629751 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393abb25-6ec3-4729-92d1-a409febd21bb admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:36.716064 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad648f6-d177-4831-906d-373b6b290a55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:36.716875 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad648f6-d177-4831-906d-373b6b290a55 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:36.717303 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad648f6-d177-4831-906d-373b6b290a55 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:36.717716 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad648f6-d177-4831-906d-373b6b290a55 admin admin] PATH_INFO: `/v3/roles` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:36.718825 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad648f6-d177-4831-906d-373b6b290a55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:36.720829 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad648f6-d177-4831-906d-373b6b290a55 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:36.733073 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 870/1743] 10.222.0.117 () {58 vars in 1126 bytes} [Tue Jan 25 02:35:36 2022] GET /identity/v3/roles => generated 1427 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 02:35:36.737135 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026b1366-9340-4ed4-9634-5877dcc6fb2d admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:36.739256 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-026b1366-9340-4ed4-9634-5877dcc6fb2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:35:36.755388 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026b1366-9340-4ed4-9634-5877dcc6fb2d admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:36.761540 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2688ada3-fa5e-499f-bef5-5c7e113ca4e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:36.762455 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2688ada3-fa5e-499f-bef5-5c7e113ca4e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:36.762735 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2688ada3-fa5e-499f-bef5-5c7e113ca4e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:36.763008 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2688ada3-fa5e-499f-bef5-5c7e113ca4e3 admin admin] PATH_INFO: `/v3/projects/043bd2918ef24ecf91285ce48cc6d394/users/cabab8b9c5464d40855c12f56b0b71e9/roles/d8dbc6d83d9d41d28c3feb8b3485b291` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:36.765904 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2688ada3-fa5e-499f-bef5-5c7e113ca4e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=043bd2918ef24ecf91285ce48cc6d394, user_id=cabab8b9c5464d40855c12f56b0b71e9, role_id=d8dbc6d83d9d41d28c3feb8b3485b291)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:36.769242 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2688ada3-fa5e-499f-bef5-5c7e113ca4e3 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:36.781599 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 874/1744] 10.222.0.117 () {60 vars in 1487 bytes} [Tue Jan 25 02:35:36 2022] PUT /identity/v3/projects/043bd2918ef24ecf91285ce48cc6d394/users/cabab8b9c5464d40855c12f56b0b71e9/roles/d8dbc6d83d9d41d28c3feb8b3485b291 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:35:36.794385 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fd8452-bd36-42d2-bc35-a4454d6401e6 None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:36.794778 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fd8452-bd36-42d2-bc35-a4454d6401e6 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:36.795121 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fd8452-bd36-42d2-bc35-a4454d6401e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:36.856583 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-53fd8452-bd36-42d2-bc35-a4454d6401e6 None None] MFA Rules not processed for user `cabab8b9c5464d40855c12f56b0b71e9`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:35:36.858288 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-53fd8452-bd36-42d2-bc35-a4454d6401e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:35:36.957352 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 871/1745] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:35:36 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 25 02:35:36.967944 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2688ada3-fa5e-499f-bef5-5c7e113ca4e3 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:36.969600 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-2688ada3-fa5e-499f-bef5-5c7e113ca4e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:35:37.041758 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2688ada3-fa5e-499f-bef5-5c7e113ca4e3 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:37.047585 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5256aa6-a105-4335-b9c3-b89eeffa1e16 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cc5249aea09430080e232cf17757f86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:37.048196 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5256aa6-a105-4335-b9c3-b89eeffa1e16 service cinder] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:37.048478 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5256aa6-a105-4335-b9c3-b89eeffa1e16 service cinder] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:37.048747 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5256aa6-a105-4335-b9c3-b89eeffa1e16 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:37.061496 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5256aa6-a105-4335-b9c3-b89eeffa1e16 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:37.063254 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5256aa6-a105-4335-b9c3-b89eeffa1e16 service cinder] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:37.085119 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 875/1746] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:35:36 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:35:37.153422 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fd8452-bd36-42d2-bc35-a4454d6401e6 None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:37.155184 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-53fd8452-bd36-42d2-bc35-a4454d6401e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:35:37.178843 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fd8452-bd36-42d2-bc35-a4454d6401e6 None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:37.183678 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5926339b-09e7-4fdf-9ae7-d654d739713e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cc5249aea09430080e232cf17757f86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:37.184380 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5926339b-09e7-4fdf-9ae7-d654d739713e service cinder] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:37.184664 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5926339b-09e7-4fdf-9ae7-d654d739713e service cinder] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:37.184948 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5926339b-09e7-4fdf-9ae7-d654d739713e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:37.195656 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-5926339b-09e7-4fdf-9ae7-d654d739713e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:35:37.305414 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5926339b-09e7-4fdf-9ae7-d654d739713e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:37.307367 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5926339b-09e7-4fdf-9ae7-d654d739713e service cinder] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:37.320900 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 872/1747] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:35:37 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:35:37.370375 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5256aa6-a105-4335-b9c3-b89eeffa1e16 service cinder] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:37.371892 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-b5256aa6-a105-4335-b9c3-b89eeffa1e16 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:35:37.508511 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5256aa6-a105-4335-b9c3-b89eeffa1e16 service cinder] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:37.532915 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402bad85-3358-4edd-9aaa-4bc207d2fa13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:37.535790 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402bad85-3358-4edd-9aaa-4bc207d2fa13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:37.537356 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402bad85-3358-4edd-9aaa-4bc207d2fa13 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:37.537795 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402bad85-3358-4edd-9aaa-4bc207d2fa13 admin admin] PATH_INFO: `/v3/projects/46d7bd9177ce4ba3950250c6c8a7e6b9` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:37.544007 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402bad85-3358-4edd-9aaa-4bc207d2fa13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=46d7bd9177ce4ba3950250c6c8a7e6b9)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:37.558373 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402bad85-3358-4edd-9aaa-4bc207d2fa13 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:37.667461 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-402bad85-3358-4edd-9aaa-4bc207d2fa13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46d7bd9177ce4ba3950250c6c8a7e6b9', 'request_id': 'req-402bad85-3358-4edd-9aaa-4bc207d2fa13'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:35:37.685189 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-402bad85-3358-4edd-9aaa-4bc207d2fa13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46d7bd9177ce4ba3950250c6c8a7e6b9', 'request_id': 'req-402bad85-3358-4edd-9aaa-4bc207d2fa13'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:35:37.706690 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-402bad85-3358-4edd-9aaa-4bc207d2fa13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46d7bd9177ce4ba3950250c6c8a7e6b9', 'request_id': 'req-402bad85-3358-4edd-9aaa-4bc207d2fa13'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:35:37.755816 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3af83a0-aefa-4c91-b884-d10d56f862f7 None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:37.756112 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3af83a0-aefa-4c91-b884-d10d56f862f7 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:37.756431 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3af83a0-aefa-4c91-b884-d10d56f862f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:37.760383 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-402bad85-3358-4edd-9aaa-4bc207d2fa13 admin admin] The token cache is being invalidate because project 46d7bd9177ce4ba3950250c6c8a7e6b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79121) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 25 02:35:37.760845 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-402bad85-3358-4edd-9aaa-4bc207d2fa13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:35:37.761718 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-402bad85-3358-4edd-9aaa-4bc207d2fa13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:35:37.763728 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 876/1748] 10.222.0.117 () {58 vars in 1237 bytes} [Tue Jan 25 02:35:37 2022] DELETE /identity/v3/projects/46d7bd9177ce4ba3950250c6c8a7e6b9 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:35:37.771199 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59c6e39-ad66-4ac2-9e97-1e43ccfb4c5d None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:37.771507 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59c6e39-ad66-4ac2-9e97-1e43ccfb4c5d None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:37.771796 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59c6e39-ad66-4ac2-9e97-1e43ccfb4c5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:37.782880 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-a3af83a0-aefa-4c91-b884-d10d56f862f7 None None] MFA Rules not processed for user `a366d243b91b479cac0fa7f3238cbafa`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:35:37.784140 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-a3af83a0-aefa-4c91-b884-d10d56f862f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:35:37.809314 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-e59c6e39-ad66-4ac2-9e97-1e43ccfb4c5d None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:35:37.810993 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-e59c6e39-ad66-4ac2-9e97-1e43ccfb4c5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:35:37.855745 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 873/1749] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:35:37 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:35:37.984137 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 877/1750] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:35:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:35:37.992673 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccdaa3c-4da0-4a66-8eaf-e1bdd12023bd None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:37.993296 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccdaa3c-4da0-4a66-8eaf-e1bdd12023bd None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:37.993776 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccdaa3c-4da0-4a66-8eaf-e1bdd12023bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:38.026280 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-7ccdaa3c-4da0-4a66-8eaf-e1bdd12023bd None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:35:38.028638 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-7ccdaa3c-4da0-4a66-8eaf-e1bdd12023bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:35:38.039007 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 874/1751] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:35:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:35:38.042538 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59c6e39-ad66-4ac2-9e97-1e43ccfb4c5d None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:38.052502 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59c6e39-ad66-4ac2-9e97-1e43ccfb4c5d None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:38.057448 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa395a1-6dcd-4907-a675-20167ba4b114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:38.058247 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa395a1-6dcd-4907-a675-20167ba4b114 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:38.058536 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa395a1-6dcd-4907-a675-20167ba4b114 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:38.059149 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa395a1-6dcd-4907-a675-20167ba4b114 admin admin] PATH_INFO: `/v3/domains` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:38.060359 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa395a1-6dcd-4907-a675-20167ba4b114 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:35:38.060359 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa395a1-6dcd-4907-a675-20167ba4b114 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:38.061982 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa395a1-6dcd-4907-a675-20167ba4b114 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:38.078684 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 878/1752] 10.222.0.117 () {58 vars in 1157 bytes} [Tue Jan 25 02:35:38 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:35:38.082697 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccdaa3c-4da0-4a66-8eaf-e1bdd12023bd None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:38.092735 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccdaa3c-4da0-4a66-8eaf-e1bdd12023bd None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:38.097418 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2755cec0-d009-4d3c-8058-74e328569755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:38.098083 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2755cec0-d009-4d3c-8058-74e328569755 admin admin] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:38.098365 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2755cec0-d009-4d3c-8058-74e328569755 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:38.098646 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2755cec0-d009-4d3c-8058-74e328569755 admin admin] PATH_INFO: `/v3/projects` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:38.099369 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2755cec0-d009-4d3c-8058-74e328569755 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:38.101673 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2755cec0-d009-4d3c-8058-74e328569755 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:38.136604 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 875/1753] 10.222.0.117 () {60 vars in 1157 bytes} [Tue Jan 25 02:35:38 2022] POST /identity/v3/projects => generated 374 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 25 02:35:38.138728 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa395a1-6dcd-4907-a675-20167ba4b114 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:38.154880 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa395a1-6dcd-4907-a675-20167ba4b114 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:38.237329 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6d0193-b995-49fa-bdd9-21be501ab834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:38.238505 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6d0193-b995-49fa-bdd9-21be501ab834 admin admin] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:38.238826 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6d0193-b995-49fa-bdd9-21be501ab834 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:38.239140 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6d0193-b995-49fa-bdd9-21be501ab834 admin admin] PATH_INFO: `/v3/users` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:38.240106 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6d0193-b995-49fa-bdd9-21be501ab834 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:38.243276 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6d0193-b995-49fa-bdd9-21be501ab834 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:38.269661 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 879/1754] 10.222.0.117 () {60 vars in 1148 bytes} [Tue Jan 25 02:35:38 2022] POST /identity/v3/users => generated 288 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 02:35:38.274795 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2755cec0-d009-4d3c-8058-74e328569755 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:38.285985 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2755cec0-d009-4d3c-8058-74e328569755 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:38.291919 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d1ec7d-c9a8-4715-b729-3c1e357e5cd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:38.292597 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d1ec7d-c9a8-4715-b729-3c1e357e5cd9 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:38.292875 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d1ec7d-c9a8-4715-b729-3c1e357e5cd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:38.293147 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d1ec7d-c9a8-4715-b729-3c1e357e5cd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:38.293903 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d1ec7d-c9a8-4715-b729-3c1e357e5cd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:38.296162 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d1ec7d-c9a8-4715-b729-3c1e357e5cd9 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:38.319863 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 876/1755] 10.222.0.117 () {58 vars in 1126 bytes} [Tue Jan 25 02:35:38 2022] GET /identity/v3/roles => generated 1427 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 25 02:35:38.321965 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6d0193-b995-49fa-bdd9-21be501ab834 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:38.333138 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6d0193-b995-49fa-bdd9-21be501ab834 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:38.343645 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16acfeec-6be1-49e6-a61a-c70bc93567b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:38.344459 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16acfeec-6be1-49e6-a61a-c70bc93567b5 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:38.344748 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16acfeec-6be1-49e6-a61a-c70bc93567b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:38.345908 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16acfeec-6be1-49e6-a61a-c70bc93567b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:38.346697 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16acfeec-6be1-49e6-a61a-c70bc93567b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:38.348747 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16acfeec-6be1-49e6-a61a-c70bc93567b5 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:38.361579 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 880/1756] 10.222.0.117 () {58 vars in 1126 bytes} [Tue Jan 25 02:35:38 2022] GET /identity/v3/roles => generated 1427 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 02:35:38.365935 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d1ec7d-c9a8-4715-b729-3c1e357e5cd9 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:38.377948 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d1ec7d-c9a8-4715-b729-3c1e357e5cd9 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:38.383006 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd21c99-6008-4f2b-908e-d1087f58e2df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:38.384059 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd21c99-6008-4f2b-908e-d1087f58e2df admin admin] REQUEST_METHOD: `PUT` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:38.384342 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd21c99-6008-4f2b-908e-d1087f58e2df admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:38.384616 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd21c99-6008-4f2b-908e-d1087f58e2df admin admin] PATH_INFO: `/v3/projects/3527f1c56c474c1297106b524103f41b/users/0637539320dc4e01b5a56ddac980ca14/roles/33a8e87420ed423f9cb29e0084eab5d2` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:38.402195 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd21c99-6008-4f2b-908e-d1087f58e2df admin admin] RBAC: Authorizing `identity:create_grant(project_id=3527f1c56c474c1297106b524103f41b, user_id=0637539320dc4e01b5a56ddac980ca14, role_id=33a8e87420ed423f9cb29e0084eab5d2)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:38.404765 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd21c99-6008-4f2b-908e-d1087f58e2df admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:38.422650 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 877/1757] 10.222.0.117 () {60 vars in 1487 bytes} [Tue Jan 25 02:35:38 2022] PUT /identity/v3/projects/3527f1c56c474c1297106b524103f41b/users/0637539320dc4e01b5a56ddac980ca14/roles/33a8e87420ed423f9cb29e0084eab5d2 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:35:38.429456 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f19e3c-ba03-4b65-a790-d91f73d89cc1 None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:38.430143 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f19e3c-ba03-4b65-a790-d91f73d89cc1 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:38.430369 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f19e3c-ba03-4b65-a790-d91f73d89cc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:38.452793 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-69f19e3c-ba03-4b65-a790-d91f73d89cc1 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:35:38.454058 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-69f19e3c-ba03-4b65-a790-d91f73d89cc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:35:38.552674 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 881/1758] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:35:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:35:38.566275 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd21c99-6008-4f2b-908e-d1087f58e2df admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:38.568150 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-abd21c99-6008-4f2b-908e-d1087f58e2df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:35:38.660304 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd21c99-6008-4f2b-908e-d1087f58e2df admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:38.664485 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ffd48a-a278-4721-a207-506292853cef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca4071c5f8f4a31b5edb81fa66a43a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:38.665162 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ffd48a-a278-4721-a207-506292853cef service neutron] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:38.665446 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ffd48a-a278-4721-a207-506292853cef service neutron] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:38.665726 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ffd48a-a278-4721-a207-506292853cef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:38.676980 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ffd48a-a278-4721-a207-506292853cef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:38.678604 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ffd48a-a278-4721-a207-506292853cef service neutron] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:38.699467 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 878/1759] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:35:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:35:40.032312 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f3ada7-4515-47b9-bb88-0af69837ca2e None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:40.032758 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f3ada7-4515-47b9-bb88-0af69837ca2e None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:40.032921 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f3ada7-4515-47b9-bb88-0af69837ca2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:40.157260 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-c7f3ada7-4515-47b9-bb88-0af69837ca2e None None] MFA Rules not processed for user `0637539320dc4e01b5a56ddac980ca14`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:35:40.167432 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-c7f3ada7-4515-47b9-bb88-0af69837ca2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:35:40.244553 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd264084-9e7e-49f6-9b8a-e59ddaf3ef5c None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:40.245585 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd264084-9e7e-49f6-9b8a-e59ddaf3ef5c None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:40.246639 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd264084-9e7e-49f6-9b8a-e59ddaf3ef5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:40.268982 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-bd264084-9e7e-49f6-9b8a-e59ddaf3ef5c None None] MFA Rules not processed for user `5924414ee6e948a680b8b75c8797b466`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:35:40.270519 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-bd264084-9e7e-49f6-9b8a-e59ddaf3ef5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:35:40.318379 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 882/1760] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:35:40 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:35:40.323006 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f3ada7-4515-47b9-bb88-0af69837ca2e None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:40.335997 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f3ada7-4515-47b9-bb88-0af69837ca2e None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:40.341665 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6dbe30-45ad-48ad-8cc2-3e5058e02dd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:40.342609 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6dbe30-45ad-48ad-8cc2-3e5058e02dd0 admin admin] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:40.343077 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6dbe30-45ad-48ad-8cc2-3e5058e02dd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:40.343555 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6dbe30-45ad-48ad-8cc2-3e5058e02dd0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:40.344316 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6dbe30-45ad-48ad-8cc2-3e5058e02dd0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:40.346411 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6dbe30-45ad-48ad-8cc2-3e5058e02dd0 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:40.373176 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 879/1761] 10.222.0.117 () {58 vars in 1014 bytes} [Tue Jan 25 02:35:40 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 25 02:35:40.385161 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 883/1762] 10.222.0.117 () {60 vars in 1157 bytes} [Tue Jan 25 02:35:40 2022] POST /identity/v3/projects => generated 374 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 25 02:35:40.385717 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd264084-9e7e-49f6-9b8a-e59ddaf3ef5c None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:40.404197 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd264084-9e7e-49f6-9b8a-e59ddaf3ef5c None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:40.512071 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f601e4b0-4b01-4b3a-8f22-8c08174c23d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:40.513126 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f601e4b0-4b01-4b3a-8f22-8c08174c23d6 admin admin] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:40.513595 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f601e4b0-4b01-4b3a-8f22-8c08174c23d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:40.514068 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f601e4b0-4b01-4b3a-8f22-8c08174c23d6 admin admin] PATH_INFO: `/v3/users` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:40.515685 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f601e4b0-4b01-4b3a-8f22-8c08174c23d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:40.517862 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f601e4b0-4b01-4b3a-8f22-8c08174c23d6 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:40.551434 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6dbe30-45ad-48ad-8cc2-3e5058e02dd0 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:40.554914 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 880/1763] 10.222.0.117 () {60 vars in 1148 bytes} [Tue Jan 25 02:35:40 2022] POST /identity/v3/users => generated 294 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 02:35:40.565153 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6dbe30-45ad-48ad-8cc2-3e5058e02dd0 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:40.574186 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66419f6-f3d3-4919-838e-a7d108e5026b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:40.575366 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66419f6-f3d3-4919-838e-a7d108e5026b admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:40.575743 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66419f6-f3d3-4919-838e-a7d108e5026b admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:40.576171 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66419f6-f3d3-4919-838e-a7d108e5026b admin admin] PATH_INFO: `/v3/roles` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:40.577604 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66419f6-f3d3-4919-838e-a7d108e5026b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:40.579555 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66419f6-f3d3-4919-838e-a7d108e5026b admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:40.591809 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f601e4b0-4b01-4b3a-8f22-8c08174c23d6 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:40.593722 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-f601e4b0-4b01-4b3a-8f22-8c08174c23d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:35:40.608205 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 884/1764] 10.222.0.117 () {58 vars in 1126 bytes} [Tue Jan 25 02:35:40 2022] GET /identity/v3/roles => generated 1427 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 02:35:40.612696 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66419f6-f3d3-4919-838e-a7d108e5026b admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:40.625583 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66419f6-f3d3-4919-838e-a7d108e5026b admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:40.633999 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d27d603-a960-4546-a8d3-c54d16117481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:40.635277 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d27d603-a960-4546-a8d3-c54d16117481 admin admin] REQUEST_METHOD: `PUT` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:40.636024 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d27d603-a960-4546-a8d3-c54d16117481 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:40.636752 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d27d603-a960-4546-a8d3-c54d16117481 admin admin] PATH_INFO: `/v3/projects/ef5be3473eb744df9d9b4779e46297f1/users/68a82b6bf8254535a369d5836ee54190/roles/d8dbc6d83d9d41d28c3feb8b3485b291` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:40.661007 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d27d603-a960-4546-a8d3-c54d16117481 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef5be3473eb744df9d9b4779e46297f1, user_id=68a82b6bf8254535a369d5836ee54190, role_id=d8dbc6d83d9d41d28c3feb8b3485b291)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:40.684001 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d27d603-a960-4546-a8d3-c54d16117481 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:40.708521 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f601e4b0-4b01-4b3a-8f22-8c08174c23d6 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:40.712809 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 885/1765] 10.222.0.117 () {60 vars in 1487 bytes} [Tue Jan 25 02:35:40 2022] PUT /identity/v3/projects/ef5be3473eb744df9d9b4779e46297f1/users/68a82b6bf8254535a369d5836ee54190/roles/d8dbc6d83d9d41d28c3feb8b3485b291 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 25 02:35:40.716575 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d27d603-a960-4546-a8d3-c54d16117481 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:40.805771 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0732754-5bc8-47bf-b750-718b0c5c4022 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100f12ee56754f1c859106bf3e473df6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:40.806834 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0732754-5bc8-47bf-b750-718b0c5c4022 service swift] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:40.807194 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0732754-5bc8-47bf-b750-718b0c5c4022 service swift] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:40.807542 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0732754-5bc8-47bf-b750-718b0c5c4022 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:40.850659 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d27d603-a960-4546-a8d3-c54d16117481 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:40.857336 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520210c9-3c61-4f92-8a60-1aeb26cf1f2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:40.858338 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520210c9-3c61-4f92-8a60-1aeb26cf1f2b admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:40.858635 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520210c9-3c61-4f92-8a60-1aeb26cf1f2b admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:40.860099 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520210c9-3c61-4f92-8a60-1aeb26cf1f2b admin admin] PATH_INFO: `/v3/roles` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:40.860510 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520210c9-3c61-4f92-8a60-1aeb26cf1f2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:40.862312 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520210c9-3c61-4f92-8a60-1aeb26cf1f2b admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:40.888648 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0732754-5bc8-47bf-b750-718b0c5c4022 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:40.893878 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 886/1766] 10.222.0.117 () {58 vars in 1126 bytes} [Tue Jan 25 02:35:40 2022] GET /identity/v3/roles => generated 1427 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 25 02:35:40.894819 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0732754-5bc8-47bf-b750-718b0c5c4022 service swift] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:40.895508 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520210c9-3c61-4f92-8a60-1aeb26cf1f2b admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:40.910061 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520210c9-3c61-4f92-8a60-1aeb26cf1f2b admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:40.914833 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 881/1767] 10.222.0.117 () {60 vars in 1389 bytes} [Tue Jan 25 02:35:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 25 02:35:40.931166 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28edc9f5-9bd2-4e85-9786-04f19a27559e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:40.932406 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28edc9f5-9bd2-4e85-9786-04f19a27559e admin admin] REQUEST_METHOD: `PUT` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:40.932917 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28edc9f5-9bd2-4e85-9786-04f19a27559e admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:40.933529 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28edc9f5-9bd2-4e85-9786-04f19a27559e admin admin] PATH_INFO: `/v3/projects/ef5be3473eb744df9d9b4779e46297f1/users/68a82b6bf8254535a369d5836ee54190/roles/d8dbc6d83d9d41d28c3feb8b3485b291` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:40.936666 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28edc9f5-9bd2-4e85-9786-04f19a27559e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef5be3473eb744df9d9b4779e46297f1, user_id=68a82b6bf8254535a369d5836ee54190, role_id=d8dbc6d83d9d41d28c3feb8b3485b291)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:40.980737 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28edc9f5-9bd2-4e85-9786-04f19a27559e admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:41.027282 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 887/1768] 10.222.0.117 () {60 vars in 1487 bytes} [Tue Jan 25 02:35:40 2022] PUT /identity/v3/projects/ef5be3473eb744df9d9b4779e46297f1/users/68a82b6bf8254535a369d5836ee54190/roles/d8dbc6d83d9d41d28c3feb8b3485b291 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:35:42.614762 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0732754-5bc8-47bf-b750-718b0c5c4022 service swift] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:42.617554 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-d0732754-5bc8-47bf-b750-718b0c5c4022 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:35:42.683606 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0732754-5bc8-47bf-b750-718b0c5c4022 service swift] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:42.824979 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc32801b-125a-414f-8274-285000cf17f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:42.826533 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc32801b-125a-414f-8274-285000cf17f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:42.826533 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc32801b-125a-414f-8274-285000cf17f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:42.826533 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc32801b-125a-414f-8274-285000cf17f9 admin admin] PATH_INFO: `/v3/users/9283ac3af88a4b908355467a35b52871` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:42.828115 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc32801b-125a-414f-8274-285000cf17f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9283ac3af88a4b908355467a35b52871)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:42.830254 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc32801b-125a-414f-8274-285000cf17f9 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:42.973249 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-fc32801b-125a-414f-8274-285000cf17f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9283ac3af88a4b908355467a35b52871'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:35:43.002058 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-fc32801b-125a-414f-8274-285000cf17f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9283ac3af88a4b908355467a35b52871'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:35:43.002684 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-fc32801b-125a-414f-8274-285000cf17f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9283ac3af88a4b908355467a35b52871'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:35:43.003451 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-fc32801b-125a-414f-8274-285000cf17f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9283ac3af88a4b908355467a35b52871'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:35:43.011085 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1652b795-7fc2-4553-9e90-69e149f0b424 None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:43.012037 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1652b795-7fc2-4553-9e90-69e149f0b424 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:43.012477 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1652b795-7fc2-4553-9e90-69e149f0b424 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:43.031332 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-fc32801b-125a-414f-8274-285000cf17f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9283ac3af88a4b908355467a35b52871'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:35:43.084681 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-1652b795-7fc2-4553-9e90-69e149f0b424 None None] MFA Rules not processed for user `9ca4071c5f8f4a31b5edb81fa66a43a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:35:43.086169 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-1652b795-7fc2-4553-9e90-69e149f0b424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:35:43.087403 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 882/1769] 10.222.0.117 () {58 vars in 1228 bytes} [Tue Jan 25 02:35:42 2022] DELETE /identity/v3/users/9283ac3af88a4b908355467a35b52871 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:35:43.091950 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bacb5e8-37aa-4e90-925e-4db21ce1fdd8 None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:43.092220 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bacb5e8-37aa-4e90-925e-4db21ce1fdd8 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:43.092499 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bacb5e8-37aa-4e90-925e-4db21ce1fdd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:43.136163 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-2bacb5e8-37aa-4e90-925e-4db21ce1fdd8 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:35:43.137052 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-2bacb5e8-37aa-4e90-925e-4db21ce1fdd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:35:43.313828 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 888/1770] 10.222.0.121 () {58 vars in 1020 bytes} [Tue Jan 25 02:35:43 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 25 02:35:43.330242 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1652b795-7fc2-4553-9e90-69e149f0b424 None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:43.332148 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-1652b795-7fc2-4553-9e90-69e149f0b424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:35:43.361273 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 883/1771] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:35:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:35:43.363683 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bacb5e8-37aa-4e90-925e-4db21ce1fdd8 None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:43.366515 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-2bacb5e8-37aa-4e90-925e-4db21ce1fdd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:35:43.411710 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bacb5e8-37aa-4e90-925e-4db21ce1fdd8 None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:43.420989 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103d19c7-6397-48ee-b2ef-7f0bf95ef5e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca4071c5f8f4a31b5edb81fa66a43a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:43.423046 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103d19c7-6397-48ee-b2ef-7f0bf95ef5e8 service neutron] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:43.424272 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103d19c7-6397-48ee-b2ef-7f0bf95ef5e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:43.424577 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103d19c7-6397-48ee-b2ef-7f0bf95ef5e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:43.454503 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103d19c7-6397-48ee-b2ef-7f0bf95ef5e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:43.458668 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103d19c7-6397-48ee-b2ef-7f0bf95ef5e8 service neutron] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:43.486687 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 884/1772] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:35:43 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:35:43.487580 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103d19c7-6397-48ee-b2ef-7f0bf95ef5e8 service neutron] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:43.497324 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-103d19c7-6397-48ee-b2ef-7f0bf95ef5e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:35:43.520675 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103d19c7-6397-48ee-b2ef-7f0bf95ef5e8 service neutron] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:43.526796 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205ae6da-d3f4-47a2-8cbd-fb350fbc2591 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca4071c5f8f4a31b5edb81fa66a43a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:43.528049 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205ae6da-d3f4-47a2-8cbd-fb350fbc2591 service neutron] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:43.528622 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205ae6da-d3f4-47a2-8cbd-fb350fbc2591 service neutron] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:43.529149 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205ae6da-d3f4-47a2-8cbd-fb350fbc2591 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:43.533245 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1652b795-7fc2-4553-9e90-69e149f0b424 None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:43.543204 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205ae6da-d3f4-47a2-8cbd-fb350fbc2591 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:43.544913 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205ae6da-d3f4-47a2-8cbd-fb350fbc2591 service neutron] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:43.548520 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf65ab60-d233-488b-968d-1b9d4f445779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:43.559481 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 885/1773] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:35:43 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:35:43.560436 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205ae6da-d3f4-47a2-8cbd-fb350fbc2591 service neutron] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:43.562453 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-205ae6da-d3f4-47a2-8cbd-fb350fbc2591 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:35:43.565365 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf65ab60-d233-488b-968d-1b9d4f445779 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:43.565871 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf65ab60-d233-488b-968d-1b9d4f445779 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:43.567265 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf65ab60-d233-488b-968d-1b9d4f445779 admin admin] PATH_INFO: `/v3/users/dccf7cdc56b6472c923290df90b69700` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:43.571861 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf65ab60-d233-488b-968d-1b9d4f445779 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dccf7cdc56b6472c923290df90b69700)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:43.574020 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf65ab60-d233-488b-968d-1b9d4f445779 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:43.622835 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205ae6da-d3f4-47a2-8cbd-fb350fbc2591 service neutron] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:43.637906 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d2a95c-930f-4940-b246-2f32e04cffdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:43.642078 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d2a95c-930f-4940-b246-2f32e04cffdd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:43.643217 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d2a95c-930f-4940-b246-2f32e04cffdd admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:43.644062 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d2a95c-930f-4940-b246-2f32e04cffdd admin admin] PATH_INFO: `/v3/users/ca66a843be8348f1a8b7e4c1c113895b` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:43.649123 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d2a95c-930f-4940-b246-2f32e04cffdd admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca66a843be8348f1a8b7e4c1c113895b)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:43.656154 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d2a95c-930f-4940-b246-2f32e04cffdd admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:43.664093 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-cf65ab60-d233-488b-968d-1b9d4f445779 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dccf7cdc56b6472c923290df90b69700'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:35:43.667760 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-cf65ab60-d233-488b-968d-1b9d4f445779 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dccf7cdc56b6472c923290df90b69700'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:35:43.691026 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-cf65ab60-d233-488b-968d-1b9d4f445779 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dccf7cdc56b6472c923290df90b69700'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:35:43.691685 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-cf65ab60-d233-488b-968d-1b9d4f445779 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dccf7cdc56b6472c923290df90b69700'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:35:43.710494 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-cf65ab60-d233-488b-968d-1b9d4f445779 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dccf7cdc56b6472c923290df90b69700'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:35:43.759252 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 889/1774] 10.222.0.117 () {58 vars in 1228 bytes} [Tue Jan 25 02:35:43 2022] DELETE /identity/v3/users/dccf7cdc56b6472c923290df90b69700 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:35:43.763055 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf65ab60-d233-488b-968d-1b9d4f445779 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:43.764558 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-cf65ab60-d233-488b-968d-1b9d4f445779 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:35:43.777488 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-b8d2a95c-930f-4940-b246-2f32e04cffdd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca66a843be8348f1a8b7e4c1c113895b'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:35:43.799517 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-b8d2a95c-930f-4940-b246-2f32e04cffdd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca66a843be8348f1a8b7e4c1c113895b'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:35:43.800874 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-b8d2a95c-930f-4940-b246-2f32e04cffdd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca66a843be8348f1a8b7e4c1c113895b'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:35:43.802835 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-b8d2a95c-930f-4940-b246-2f32e04cffdd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca66a843be8348f1a8b7e4c1c113895b'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:35:43.826001 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-b8d2a95c-930f-4940-b246-2f32e04cffdd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca66a843be8348f1a8b7e4c1c113895b'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:35:43.864262 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 886/1775] 10.222.0.117 () {58 vars in 1228 bytes} [Tue Jan 25 02:35:43 2022] DELETE /identity/v3/users/ca66a843be8348f1a8b7e4c1c113895b => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:35:43.869555 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819cf9fa-643d-46cb-837f-aad3e0ea824e None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:43.870157 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819cf9fa-643d-46cb-837f-aad3e0ea824e None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:43.871549 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819cf9fa-643d-46cb-837f-aad3e0ea824e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:43.890878 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf65ab60-d233-488b-968d-1b9d4f445779 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:43.948532 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-819cf9fa-643d-46cb-837f-aad3e0ea824e None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:35:43.950124 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-819cf9fa-643d-46cb-837f-aad3e0ea824e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:35:44.016533 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca6678c-2111-4064-9789-ad0e7f1ec2f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca4071c5f8f4a31b5edb81fa66a43a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:44.017984 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca6678c-2111-4064-9789-ad0e7f1ec2f5 service neutron] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:44.018618 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca6678c-2111-4064-9789-ad0e7f1ec2f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:44.019101 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca6678c-2111-4064-9789-ad0e7f1ec2f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:44.021928 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-bca6678c-2111-4064-9789-ad0e7f1ec2f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:35:44.082301 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 887/1776] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:35:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:35:44.083770 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd5e823-d896-4756-ae68-80f507111f27 None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:44.084333 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd5e823-d896-4756-ae68-80f507111f27 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:44.084661 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd5e823-d896-4756-ae68-80f507111f27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:44.120384 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-acd5e823-d896-4756-ae68-80f507111f27 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:35:44.121657 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-acd5e823-d896-4756-ae68-80f507111f27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:35:44.142254 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 888/1777] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:35:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:35:44.166286 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca6678c-2111-4064-9789-ad0e7f1ec2f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:44.167801 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca6678c-2111-4064-9789-ad0e7f1ec2f5 service neutron] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:44.179198 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 890/1778] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:35:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:35:44.186983 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd5e823-d896-4756-ae68-80f507111f27 None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:44.188563 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-acd5e823-d896-4756-ae68-80f507111f27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:35:44.214386 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd5e823-d896-4756-ae68-80f507111f27 None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:44.219670 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca6678c-2111-4064-9789-ad0e7f1ec2f5 service neutron] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:44.221194 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-bca6678c-2111-4064-9789-ad0e7f1ec2f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:35:44.226973 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d383fbab-fd83-4b65-bb88-3d360c85acfb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca4071c5f8f4a31b5edb81fa66a43a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:44.228092 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d383fbab-fd83-4b65-bb88-3d360c85acfb service neutron] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:44.228502 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d383fbab-fd83-4b65-bb88-3d360c85acfb service neutron] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:44.229032 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d383fbab-fd83-4b65-bb88-3d360c85acfb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:44.240852 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca6678c-2111-4064-9789-ad0e7f1ec2f5 service neutron] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:44.248747 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d383fbab-fd83-4b65-bb88-3d360c85acfb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:44.251786 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d383fbab-fd83-4b65-bb88-3d360c85acfb service neutron] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:44.269545 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 889/1779] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:35:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:35:44.274155 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640fd4ff-890b-4181-973c-54a99b7d400f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca4071c5f8f4a31b5edb81fa66a43a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:44.274832 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640fd4ff-890b-4181-973c-54a99b7d400f service neutron] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:44.275121 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640fd4ff-890b-4181-973c-54a99b7d400f service neutron] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:44.275393 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640fd4ff-890b-4181-973c-54a99b7d400f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:44.286300 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640fd4ff-890b-4181-973c-54a99b7d400f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:44.288710 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640fd4ff-890b-4181-973c-54a99b7d400f service neutron] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:44.310435 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 891/1780] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:35:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 25 02:35:45.648707 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d383fbab-fd83-4b65-bb88-3d360c85acfb service neutron] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:45.660876 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-d383fbab-fd83-4b65-bb88-3d360c85acfb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:35:45.708125 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d383fbab-fd83-4b65-bb88-3d360c85acfb service neutron] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:45.717436 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001fdeca-2b9b-4702-89f1-31c191d90f9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:45.720112 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001fdeca-2b9b-4702-89f1-31c191d90f9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:45.721980 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001fdeca-2b9b-4702-89f1-31c191d90f9c admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:45.723295 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001fdeca-2b9b-4702-89f1-31c191d90f9c admin admin] PATH_INFO: `/v3/projects/339f4b4d625941c1ac41f27a8bcef577` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:45.726209 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001fdeca-2b9b-4702-89f1-31c191d90f9c admin admin] RBAC: Authorizing `identity:delete_project(project_id=339f4b4d625941c1ac41f27a8bcef577)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:45.728465 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001fdeca-2b9b-4702-89f1-31c191d90f9c admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:45.885180 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-001fdeca-2b9b-4702-89f1-31c191d90f9c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '339f4b4d625941c1ac41f27a8bcef577', 'request_id': 'req-001fdeca-2b9b-4702-89f1-31c191d90f9c'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:35:45.905768 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-001fdeca-2b9b-4702-89f1-31c191d90f9c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '339f4b4d625941c1ac41f27a8bcef577', 'request_id': 'req-001fdeca-2b9b-4702-89f1-31c191d90f9c'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:35:45.917037 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-001fdeca-2b9b-4702-89f1-31c191d90f9c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '339f4b4d625941c1ac41f27a8bcef577', 'request_id': 'req-001fdeca-2b9b-4702-89f1-31c191d90f9c'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:35:45.965440 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-001fdeca-2b9b-4702-89f1-31c191d90f9c admin admin] The token cache is being invalidate because project 339f4b4d625941c1ac41f27a8bcef577 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79120) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 25 02:35:45.967632 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-001fdeca-2b9b-4702-89f1-31c191d90f9c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:35:45.969424 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-001fdeca-2b9b-4702-89f1-31c191d90f9c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:35:45.977311 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 890/1781] 10.222.0.117 () {58 vars in 1237 bytes} [Tue Jan 25 02:35:45 2022] DELETE /identity/v3/projects/339f4b4d625941c1ac41f27a8bcef577 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:35:45.981051 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640fd4ff-890b-4181-973c-54a99b7d400f service neutron] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:45.991175 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640fd4ff-890b-4181-973c-54a99b7d400f service neutron] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:46.059545 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fdf4fc-9d5f-4109-ba4a-f706ff597408 None None] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:46.061399 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fdf4fc-9d5f-4109-ba4a-f706ff597408 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:46.062263 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fdf4fc-9d5f-4109-ba4a-f706ff597408 None None] PATH_INFO: `/` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:46.068135 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 891/1782] 10.222.0.117 () {54 vars in 926 bytes} [Tue Jan 25 02:35:46 2022] GET /identity => generated 271 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:35:46.093293 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24593bf3-54ed-4a66-9c57-1b1a4b3c6982 None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:46.093531 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24593bf3-54ed-4a66-9c57-1b1a4b3c6982 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:46.093825 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24593bf3-54ed-4a66-9c57-1b1a4b3c6982 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:46.135645 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-24593bf3-54ed-4a66-9c57-1b1a4b3c6982 None None] MFA Rules not processed for user `d9ad6269900346458050063c12cac299`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:35:46.137159 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-24593bf3-54ed-4a66-9c57-1b1a4b3c6982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:35:46.138528 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208fee10-7a71-4afc-9148-e7a7bfaaebf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:46.139729 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208fee10-7a71-4afc-9148-e7a7bfaaebf4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:46.140242 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208fee10-7a71-4afc-9148-e7a7bfaaebf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:46.140732 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208fee10-7a71-4afc-9148-e7a7bfaaebf4 admin admin] PATH_INFO: `/v3/users/a251cf3310fd49739fb6106cf62c36b9` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:46.142239 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208fee10-7a71-4afc-9148-e7a7bfaaebf4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a251cf3310fd49739fb6106cf62c36b9)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:46.145278 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208fee10-7a71-4afc-9148-e7a7bfaaebf4 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:46.218512 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-208fee10-7a71-4afc-9148-e7a7bfaaebf4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a251cf3310fd49739fb6106cf62c36b9'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:35:46.219195 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-208fee10-7a71-4afc-9148-e7a7bfaaebf4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a251cf3310fd49739fb6106cf62c36b9'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:35:46.228513 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-208fee10-7a71-4afc-9148-e7a7bfaaebf4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a251cf3310fd49739fb6106cf62c36b9'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:35:46.229957 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-208fee10-7a71-4afc-9148-e7a7bfaaebf4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a251cf3310fd49739fb6106cf62c36b9'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:35:46.240550 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-208fee10-7a71-4afc-9148-e7a7bfaaebf4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a251cf3310fd49739fb6106cf62c36b9'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:35:46.283000 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 892/1783] 10.222.0.117 () {58 vars in 1228 bytes} [Tue Jan 25 02:35:45 2022] DELETE /identity/v3/users/a251cf3310fd49739fb6106cf62c36b9 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:35:46.319893 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 892/1784] 10.222.0.117 () {58 vars in 1023 bytes} [Tue Jan 25 02:35:46 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:35:46.895626 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208fee10-7a71-4afc-9148-e7a7bfaaebf4 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:46.897408 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-208fee10-7a71-4afc-9148-e7a7bfaaebf4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:35:46.903856 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24593bf3-54ed-4a66-9c57-1b1a4b3c6982 None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:46.905419 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-24593bf3-54ed-4a66-9c57-1b1a4b3c6982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:35:46.948777 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24593bf3-54ed-4a66-9c57-1b1a4b3c6982 None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:47.139974 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8b16ff-c459-4399-a508-b6d4618d1489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:47.141129 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8b16ff-c459-4399-a508-b6d4618d1489 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:47.141421 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8b16ff-c459-4399-a508-b6d4618d1489 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:47.141700 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8b16ff-c459-4399-a508-b6d4618d1489 admin admin] PATH_INFO: `/v3/projects/ad779fdd393a496c8ba005741bbb7381` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:47.144862 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8b16ff-c459-4399-a508-b6d4618d1489 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad779fdd393a496c8ba005741bbb7381)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:47.146758 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8b16ff-c459-4399-a508-b6d4618d1489 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:47.155281 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208fee10-7a71-4afc-9148-e7a7bfaaebf4 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:47.172082 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e785de3e-4d8e-4040-9972-1f37985fa62f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9ad6269900346458050063c12cac299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:47.172754 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e785de3e-4d8e-4040-9972-1f37985fa62f service nova] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:47.173035 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e785de3e-4d8e-4040-9972-1f37985fa62f service nova] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:47.173310 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e785de3e-4d8e-4040-9972-1f37985fa62f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:47.202198 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e785de3e-4d8e-4040-9972-1f37985fa62f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:47.203942 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e785de3e-4d8e-4040-9972-1f37985fa62f service nova] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:47.236225 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 893/1785] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:35:46 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:35:47.267210 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-cd8b16ff-c459-4399-a508-b6d4618d1489 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad779fdd393a496c8ba005741bbb7381', 'request_id': 'req-cd8b16ff-c459-4399-a508-b6d4618d1489'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:35:47.277933 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-cd8b16ff-c459-4399-a508-b6d4618d1489 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad779fdd393a496c8ba005741bbb7381', 'request_id': 'req-cd8b16ff-c459-4399-a508-b6d4618d1489'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:35:47.289853 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-cd8b16ff-c459-4399-a508-b6d4618d1489 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad779fdd393a496c8ba005741bbb7381', 'request_id': 'req-cd8b16ff-c459-4399-a508-b6d4618d1489'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:35:47.314922 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-cd8b16ff-c459-4399-a508-b6d4618d1489 admin admin] The token cache is being invalidate because project ad779fdd393a496c8ba005741bbb7381 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79120) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 25 02:35:47.315226 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-cd8b16ff-c459-4399-a508-b6d4618d1489 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:35:47.320000 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-cd8b16ff-c459-4399-a508-b6d4618d1489 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:35:47.321708 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 893/1786] 10.222.0.117 () {58 vars in 1237 bytes} [Tue Jan 25 02:35:46 2022] DELETE /identity/v3/projects/ad779fdd393a496c8ba005741bbb7381 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:35:47.328404 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5236a4c5-291d-4449-8a74-4d42042930ae None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:47.329214 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5236a4c5-291d-4449-8a74-4d42042930ae None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:47.329214 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5236a4c5-291d-4449-8a74-4d42042930ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:47.369218 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-5236a4c5-291d-4449-8a74-4d42042930ae None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:35:47.370449 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-5236a4c5-291d-4449-8a74-4d42042930ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:35:47.575260 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 894/1787] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:35:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:35:47.580820 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0acc05f-1dfc-4fa8-9138-1b62ba71731d None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:47.581905 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0acc05f-1dfc-4fa8-9138-1b62ba71731d None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:47.587085 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0acc05f-1dfc-4fa8-9138-1b62ba71731d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:47.644764 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-f0acc05f-1dfc-4fa8-9138-1b62ba71731d None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:35:47.647979 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-f0acc05f-1dfc-4fa8-9138-1b62ba71731d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:35:47.675640 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 894/1788] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:35:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:35:47.680050 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5236a4c5-291d-4449-8a74-4d42042930ae None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:47.697100 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5236a4c5-291d-4449-8a74-4d42042930ae None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:47.702484 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68881cb-c579-4f4c-992a-26ebee9226e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:47.703227 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68881cb-c579-4f4c-992a-26ebee9226e3 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:47.703513 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68881cb-c579-4f4c-992a-26ebee9226e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:47.703810 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68881cb-c579-4f4c-992a-26ebee9226e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:47.704614 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68881cb-c579-4f4c-992a-26ebee9226e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:35:47.705296 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68881cb-c579-4f4c-992a-26ebee9226e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:47.707447 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68881cb-c579-4f4c-992a-26ebee9226e3 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:47.741295 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 895/1789] 10.222.0.117 () {58 vars in 1157 bytes} [Tue Jan 25 02:35:47 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:35:47.745922 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0acc05f-1dfc-4fa8-9138-1b62ba71731d None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:47.824478 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0acc05f-1dfc-4fa8-9138-1b62ba71731d None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:47.830905 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9f449d-dee4-4767-9fa6-fb133e58eae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:47.831945 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9f449d-dee4-4767-9fa6-fb133e58eae1 admin admin] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:47.832500 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9f449d-dee4-4767-9fa6-fb133e58eae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:47.832992 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9f449d-dee4-4767-9fa6-fb133e58eae1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:47.834111 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9f449d-dee4-4767-9fa6-fb133e58eae1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:47.837947 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9f449d-dee4-4767-9fa6-fb133e58eae1 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:47.908896 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 895/1790] 10.222.0.117 () {60 vars in 1157 bytes} [Tue Jan 25 02:35:47 2022] POST /identity/v3/projects => generated 366 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 02:35:47.909823 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68881cb-c579-4f4c-992a-26ebee9226e3 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:47.936182 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68881cb-c579-4f4c-992a-26ebee9226e3 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:48.079655 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dc4c02-2436-4c67-a38e-6c642d802e82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:48.080489 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dc4c02-2436-4c67-a38e-6c642d802e82 admin admin] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:48.080658 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dc4c02-2436-4c67-a38e-6c642d802e82 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:48.080921 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dc4c02-2436-4c67-a38e-6c642d802e82 admin admin] PATH_INFO: `/v3/users` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:48.081635 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dc4c02-2436-4c67-a38e-6c642d802e82 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:48.083746 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dc4c02-2436-4c67-a38e-6c642d802e82 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:48.125955 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 896/1791] 10.222.0.117 () {60 vars in 1148 bytes} [Tue Jan 25 02:35:47 2022] POST /identity/v3/users => generated 284 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 02:35:48.129733 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9f449d-dee4-4767-9fa6-fb133e58eae1 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:48.154127 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9f449d-dee4-4767-9fa6-fb133e58eae1 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:48.165630 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4319c535-5d33-427f-9075-c2790f1befd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:48.167660 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4319c535-5d33-427f-9075-c2790f1befd5 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:48.169129 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4319c535-5d33-427f-9075-c2790f1befd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:48.169713 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4319c535-5d33-427f-9075-c2790f1befd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:48.170853 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4319c535-5d33-427f-9075-c2790f1befd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:48.173301 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4319c535-5d33-427f-9075-c2790f1befd5 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:48.187524 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dc4c02-2436-4c67-a38e-6c642d802e82 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:48.189479 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-25dc4c02-2436-4c67-a38e-6c642d802e82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:35:48.200152 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 896/1792] 10.222.0.117 () {58 vars in 1126 bytes} [Tue Jan 25 02:35:48 2022] GET /identity/v3/roles => generated 1427 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 02:35:48.203890 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4319c535-5d33-427f-9075-c2790f1befd5 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:48.208156 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dc4c02-2436-4c67-a38e-6c642d802e82 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:48.214567 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101b8ae3-09cb-43fc-a115-fa74301e3533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:48.215127 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101b8ae3-09cb-43fc-a115-fa74301e3533 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:48.215455 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101b8ae3-09cb-43fc-a115-fa74301e3533 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:48.215706 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101b8ae3-09cb-43fc-a115-fa74301e3533 admin admin] PATH_INFO: `/v3/projects/77350c403d1f406fa35dd6be35350f42` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:48.216947 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101b8ae3-09cb-43fc-a115-fa74301e3533 admin admin] RBAC: Authorizing `identity:delete_project(project_id=77350c403d1f406fa35dd6be35350f42)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:48.219044 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101b8ae3-09cb-43fc-a115-fa74301e3533 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:48.221373 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4319c535-5d33-427f-9075-c2790f1befd5 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:48.228780 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f584a556-496b-408d-9896-61c9870d3dea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:48.230983 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f584a556-496b-408d-9896-61c9870d3dea admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:48.232529 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f584a556-496b-408d-9896-61c9870d3dea admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:48.233597 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f584a556-496b-408d-9896-61c9870d3dea admin admin] PATH_INFO: `/v3/roles` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:48.235534 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f584a556-496b-408d-9896-61c9870d3dea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:48.239732 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f584a556-496b-408d-9896-61c9870d3dea admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:48.270989 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 897/1793] 10.222.0.117 () {58 vars in 1126 bytes} [Tue Jan 25 02:35:48 2022] GET /identity/v3/roles => generated 1427 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 02:35:48.275256 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f584a556-496b-408d-9896-61c9870d3dea admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:48.291604 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-101b8ae3-09cb-43fc-a115-fa74301e3533 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77350c403d1f406fa35dd6be35350f42', 'request_id': 'req-101b8ae3-09cb-43fc-a115-fa74301e3533'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:35:48.297052 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f584a556-496b-408d-9896-61c9870d3dea admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:48.297896 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-101b8ae3-09cb-43fc-a115-fa74301e3533 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77350c403d1f406fa35dd6be35350f42', 'request_id': 'req-101b8ae3-09cb-43fc-a115-fa74301e3533'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:35:48.320609 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-101b8ae3-09cb-43fc-a115-fa74301e3533 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77350c403d1f406fa35dd6be35350f42', 'request_id': 'req-101b8ae3-09cb-43fc-a115-fa74301e3533'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:35:48.337311 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-101b8ae3-09cb-43fc-a115-fa74301e3533 admin admin] The token cache is being invalidate because project 77350c403d1f406fa35dd6be35350f42 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79121) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 25 02:35:48.337829 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-101b8ae3-09cb-43fc-a115-fa74301e3533 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:35:48.338684 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-101b8ae3-09cb-43fc-a115-fa74301e3533 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:35:48.344089 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 897/1794] 10.222.0.117 () {58 vars in 1237 bytes} [Tue Jan 25 02:35:48 2022] DELETE /identity/v3/projects/77350c403d1f406fa35dd6be35350f42 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:35:48.345148 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101b8ae3-09cb-43fc-a115-fa74301e3533 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:48.347042 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-101b8ae3-09cb-43fc-a115-fa74301e3533 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:35:48.396868 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f852c9b8-3608-4984-9602-91102be3fef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:48.399547 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f852c9b8-3608-4984-9602-91102be3fef6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:48.401598 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f852c9b8-3608-4984-9602-91102be3fef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:48.403560 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f852c9b8-3608-4984-9602-91102be3fef6 admin admin] PATH_INFO: `/v3/projects/2ed91c31402047789283f647ff5815fa/users/658856108a774d89b05260b7579813cc/roles/33a8e87420ed423f9cb29e0084eab5d2` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:48.424978 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101b8ae3-09cb-43fc-a115-fa74301e3533 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:48.438762 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2570e6a-bb2d-437e-a535-3cb76400c96c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:48.439962 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2570e6a-bb2d-437e-a535-3cb76400c96c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:48.440713 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2570e6a-bb2d-437e-a535-3cb76400c96c admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:48.442506 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2570e6a-bb2d-437e-a535-3cb76400c96c admin admin] PATH_INFO: `/v3/users/cabab8b9c5464d40855c12f56b0b71e9` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:48.446697 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2570e6a-bb2d-437e-a535-3cb76400c96c admin admin] RBAC: Authorizing `identity:delete_user(user_id=cabab8b9c5464d40855c12f56b0b71e9)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:48.455455 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2570e6a-bb2d-437e-a535-3cb76400c96c admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:48.457002 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f852c9b8-3608-4984-9602-91102be3fef6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ed91c31402047789283f647ff5815fa, user_id=658856108a774d89b05260b7579813cc, role_id=33a8e87420ed423f9cb29e0084eab5d2)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:48.464362 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f852c9b8-3608-4984-9602-91102be3fef6 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:48.508417 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 898/1795] 10.222.0.117 () {60 vars in 1487 bytes} [Tue Jan 25 02:35:48 2022] PUT /identity/v3/projects/2ed91c31402047789283f647ff5815fa/users/658856108a774d89b05260b7579813cc/roles/33a8e87420ed423f9cb29e0084eab5d2 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:35:48.511159 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f852c9b8-3608-4984-9602-91102be3fef6 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:48.513307 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-f852c9b8-3608-4984-9602-91102be3fef6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:35:48.594899 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-b2570e6a-bb2d-437e-a535-3cb76400c96c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cabab8b9c5464d40855c12f56b0b71e9'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:35:48.595669 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-b2570e6a-bb2d-437e-a535-3cb76400c96c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cabab8b9c5464d40855c12f56b0b71e9'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:35:48.613348 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-b2570e6a-bb2d-437e-a535-3cb76400c96c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cabab8b9c5464d40855c12f56b0b71e9'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:35:48.614114 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-b2570e6a-bb2d-437e-a535-3cb76400c96c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cabab8b9c5464d40855c12f56b0b71e9'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:35:48.627842 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-b2570e6a-bb2d-437e-a535-3cb76400c96c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cabab8b9c5464d40855c12f56b0b71e9'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:35:48.666157 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f852c9b8-3608-4984-9602-91102be3fef6 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:48.684043 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e546ad44-bf0e-47e2-8922-48ad19ee6489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:48.685510 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e546ad44-bf0e-47e2-8922-48ad19ee6489 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:48.685634 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e546ad44-bf0e-47e2-8922-48ad19ee6489 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:48.686065 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e546ad44-bf0e-47e2-8922-48ad19ee6489 admin admin] PATH_INFO: `/v3/projects/d513cd7c4380444d8bcc26c9829072b5` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:48.687793 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e546ad44-bf0e-47e2-8922-48ad19ee6489 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d513cd7c4380444d8bcc26c9829072b5)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:48.695797 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e546ad44-bf0e-47e2-8922-48ad19ee6489 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:48.699588 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 898/1796] 10.222.0.117 () {58 vars in 1228 bytes} [Tue Jan 25 02:35:48 2022] DELETE /identity/v3/users/cabab8b9c5464d40855c12f56b0b71e9 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:35:48.700941 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e10a4e-c138-4b35-afc7-86e35dbec0a3 None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:48.701302 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e10a4e-c138-4b35-afc7-86e35dbec0a3 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:48.701651 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e10a4e-c138-4b35-afc7-86e35dbec0a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:48.780723 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-a7e10a4e-c138-4b35-afc7-86e35dbec0a3 None None] MFA Rules not processed for user `658856108a774d89b05260b7579813cc`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:35:48.782511 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-a7e10a4e-c138-4b35-afc7-86e35dbec0a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:35:48.878918 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-e546ad44-bf0e-47e2-8922-48ad19ee6489 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd513cd7c4380444d8bcc26c9829072b5', 'request_id': 'req-e546ad44-bf0e-47e2-8922-48ad19ee6489'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:35:48.897622 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-e546ad44-bf0e-47e2-8922-48ad19ee6489 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd513cd7c4380444d8bcc26c9829072b5', 'request_id': 'req-e546ad44-bf0e-47e2-8922-48ad19ee6489'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:35:48.928493 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-e546ad44-bf0e-47e2-8922-48ad19ee6489 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd513cd7c4380444d8bcc26c9829072b5', 'request_id': 'req-e546ad44-bf0e-47e2-8922-48ad19ee6489'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:35:48.953352 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-e546ad44-bf0e-47e2-8922-48ad19ee6489 admin admin] The token cache is being invalidate because project d513cd7c4380444d8bcc26c9829072b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79120) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 25 02:35:48.954011 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-e546ad44-bf0e-47e2-8922-48ad19ee6489 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:35:48.955807 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-e546ad44-bf0e-47e2-8922-48ad19ee6489 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:35:48.962921 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 899/1797] 10.222.0.117 () {58 vars in 1237 bytes} [Tue Jan 25 02:35:48 2022] DELETE /identity/v3/projects/d513cd7c4380444d8bcc26c9829072b5 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:35:48.967157 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e546ad44-bf0e-47e2-8922-48ad19ee6489 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:48.969482 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-e546ad44-bf0e-47e2-8922-48ad19ee6489 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:35:49.011955 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 899/1798] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:35:48 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:35:49.021227 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e10a4e-c138-4b35-afc7-86e35dbec0a3 None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:49.023650 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-a7e10a4e-c138-4b35-afc7-86e35dbec0a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:35:49.138507 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e546ad44-bf0e-47e2-8922-48ad19ee6489 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:49.146427 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15ea26b-04a2-4054-b900-5ec09fea4fb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:49.161185 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15ea26b-04a2-4054-b900-5ec09fea4fb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:49.161185 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15ea26b-04a2-4054-b900-5ec09fea4fb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:49.161185 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15ea26b-04a2-4054-b900-5ec09fea4fb6 admin admin] PATH_INFO: `/v3/users/8f3f1442f5b4407b823548f35b672074` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:49.162602 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15ea26b-04a2-4054-b900-5ec09fea4fb6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f3f1442f5b4407b823548f35b672074)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:49.164850 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15ea26b-04a2-4054-b900-5ec09fea4fb6 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:49.165565 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e10a4e-c138-4b35-afc7-86e35dbec0a3 None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:49.233656 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-c15ea26b-04a2-4054-b900-5ec09fea4fb6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f3f1442f5b4407b823548f35b672074'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:35:49.246204 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-c15ea26b-04a2-4054-b900-5ec09fea4fb6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f3f1442f5b4407b823548f35b672074'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:35:49.248183 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-c15ea26b-04a2-4054-b900-5ec09fea4fb6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f3f1442f5b4407b823548f35b672074'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:35:49.248941 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-c15ea26b-04a2-4054-b900-5ec09fea4fb6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f3f1442f5b4407b823548f35b672074'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:35:49.258603 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af1227f-7fb4-4be6-8191-1fb399a5e138 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cc5249aea09430080e232cf17757f86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:49.260298 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af1227f-7fb4-4be6-8191-1fb399a5e138 service cinder] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:49.261214 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af1227f-7fb4-4be6-8191-1fb399a5e138 service cinder] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:49.261837 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af1227f-7fb4-4be6-8191-1fb399a5e138 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:49.266648 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-7af1227f-7fb4-4be6-8191-1fb399a5e138 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:35:49.288077 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-c15ea26b-04a2-4054-b900-5ec09fea4fb6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f3f1442f5b4407b823548f35b672074'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:35:49.337377 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 900/1799] 10.222.0.117 () {58 vars in 1228 bytes} [Tue Jan 25 02:35:48 2022] DELETE /identity/v3/users/8f3f1442f5b4407b823548f35b672074 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 25 02:35:49.343153 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325ce617-e5d8-4734-ad34-e55e39da16a9 None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:49.343477 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325ce617-e5d8-4734-ad34-e55e39da16a9 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:49.346197 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325ce617-e5d8-4734-ad34-e55e39da16a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:49.404840 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af1227f-7fb4-4be6-8191-1fb399a5e138 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:49.407354 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af1227f-7fb4-4be6-8191-1fb399a5e138 service cinder] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:49.429216 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 900/1800] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:35:49 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 25 02:35:49.440362 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-325ce617-e5d8-4734-ad34-e55e39da16a9 None None] MFA Rules not processed for user `68a82b6bf8254535a369d5836ee54190`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:35:49.441600 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-325ce617-e5d8-4734-ad34-e55e39da16a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:35:49.647002 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 901/1801] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:35:49 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:35:49.662637 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af1227f-7fb4-4be6-8191-1fb399a5e138 service cinder] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:49.665047 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-7af1227f-7fb4-4be6-8191-1fb399a5e138 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:35:49.686191 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af1227f-7fb4-4be6-8191-1fb399a5e138 service cinder] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:49.883478 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96456cc-ca6b-4054-8b65-234f819385d7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cc5249aea09430080e232cf17757f86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:49.884600 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96456cc-ca6b-4054-8b65-234f819385d7 service cinder] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:49.884600 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96456cc-ca6b-4054-8b65-234f819385d7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:49.884810 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96456cc-ca6b-4054-8b65-234f819385d7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:49.887305 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-e96456cc-ca6b-4054-8b65-234f819385d7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:35:50.043507 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96456cc-ca6b-4054-8b65-234f819385d7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:50.045439 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96456cc-ca6b-4054-8b65-234f819385d7 service cinder] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:50.075780 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 901/1802] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:35:49 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:35:50.332628 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c483f914-1e83-45f7-b505-2a15310f08b0 None None] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:50.332628 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c483f914-1e83-45f7-b505-2a15310f08b0 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:50.332628 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c483f914-1e83-45f7-b505-2a15310f08b0 None None] PATH_INFO: `/` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:50.334611 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 902/1803] 10.222.0.117 () {54 vars in 926 bytes} [Tue Jan 25 02:35:50 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:35:50.464475 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96456cc-ca6b-4054-8b65-234f819385d7 service cinder] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:50.467489 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-e96456cc-ca6b-4054-8b65-234f819385d7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:35:50.526794 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e03958c-dc4b-44cf-8c39-54ffbd97c090 None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:50.527316 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e03958c-dc4b-44cf-8c39-54ffbd97c090 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:50.527853 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e03958c-dc4b-44cf-8c39-54ffbd97c090 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:50.566518 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-4e03958c-dc4b-44cf-8c39-54ffbd97c090 None None] MFA Rules not processed for user `d9ad6269900346458050063c12cac299`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:35:50.567875 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-4e03958c-dc4b-44cf-8c39-54ffbd97c090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:35:50.743551 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 903/1804] 10.222.0.117 () {58 vars in 1023 bytes} [Tue Jan 25 02:35:50 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:35:50.805171 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96456cc-ca6b-4054-8b65-234f819385d7 service cinder] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:50.821164 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e19a96-df1c-4584-bc25-cca123d2779c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:50.822188 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e19a96-df1c-4584-bc25-cca123d2779c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:50.822349 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e19a96-df1c-4584-bc25-cca123d2779c admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:50.822792 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e19a96-df1c-4584-bc25-cca123d2779c admin admin] PATH_INFO: `/v3/projects/c9860c2b7c5e4e60bf5887bb3c101fa2` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:50.824738 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e19a96-df1c-4584-bc25-cca123d2779c admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9860c2b7c5e4e60bf5887bb3c101fa2)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:50.827238 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e19a96-df1c-4584-bc25-cca123d2779c admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:50.945150 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-b8e19a96-df1c-4584-bc25-cca123d2779c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9860c2b7c5e4e60bf5887bb3c101fa2', 'request_id': 'req-b8e19a96-df1c-4584-bc25-cca123d2779c'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:35:50.955369 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-b8e19a96-df1c-4584-bc25-cca123d2779c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9860c2b7c5e4e60bf5887bb3c101fa2', 'request_id': 'req-b8e19a96-df1c-4584-bc25-cca123d2779c'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:35:50.969218 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-b8e19a96-df1c-4584-bc25-cca123d2779c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9860c2b7c5e4e60bf5887bb3c101fa2', 'request_id': 'req-b8e19a96-df1c-4584-bc25-cca123d2779c'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:35:50.989665 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-b8e19a96-df1c-4584-bc25-cca123d2779c admin admin] The token cache is being invalidate because project c9860c2b7c5e4e60bf5887bb3c101fa2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79121) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 25 02:35:50.990041 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-b8e19a96-df1c-4584-bc25-cca123d2779c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:35:50.991327 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-b8e19a96-df1c-4584-bc25-cca123d2779c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:35:50.993351 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 902/1805] 10.222.0.117 () {58 vars in 1237 bytes} [Tue Jan 25 02:35:50 2022] DELETE /identity/v3/projects/c9860c2b7c5e4e60bf5887bb3c101fa2 => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:35:51.000046 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04875f11-a865-4b79-ac4b-ca6944d9bad8 None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:51.000568 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04875f11-a865-4b79-ac4b-ca6944d9bad8 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:51.001150 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04875f11-a865-4b79-ac4b-ca6944d9bad8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:51.024344 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-04875f11-a865-4b79-ac4b-ca6944d9bad8 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:35:51.025673 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-04875f11-a865-4b79-ac4b-ca6944d9bad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:35:51.123585 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e19a96-df1c-4584-bc25-cca123d2779c admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:51.126545 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-b8e19a96-df1c-4584-bc25-cca123d2779c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:35:51.150588 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 904/1806] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:35:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:35:51.151509 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04875f11-a865-4b79-ac4b-ca6944d9bad8 None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:51.156286 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-04875f11-a865-4b79-ac4b-ca6944d9bad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:35:51.172599 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04875f11-a865-4b79-ac4b-ca6944d9bad8 None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:51.183057 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c209c9-c7fb-44f9-94f7-4e27dcc1a423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:51.184633 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c209c9-c7fb-44f9-94f7-4e27dcc1a423 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:51.184925 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c209c9-c7fb-44f9-94f7-4e27dcc1a423 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:51.185720 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c209c9-c7fb-44f9-94f7-4e27dcc1a423 admin admin] PATH_INFO: `/v3/projects/043bd2918ef24ecf91285ce48cc6d394` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:51.188005 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c209c9-c7fb-44f9-94f7-4e27dcc1a423 admin admin] RBAC: Authorizing `identity:delete_project(project_id=043bd2918ef24ecf91285ce48cc6d394)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:51.190843 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c209c9-c7fb-44f9-94f7-4e27dcc1a423 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:51.249434 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e19a96-df1c-4584-bc25-cca123d2779c admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:51.279468 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-03c209c9-c7fb-44f9-94f7-4e27dcc1a423 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '043bd2918ef24ecf91285ce48cc6d394', 'request_id': 'req-03c209c9-c7fb-44f9-94f7-4e27dcc1a423'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:35:51.291544 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-03c209c9-c7fb-44f9-94f7-4e27dcc1a423 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '043bd2918ef24ecf91285ce48cc6d394', 'request_id': 'req-03c209c9-c7fb-44f9-94f7-4e27dcc1a423'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:35:51.301701 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-03c209c9-c7fb-44f9-94f7-4e27dcc1a423 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '043bd2918ef24ecf91285ce48cc6d394', 'request_id': 'req-03c209c9-c7fb-44f9-94f7-4e27dcc1a423'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:35:51.330138 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-03c209c9-c7fb-44f9-94f7-4e27dcc1a423 admin admin] The token cache is being invalidate because project 043bd2918ef24ecf91285ce48cc6d394 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79120) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 25 02:35:51.330430 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-03c209c9-c7fb-44f9-94f7-4e27dcc1a423 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:35:51.331084 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-03c209c9-c7fb-44f9-94f7-4e27dcc1a423 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:35:51.334206 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 905/1807] 10.222.0.117 () {58 vars in 1237 bytes} [Tue Jan 25 02:35:51 2022] DELETE /identity/v3/projects/043bd2918ef24ecf91285ce48cc6d394 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:35:51.336438 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a952e93a-258a-4d68-97b5-28c93cfe0542 None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:51.336728 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a952e93a-258a-4d68-97b5-28c93cfe0542 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:51.337008 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a952e93a-258a-4d68-97b5-28c93cfe0542 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:51.346541 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3227ece-d601-4c5c-8197-4d6abe45eb0b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9ad6269900346458050063c12cac299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:51.347343 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3227ece-d601-4c5c-8197-4d6abe45eb0b service nova] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:51.347746 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3227ece-d601-4c5c-8197-4d6abe45eb0b service nova] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:51.348126 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3227ece-d601-4c5c-8197-4d6abe45eb0b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:51.352754 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-e3227ece-d601-4c5c-8197-4d6abe45eb0b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:35:51.359538 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-a952e93a-258a-4d68-97b5-28c93cfe0542 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:35:51.360982 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-a952e93a-258a-4d68-97b5-28c93cfe0542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:35:51.378019 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3227ece-d601-4c5c-8197-4d6abe45eb0b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:51.379837 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3227ece-d601-4c5c-8197-4d6abe45eb0b service nova] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:51.391862 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 903/1808] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:35:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:35:51.393228 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714d1de0-81bd-4dbd-bed4-c9d6831ad4ae None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:51.393590 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714d1de0-81bd-4dbd-bed4-c9d6831ad4ae None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:51.393878 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714d1de0-81bd-4dbd-bed4-c9d6831ad4ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:51.411601 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-714d1de0-81bd-4dbd-bed4-c9d6831ad4ae None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:35:51.413760 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-714d1de0-81bd-4dbd-bed4-c9d6831ad4ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:35:51.441606 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 906/1809] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:35:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:35:51.442714 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a952e93a-258a-4d68-97b5-28c93cfe0542 None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:51.453527 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a952e93a-258a-4d68-97b5-28c93cfe0542 None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:51.459149 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24828f6a-2769-41f4-a9f1-e29165523beb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:51.460556 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24828f6a-2769-41f4-a9f1-e29165523beb admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:51.460866 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24828f6a-2769-41f4-a9f1-e29165523beb admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:51.461322 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24828f6a-2769-41f4-a9f1-e29165523beb admin admin] PATH_INFO: `/v3/domains` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:51.462217 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24828f6a-2769-41f4-a9f1-e29165523beb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:35:51.462669 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24828f6a-2769-41f4-a9f1-e29165523beb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:51.464309 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24828f6a-2769-41f4-a9f1-e29165523beb admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:51.479663 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 907/1810] 10.222.0.117 () {58 vars in 1157 bytes} [Tue Jan 25 02:35:51 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:35:51.483604 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 904/1811] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:35:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:35:51.484902 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24828f6a-2769-41f4-a9f1-e29165523beb admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:51.492169 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc533b7-6921-430b-90a3-1ee1e25ff52d None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:51.492471 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc533b7-6921-430b-90a3-1ee1e25ff52d None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:51.492793 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc533b7-6921-430b-90a3-1ee1e25ff52d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:51.499553 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24828f6a-2769-41f4-a9f1-e29165523beb admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:51.505060 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6b5c02-6bbd-4c7e-b8f8-0549401ab784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:51.505922 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6b5c02-6bbd-4c7e-b8f8-0549401ab784 admin admin] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:51.506210 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6b5c02-6bbd-4c7e-b8f8-0549401ab784 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:51.506659 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6b5c02-6bbd-4c7e-b8f8-0549401ab784 admin admin] PATH_INFO: `/v3/projects` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:51.507382 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6b5c02-6bbd-4c7e-b8f8-0549401ab784 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:51.509339 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6b5c02-6bbd-4c7e-b8f8-0549401ab784 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:51.512607 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-6cc533b7-6921-430b-90a3-1ee1e25ff52d None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:35:51.513934 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-6cc533b7-6921-430b-90a3-1ee1e25ff52d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:35:51.524825 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 905/1812] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:35:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 25 02:35:51.529418 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc533b7-6921-430b-90a3-1ee1e25ff52d None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:51.542905 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc533b7-6921-430b-90a3-1ee1e25ff52d None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:51.547625 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddd9e1d-564c-4e65-979f-b86d91af8a96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:51.551537 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 908/1813] 10.222.0.117 () {60 vars in 1157 bytes} [Tue Jan 25 02:35:51 2022] POST /identity/v3/projects => generated 358 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 25 02:35:51.551713 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddd9e1d-564c-4e65-979f-b86d91af8a96 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:51.551713 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddd9e1d-564c-4e65-979f-b86d91af8a96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:51.551713 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddd9e1d-564c-4e65-979f-b86d91af8a96 admin admin] PATH_INFO: `/v3/domains` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:51.551713 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddd9e1d-564c-4e65-979f-b86d91af8a96 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:35:51.551713 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddd9e1d-564c-4e65-979f-b86d91af8a96 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:51.552666 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6b5c02-6bbd-4c7e-b8f8-0549401ab784 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:51.558440 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddd9e1d-564c-4e65-979f-b86d91af8a96 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:51.580155 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 906/1814] 10.222.0.117 () {58 vars in 1157 bytes} [Tue Jan 25 02:35:51 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:35:51.584817 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddd9e1d-564c-4e65-979f-b86d91af8a96 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:51.595484 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddd9e1d-564c-4e65-979f-b86d91af8a96 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:51.626953 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6b5c02-6bbd-4c7e-b8f8-0549401ab784 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:51.633210 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1f0a32-d091-4867-94c5-51104ceb88b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:51.633896 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1f0a32-d091-4867-94c5-51104ceb88b0 admin admin] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:51.634180 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1f0a32-d091-4867-94c5-51104ceb88b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:51.634520 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1f0a32-d091-4867-94c5-51104ceb88b0 admin admin] PATH_INFO: `/v3/users` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:51.636949 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1f0a32-d091-4867-94c5-51104ceb88b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:51.637345 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1f0a32-d091-4867-94c5-51104ceb88b0 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:51.658459 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6f286f-8723-4919-a494-c45f88ed994c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:51.662741 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 909/1815] 10.222.0.117 () {60 vars in 1148 bytes} [Tue Jan 25 02:35:51 2022] POST /identity/v3/users => generated 280 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 02:35:51.663596 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6f286f-8723-4919-a494-c45f88ed994c admin admin] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:51.663596 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6f286f-8723-4919-a494-c45f88ed994c admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:51.663596 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6f286f-8723-4919-a494-c45f88ed994c admin admin] PATH_INFO: `/v3/projects` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:51.663596 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6f286f-8723-4919-a494-c45f88ed994c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:51.665189 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6f286f-8723-4919-a494-c45f88ed994c admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:51.666145 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1f0a32-d091-4867-94c5-51104ceb88b0 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:51.676399 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1f0a32-d091-4867-94c5-51104ceb88b0 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:51.684475 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e6be15-2819-47c9-806e-b45570ad247a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:51.685238 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e6be15-2819-47c9-806e-b45570ad247a admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:51.685522 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e6be15-2819-47c9-806e-b45570ad247a admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:51.685937 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e6be15-2819-47c9-806e-b45570ad247a admin admin] PATH_INFO: `/v3/roles` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:51.686725 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e6be15-2819-47c9-806e-b45570ad247a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:51.688438 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e6be15-2819-47c9-806e-b45570ad247a admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:51.699795 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 907/1816] 10.222.0.117 () {60 vars in 1157 bytes} [Tue Jan 25 02:35:51 2022] POST /identity/v3/projects => generated 384 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 25 02:35:51.703921 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6f286f-8723-4919-a494-c45f88ed994c admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:51.709160 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 910/1817] 10.222.0.117 () {58 vars in 1126 bytes} [Tue Jan 25 02:35:51 2022] GET /identity/v3/roles => generated 1427 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 02:35:51.712984 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e6be15-2819-47c9-806e-b45570ad247a admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:51.722803 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e6be15-2819-47c9-806e-b45570ad247a admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:51.802216 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6f286f-8723-4919-a494-c45f88ed994c admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:51.808601 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d81f9cf-ef63-44bc-bbd2-a2b36ffeeb79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:51.809368 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d81f9cf-ef63-44bc-bbd2-a2b36ffeeb79 admin admin] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:51.809723 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d81f9cf-ef63-44bc-bbd2-a2b36ffeeb79 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:51.810244 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d81f9cf-ef63-44bc-bbd2-a2b36ffeeb79 admin admin] PATH_INFO: `/v3/users` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:51.811236 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d81f9cf-ef63-44bc-bbd2-a2b36ffeeb79 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:51.813545 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d81f9cf-ef63-44bc-bbd2-a2b36ffeeb79 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:51.835863 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 908/1818] 10.222.0.117 () {60 vars in 1148 bytes} [Tue Jan 25 02:35:51 2022] POST /identity/v3/users => generated 293 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 25 02:35:51.840484 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d81f9cf-ef63-44bc-bbd2-a2b36ffeeb79 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:51.840996 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe355a48-f833-4347-beef-c38e193adb70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:51.841679 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe355a48-f833-4347-beef-c38e193adb70 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:51.841962 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe355a48-f833-4347-beef-c38e193adb70 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:51.842264 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe355a48-f833-4347-beef-c38e193adb70 admin admin] PATH_INFO: `/v3/roles` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:51.842986 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe355a48-f833-4347-beef-c38e193adb70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:51.844764 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe355a48-f833-4347-beef-c38e193adb70 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:51.851861 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d81f9cf-ef63-44bc-bbd2-a2b36ffeeb79 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:51.856836 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2f9586-912e-4d54-9b15-4f3ac1e511fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:51.857586 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2f9586-912e-4d54-9b15-4f3ac1e511fe admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:51.858081 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2f9586-912e-4d54-9b15-4f3ac1e511fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:51.858434 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2f9586-912e-4d54-9b15-4f3ac1e511fe admin admin] PATH_INFO: `/v3/roles` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:51.858842 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 911/1819] 10.222.0.117 () {58 vars in 1126 bytes} [Tue Jan 25 02:35:51 2022] GET /identity/v3/roles => generated 1427 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 25 02:35:51.862571 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe355a48-f833-4347-beef-c38e193adb70 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:51.864534 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2f9586-912e-4d54-9b15-4f3ac1e511fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:51.866588 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2f9586-912e-4d54-9b15-4f3ac1e511fe admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:51.875378 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe355a48-f833-4347-beef-c38e193adb70 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:51.879055 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 909/1820] 10.222.0.117 () {58 vars in 1126 bytes} [Tue Jan 25 02:35:51 2022] GET /identity/v3/roles => generated 1427 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 02:35:51.880680 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288dbdd5-36f0-430a-885d-bf42901a5fbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:51.882293 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288dbdd5-36f0-430a-885d-bf42901a5fbd admin admin] REQUEST_METHOD: `PUT` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:51.882711 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288dbdd5-36f0-430a-885d-bf42901a5fbd admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:51.883177 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288dbdd5-36f0-430a-885d-bf42901a5fbd admin admin] PATH_INFO: `/v3/projects/be17c78cfd2a4125996a10e3841aa4d6/users/5b7ae346f76d434f8d38ccd5901b5199/roles/33a8e87420ed423f9cb29e0084eab5d2` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:51.883880 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2f9586-912e-4d54-9b15-4f3ac1e511fe admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:51.897782 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2f9586-912e-4d54-9b15-4f3ac1e511fe admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:51.903717 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680e2b75-8565-436b-9a2a-2e3412a3fc86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:51.904663 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680e2b75-8565-436b-9a2a-2e3412a3fc86 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:51.904948 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680e2b75-8565-436b-9a2a-2e3412a3fc86 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:51.905227 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680e2b75-8565-436b-9a2a-2e3412a3fc86 admin admin] PATH_INFO: `/v3/roles` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:51.905982 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680e2b75-8565-436b-9a2a-2e3412a3fc86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:51.907626 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680e2b75-8565-436b-9a2a-2e3412a3fc86 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:51.908786 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288dbdd5-36f0-430a-885d-bf42901a5fbd admin admin] RBAC: Authorizing `identity:create_grant(project_id=be17c78cfd2a4125996a10e3841aa4d6, user_id=5b7ae346f76d434f8d38ccd5901b5199, role_id=33a8e87420ed423f9cb29e0084eab5d2)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:51.912472 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288dbdd5-36f0-430a-885d-bf42901a5fbd admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:51.920564 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 910/1821] 10.222.0.117 () {58 vars in 1126 bytes} [Tue Jan 25 02:35:51 2022] GET /identity/v3/roles => generated 1427 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 02:35:51.924585 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680e2b75-8565-436b-9a2a-2e3412a3fc86 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:51.934622 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 912/1822] 10.222.0.117 () {60 vars in 1487 bytes} [Tue Jan 25 02:35:51 2022] PUT /identity/v3/projects/be17c78cfd2a4125996a10e3841aa4d6/users/5b7ae346f76d434f8d38ccd5901b5199/roles/33a8e87420ed423f9cb29e0084eab5d2 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 25 02:35:51.944536 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680e2b75-8565-436b-9a2a-2e3412a3fc86 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:51.947220 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ac9336-836c-461a-9eec-dac317c3b01f None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:51.947617 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ac9336-836c-461a-9eec-dac317c3b01f None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:51.948021 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ac9336-836c-461a-9eec-dac317c3b01f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:51.981239 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-29ac9336-836c-461a-9eec-dac317c3b01f None None] MFA Rules not processed for user `5b7ae346f76d434f8d38ccd5901b5199`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:35:51.982625 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-29ac9336-836c-461a-9eec-dac317c3b01f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:35:52.005151 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74087921-6737-4bed-be33-341322cb1cda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:52.006049 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74087921-6737-4bed-be33-341322cb1cda admin admin] REQUEST_METHOD: `PUT` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:52.006906 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74087921-6737-4bed-be33-341322cb1cda admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:52.007683 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74087921-6737-4bed-be33-341322cb1cda admin admin] PATH_INFO: `/v3/projects/58647b4771c04d1cb0a01d25bd9128f1/users/b504e4523faf408196b2718443ea19e2/roles/33a8e87420ed423f9cb29e0084eab5d2` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:52.020977 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74087921-6737-4bed-be33-341322cb1cda admin admin] RBAC: Authorizing `identity:create_grant(project_id=58647b4771c04d1cb0a01d25bd9128f1, user_id=b504e4523faf408196b2718443ea19e2, role_id=33a8e87420ed423f9cb29e0084eab5d2)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:52.024453 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74087921-6737-4bed-be33-341322cb1cda admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:52.037170 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 911/1823] 10.222.0.117 () {60 vars in 1487 bytes} [Tue Jan 25 02:35:51 2022] PUT /identity/v3/projects/58647b4771c04d1cb0a01d25bd9128f1/users/b504e4523faf408196b2718443ea19e2/roles/33a8e87420ed423f9cb29e0084eab5d2 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 25 02:35:52.046592 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 913/1824] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:35:51 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 25 02:35:52.048658 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ea982e-68aa-4a90-92c4-b35b8cec0c3b None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:52.048890 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ea982e-68aa-4a90-92c4-b35b8cec0c3b None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:52.049164 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ea982e-68aa-4a90-92c4-b35b8cec0c3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:52.051287 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ac9336-836c-461a-9eec-dac317c3b01f None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:52.062531 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ac9336-836c-461a-9eec-dac317c3b01f None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:52.080515 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-87ea982e-68aa-4a90-92c4-b35b8cec0c3b None None] MFA Rules not processed for user `b504e4523faf408196b2718443ea19e2`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:35:52.081828 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-87ea982e-68aa-4a90-92c4-b35b8cec0c3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:35:52.133099 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a5b3e4-a6c8-40e4-a079-f2032ceb166a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:52.134302 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a5b3e4-a6c8-40e4-a079-f2032ceb166a admin admin] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:52.134658 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a5b3e4-a6c8-40e4-a079-f2032ceb166a admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:52.135012 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a5b3e4-a6c8-40e4-a079-f2032ceb166a admin admin] PATH_INFO: `/v3/projects` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:52.135977 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a5b3e4-a6c8-40e4-a079-f2032ceb166a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:52.138236 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a5b3e4-a6c8-40e4-a079-f2032ceb166a admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:52.158465 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 912/1825] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:35:52 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 25 02:35:52.165701 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ea982e-68aa-4a90-92c4-b35b8cec0c3b None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:52.170409 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 914/1826] 10.222.0.117 () {60 vars in 1157 bytes} [Tue Jan 25 02:35:52 2022] POST /identity/v3/projects => generated 358 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 25 02:35:52.176711 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a5b3e4-a6c8-40e4-a079-f2032ceb166a admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:52.180274 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ea982e-68aa-4a90-92c4-b35b8cec0c3b None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:52.254062 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64463e42-7195-49fe-aa32-c64e39a171d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:52.254751 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64463e42-7195-49fe-aa32-c64e39a171d8 admin admin] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:52.255016 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64463e42-7195-49fe-aa32-c64e39a171d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:52.255851 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64463e42-7195-49fe-aa32-c64e39a171d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:52.256034 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64463e42-7195-49fe-aa32-c64e39a171d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:52.259182 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64463e42-7195-49fe-aa32-c64e39a171d8 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:52.260521 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a5b3e4-a6c8-40e4-a079-f2032ceb166a admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:52.271297 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cf1115-b382-4e89-aa44-3f14c5cdcce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:52.272646 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cf1115-b382-4e89-aa44-3f14c5cdcce9 admin admin] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:52.272930 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cf1115-b382-4e89-aa44-3f14c5cdcce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:52.273207 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cf1115-b382-4e89-aa44-3f14c5cdcce9 admin admin] PATH_INFO: `/v3/users` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:52.274017 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cf1115-b382-4e89-aa44-3f14c5cdcce9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:52.276952 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cf1115-b382-4e89-aa44-3f14c5cdcce9 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:52.289477 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 913/1827] 10.222.0.117 () {60 vars in 1157 bytes} [Tue Jan 25 02:35:52 2022] POST /identity/v3/projects => generated 380 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 02:35:52.293971 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64463e42-7195-49fe-aa32-c64e39a171d8 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:52.302150 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 915/1828] 10.222.0.117 () {60 vars in 1148 bytes} [Tue Jan 25 02:35:52 2022] POST /identity/v3/users => generated 286 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 02:35:52.307083 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cf1115-b382-4e89-aa44-3f14c5cdcce9 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:52.318289 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cf1115-b382-4e89-aa44-3f14c5cdcce9 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:52.361559 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64463e42-7195-49fe-aa32-c64e39a171d8 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:52.366788 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f173cf73-5f20-4c3a-81ae-7256b1c0e69d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:52.367555 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f173cf73-5f20-4c3a-81ae-7256b1c0e69d admin admin] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:52.367874 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f173cf73-5f20-4c3a-81ae-7256b1c0e69d admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:52.368182 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f173cf73-5f20-4c3a-81ae-7256b1c0e69d admin admin] PATH_INFO: `/v3/users` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:52.368884 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f173cf73-5f20-4c3a-81ae-7256b1c0e69d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:52.370986 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f173cf73-5f20-4c3a-81ae-7256b1c0e69d admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:52.375228 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30100ecf-797e-4480-af03-d7121fd4febb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:52.375925 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30100ecf-797e-4480-af03-d7121fd4febb admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:52.376207 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30100ecf-797e-4480-af03-d7121fd4febb admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:52.376482 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30100ecf-797e-4480-af03-d7121fd4febb admin admin] PATH_INFO: `/v3/roles` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:52.377223 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30100ecf-797e-4480-af03-d7121fd4febb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:52.380400 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30100ecf-797e-4480-af03-d7121fd4febb admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:52.392200 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 914/1829] 10.222.0.117 () {60 vars in 1148 bytes} [Tue Jan 25 02:35:52 2022] POST /identity/v3/users => generated 297 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 25 02:35:52.393224 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 916/1830] 10.222.0.117 () {58 vars in 1126 bytes} [Tue Jan 25 02:35:52 2022] GET /identity/v3/roles => generated 1427 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 25 02:35:52.396020 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f173cf73-5f20-4c3a-81ae-7256b1c0e69d admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:52.400696 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30100ecf-797e-4480-af03-d7121fd4febb admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:52.407500 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f173cf73-5f20-4c3a-81ae-7256b1c0e69d admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:52.410330 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30100ecf-797e-4480-af03-d7121fd4febb admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:52.413960 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a91fee5-707d-4ed2-9388-ac5940349f93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:52.415045 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a91fee5-707d-4ed2-9388-ac5940349f93 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:52.415556 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a91fee5-707d-4ed2-9388-ac5940349f93 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:52.416074 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a91fee5-707d-4ed2-9388-ac5940349f93 admin admin] PATH_INFO: `/v3/roles` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:52.416515 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d1d51d-2564-4bfd-87e4-1288ca9c6f8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:52.417376 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a91fee5-707d-4ed2-9388-ac5940349f93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:52.417488 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d1d51d-2564-4bfd-87e4-1288ca9c6f8c admin admin] REQUEST_METHOD: `PUT` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:52.417685 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d1d51d-2564-4bfd-87e4-1288ca9c6f8c admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:52.417960 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d1d51d-2564-4bfd-87e4-1288ca9c6f8c admin admin] PATH_INFO: `/v3/projects/6a77a5a817cc4ed5bcde8b9baa441997/users/f70eacac146d410e8b969042a91be9b0/roles/d8dbc6d83d9d41d28c3feb8b3485b291` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:52.419684 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a91fee5-707d-4ed2-9388-ac5940349f93 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:52.431198 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 915/1831] 10.222.0.117 () {58 vars in 1126 bytes} [Tue Jan 25 02:35:52 2022] GET /identity/v3/roles => generated 1427 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 02:35:52.434231 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d1d51d-2564-4bfd-87e4-1288ca9c6f8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a77a5a817cc4ed5bcde8b9baa441997, user_id=f70eacac146d410e8b969042a91be9b0, role_id=d8dbc6d83d9d41d28c3feb8b3485b291)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:52.436616 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a91fee5-707d-4ed2-9388-ac5940349f93 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:52.437025 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d1d51d-2564-4bfd-87e4-1288ca9c6f8c admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:52.448269 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a91fee5-707d-4ed2-9388-ac5940349f93 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:52.453456 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 917/1832] 10.222.0.117 () {60 vars in 1487 bytes} [Tue Jan 25 02:35:52 2022] PUT /identity/v3/projects/6a77a5a817cc4ed5bcde8b9baa441997/users/f70eacac146d410e8b969042a91be9b0/roles/d8dbc6d83d9d41d28c3feb8b3485b291 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:35:52.458401 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d1d51d-2564-4bfd-87e4-1288ca9c6f8c admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:52.512514 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f26f1c-5e87-4b9c-90bf-8d6451c7480a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:52.513419 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f26f1c-5e87-4b9c-90bf-8d6451c7480a admin admin] REQUEST_METHOD: `PUT` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:52.513693 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f26f1c-5e87-4b9c-90bf-8d6451c7480a admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:52.514022 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f26f1c-5e87-4b9c-90bf-8d6451c7480a admin admin] PATH_INFO: `/v3/projects/61a73ddc0b6944339705bc095e625c96/users/8c085bb40bdb48ffac31f60f915101e1/roles/d8dbc6d83d9d41d28c3feb8b3485b291` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:52.524530 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d1d51d-2564-4bfd-87e4-1288ca9c6f8c admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:52.529306 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8961e3c9-789a-417a-a3be-9ad558a1bec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:52.529663 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f26f1c-5e87-4b9c-90bf-8d6451c7480a admin admin] RBAC: Authorizing `identity:create_grant(project_id=61a73ddc0b6944339705bc095e625c96, user_id=8c085bb40bdb48ffac31f60f915101e1, role_id=d8dbc6d83d9d41d28c3feb8b3485b291)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:52.529971 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8961e3c9-789a-417a-a3be-9ad558a1bec3 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:52.530250 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8961e3c9-789a-417a-a3be-9ad558a1bec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:52.530522 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8961e3c9-789a-417a-a3be-9ad558a1bec3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:52.531388 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8961e3c9-789a-417a-a3be-9ad558a1bec3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:52.532444 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f26f1c-5e87-4b9c-90bf-8d6451c7480a admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:52.533062 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8961e3c9-789a-417a-a3be-9ad558a1bec3 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:52.548038 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 918/1833] 10.222.0.117 () {58 vars in 1126 bytes} [Tue Jan 25 02:35:52 2022] GET /identity/v3/roles => generated 1427 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 02:35:52.550696 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 916/1834] 10.222.0.117 () {60 vars in 1487 bytes} [Tue Jan 25 02:35:52 2022] PUT /identity/v3/projects/61a73ddc0b6944339705bc095e625c96/users/8c085bb40bdb48ffac31f60f915101e1/roles/d8dbc6d83d9d41d28c3feb8b3485b291 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 25 02:35:52.559913 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8961e3c9-789a-417a-a3be-9ad558a1bec3 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:52.560440 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f26f1c-5e87-4b9c-90bf-8d6451c7480a admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:52.569874 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8961e3c9-789a-417a-a3be-9ad558a1bec3 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:52.629294 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39cfab4-79b6-43e4-a802-d555d729b021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:52.630007 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39cfab4-79b6-43e4-a802-d555d729b021 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:52.630290 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39cfab4-79b6-43e4-a802-d555d729b021 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:52.630563 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39cfab4-79b6-43e4-a802-d555d729b021 admin admin] PATH_INFO: `/v3/roles` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:52.632056 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39cfab4-79b6-43e4-a802-d555d729b021 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:52.634387 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39cfab4-79b6-43e4-a802-d555d729b021 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:52.635660 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f26f1c-5e87-4b9c-90bf-8d6451c7480a admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:52.640412 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c60804-ebc6-4378-8bf7-28104d733dd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:52.641319 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c60804-ebc6-4378-8bf7-28104d733dd7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:52.641595 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c60804-ebc6-4378-8bf7-28104d733dd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:52.641863 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c60804-ebc6-4378-8bf7-28104d733dd7 admin admin] PATH_INFO: `/v3/projects/6a77a5a817cc4ed5bcde8b9baa441997/users/f70eacac146d410e8b969042a91be9b0/roles/d8dbc6d83d9d41d28c3feb8b3485b291` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:52.643947 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c60804-ebc6-4378-8bf7-28104d733dd7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a77a5a817cc4ed5bcde8b9baa441997, user_id=f70eacac146d410e8b969042a91be9b0, role_id=d8dbc6d83d9d41d28c3feb8b3485b291)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:52.644363 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 919/1835] 10.222.0.117 () {58 vars in 1126 bytes} [Tue Jan 25 02:35:52 2022] GET /identity/v3/roles => generated 1427 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 02:35:52.646597 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c60804-ebc6-4378-8bf7-28104d733dd7 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:52.649111 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39cfab4-79b6-43e4-a802-d555d729b021 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:52.658066 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 917/1836] 10.222.0.117 () {60 vars in 1487 bytes} [Tue Jan 25 02:35:52 2022] PUT /identity/v3/projects/6a77a5a817cc4ed5bcde8b9baa441997/users/f70eacac146d410e8b969042a91be9b0/roles/d8dbc6d83d9d41d28c3feb8b3485b291 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:35:52.658310 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39cfab4-79b6-43e4-a802-d555d729b021 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:52.667894 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cdc60c-6549-4a00-b71a-744897d49459 None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:52.668182 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cdc60c-6549-4a00-b71a-744897d49459 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:52.668461 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cdc60c-6549-4a00-b71a-744897d49459 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:52.695768 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-44cdc60c-6549-4a00-b71a-744897d49459 None None] MFA Rules not processed for user `f70eacac146d410e8b969042a91be9b0`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:35:52.697000 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-44cdc60c-6549-4a00-b71a-744897d49459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:35:52.714192 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f235e01e-a306-4798-a912-78339080e7a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:52.715090 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f235e01e-a306-4798-a912-78339080e7a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:52.715379 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f235e01e-a306-4798-a912-78339080e7a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:52.715658 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f235e01e-a306-4798-a912-78339080e7a0 admin admin] PATH_INFO: `/v3/projects/61a73ddc0b6944339705bc095e625c96/users/8c085bb40bdb48ffac31f60f915101e1/roles/d8dbc6d83d9d41d28c3feb8b3485b291` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:52.717981 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f235e01e-a306-4798-a912-78339080e7a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=61a73ddc0b6944339705bc095e625c96, user_id=8c085bb40bdb48ffac31f60f915101e1, role_id=d8dbc6d83d9d41d28c3feb8b3485b291)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:52.720652 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f235e01e-a306-4798-a912-78339080e7a0 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:52.731315 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 920/1837] 10.222.0.117 () {60 vars in 1487 bytes} [Tue Jan 25 02:35:52 2022] PUT /identity/v3/projects/61a73ddc0b6944339705bc095e625c96/users/8c085bb40bdb48ffac31f60f915101e1/roles/d8dbc6d83d9d41d28c3feb8b3485b291 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 25 02:35:52.742918 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e3a954-0aef-497e-96f2-df56836beee7 None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:52.743569 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e3a954-0aef-497e-96f2-df56836beee7 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:52.744044 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e3a954-0aef-497e-96f2-df56836beee7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:52.765656 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 918/1838] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:35:52 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 25 02:35:52.770398 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-01e3a954-0aef-497e-96f2-df56836beee7 None None] MFA Rules not processed for user `8c085bb40bdb48ffac31f60f915101e1`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:35:52.771626 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-01e3a954-0aef-497e-96f2-df56836beee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:35:52.775713 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cdc60c-6549-4a00-b71a-744897d49459 None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:52.777066 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-44cdc60c-6549-4a00-b71a-744897d49459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:35:52.839022 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cdc60c-6549-4a00-b71a-744897d49459 None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:52.858891 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 921/1839] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:35:52 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:35:52.901570 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7938a9-cb0d-49f4-9327-dbbed9f94edd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cc5249aea09430080e232cf17757f86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:52.902220 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7938a9-cb0d-49f4-9327-dbbed9f94edd service cinder] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:52.902500 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7938a9-cb0d-49f4-9327-dbbed9f94edd service cinder] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:52.902795 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7938a9-cb0d-49f4-9327-dbbed9f94edd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:52.910472 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e3a954-0aef-497e-96f2-df56836beee7 None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:52.911978 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-01e3a954-0aef-497e-96f2-df56836beee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:35:52.926784 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e3a954-0aef-497e-96f2-df56836beee7 None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:52.931885 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9dbc4b-d215-43d9-8532-f60530d3c094 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cc5249aea09430080e232cf17757f86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:52.932547 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9dbc4b-d215-43d9-8532-f60530d3c094 service cinder] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:52.932880 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9dbc4b-d215-43d9-8532-f60530d3c094 service cinder] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:52.933162 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9dbc4b-d215-43d9-8532-f60530d3c094 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:52.942634 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9dbc4b-d215-43d9-8532-f60530d3c094 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:52.944990 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9dbc4b-d215-43d9-8532-f60530d3c094 service cinder] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:52.954467 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 922/1840] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:35:52 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 25 02:35:52.977297 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7938a9-cb0d-49f4-9327-dbbed9f94edd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:52.979415 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7938a9-cb0d-49f4-9327-dbbed9f94edd service cinder] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:52.994781 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 919/1841] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:35:52 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 25 02:35:53.010472 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9dbc4b-d215-43d9-8532-f60530d3c094 service cinder] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:53.020000 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9dbc4b-d215-43d9-8532-f60530d3c094 service cinder] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:53.024127 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd77a70e-e383-4107-8fe3-6cd6f797a059 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cc5249aea09430080e232cf17757f86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:53.024771 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd77a70e-e383-4107-8fe3-6cd6f797a059 service cinder] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:53.025559 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd77a70e-e383-4107-8fe3-6cd6f797a059 service cinder] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:53.025757 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd77a70e-e383-4107-8fe3-6cd6f797a059 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:53.034162 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-fd77a70e-e383-4107-8fe3-6cd6f797a059 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:35:53.114030 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd77a70e-e383-4107-8fe3-6cd6f797a059 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:53.115518 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd77a70e-e383-4107-8fe3-6cd6f797a059 service cinder] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:53.127058 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 923/1842] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:35:53 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:35:53.317146 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7938a9-cb0d-49f4-9327-dbbed9f94edd service cinder] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:53.329088 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7938a9-cb0d-49f4-9327-dbbed9f94edd service cinder] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:53.333684 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455f9e35-e4c2-43f8-a493-c3e6f4cb9372 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cc5249aea09430080e232cf17757f86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:53.335371 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455f9e35-e4c2-43f8-a493-c3e6f4cb9372 service cinder] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:53.335918 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455f9e35-e4c2-43f8-a493-c3e6f4cb9372 service cinder] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:53.336288 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455f9e35-e4c2-43f8-a493-c3e6f4cb9372 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:53.361438 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd77a70e-e383-4107-8fe3-6cd6f797a059 service cinder] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:53.370174 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd77a70e-e383-4107-8fe3-6cd6f797a059 service cinder] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:53.382781 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562ab771-aa61-4975-956b-6bbd5af4a2e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cc5249aea09430080e232cf17757f86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:53.383521 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562ab771-aa61-4975-956b-6bbd5af4a2e9 service cinder] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:53.383606 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562ab771-aa61-4975-956b-6bbd5af4a2e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:53.383919 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562ab771-aa61-4975-956b-6bbd5af4a2e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:53.407382 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455f9e35-e4c2-43f8-a493-c3e6f4cb9372 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:53.408984 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455f9e35-e4c2-43f8-a493-c3e6f4cb9372 service cinder] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:53.419656 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 920/1843] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:35:53 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:35:53.464099 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562ab771-aa61-4975-956b-6bbd5af4a2e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:53.466071 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562ab771-aa61-4975-956b-6bbd5af4a2e9 service cinder] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:53.479562 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 924/1844] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:35:53 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 25 02:35:53.912184 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455f9e35-e4c2-43f8-a493-c3e6f4cb9372 service cinder] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:53.998618 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455f9e35-e4c2-43f8-a493-c3e6f4cb9372 service cinder] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:54.007986 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edca057-6d08-453d-8016-37c167248ab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:54.008903 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edca057-6d08-453d-8016-37c167248ab6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:54.009211 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edca057-6d08-453d-8016-37c167248ab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:54.009943 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edca057-6d08-453d-8016-37c167248ab6 admin admin] PATH_INFO: `/v3/users/b504e4523faf408196b2718443ea19e2` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:54.011403 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edca057-6d08-453d-8016-37c167248ab6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b504e4523faf408196b2718443ea19e2)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:54.013424 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edca057-6d08-453d-8016-37c167248ab6 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:54.066811 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-7edca057-6d08-453d-8016-37c167248ab6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b504e4523faf408196b2718443ea19e2'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:35:54.067510 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-7edca057-6d08-453d-8016-37c167248ab6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b504e4523faf408196b2718443ea19e2'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:35:54.074903 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-7edca057-6d08-453d-8016-37c167248ab6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b504e4523faf408196b2718443ea19e2'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:35:54.075534 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-7edca057-6d08-453d-8016-37c167248ab6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b504e4523faf408196b2718443ea19e2'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:35:54.082632 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-7edca057-6d08-453d-8016-37c167248ab6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b504e4523faf408196b2718443ea19e2'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:35:54.099608 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 921/1845] 10.222.0.117 () {58 vars in 1228 bytes} [Tue Jan 25 02:35:53 2022] DELETE /identity/v3/users/b504e4523faf408196b2718443ea19e2 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:35:54.105398 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b69e28-ffd7-4bb0-b7bc-92d98a52f4df None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:54.105694 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b69e28-ffd7-4bb0-b7bc-92d98a52f4df None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:54.106028 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b69e28-ffd7-4bb0-b7bc-92d98a52f4df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:54.123477 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-61b69e28-ffd7-4bb0-b7bc-92d98a52f4df None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:35:54.124793 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-61b69e28-ffd7-4bb0-b7bc-92d98a52f4df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:35:54.183166 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 925/1846] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:35:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:35:54.192639 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edca057-6d08-453d-8016-37c167248ab6 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:54.194807 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-7edca057-6d08-453d-8016-37c167248ab6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:35:54.257711 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edca057-6d08-453d-8016-37c167248ab6 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:54.261942 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad72233-2092-4d31-94e4-e6ad960d40e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca4071c5f8f4a31b5edb81fa66a43a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:54.262832 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad72233-2092-4d31-94e4-e6ad960d40e3 service neutron] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:54.263270 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad72233-2092-4d31-94e4-e6ad960d40e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:54.263747 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad72233-2092-4d31-94e4-e6ad960d40e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:54.275650 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad72233-2092-4d31-94e4-e6ad960d40e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:54.284862 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad72233-2092-4d31-94e4-e6ad960d40e3 service neutron] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:54.296950 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 922/1847] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:35:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:35:55.474230 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b69e28-ffd7-4bb0-b7bc-92d98a52f4df None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:55.477577 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-61b69e28-ffd7-4bb0-b7bc-92d98a52f4df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:35:55.492650 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b69e28-ffd7-4bb0-b7bc-92d98a52f4df None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:55.507842 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3688c3ab-ec9e-4587-a76c-5212b3b6fcfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:55.509341 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3688c3ab-ec9e-4587-a76c-5212b3b6fcfa admin admin] REQUEST_METHOD: `DELETE` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:55.509810 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3688c3ab-ec9e-4587-a76c-5212b3b6fcfa admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:55.510320 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3688c3ab-ec9e-4587-a76c-5212b3b6fcfa admin admin] PATH_INFO: `/v3/projects/58647b4771c04d1cb0a01d25bd9128f1` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:55.522293 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3688c3ab-ec9e-4587-a76c-5212b3b6fcfa admin admin] RBAC: Authorizing `identity:delete_project(project_id=58647b4771c04d1cb0a01d25bd9128f1)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:55.524678 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3688c3ab-ec9e-4587-a76c-5212b3b6fcfa admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:55.595803 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-3688c3ab-ec9e-4587-a76c-5212b3b6fcfa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58647b4771c04d1cb0a01d25bd9128f1', 'request_id': 'req-3688c3ab-ec9e-4587-a76c-5212b3b6fcfa'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:35:55.603228 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-3688c3ab-ec9e-4587-a76c-5212b3b6fcfa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58647b4771c04d1cb0a01d25bd9128f1', 'request_id': 'req-3688c3ab-ec9e-4587-a76c-5212b3b6fcfa'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:35:55.609993 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-3688c3ab-ec9e-4587-a76c-5212b3b6fcfa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58647b4771c04d1cb0a01d25bd9128f1', 'request_id': 'req-3688c3ab-ec9e-4587-a76c-5212b3b6fcfa'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:35:55.624271 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-3688c3ab-ec9e-4587-a76c-5212b3b6fcfa admin admin] The token cache is being invalidate because project 58647b4771c04d1cb0a01d25bd9128f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79120) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 25 02:35:55.624572 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-3688c3ab-ec9e-4587-a76c-5212b3b6fcfa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:35:55.625287 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-3688c3ab-ec9e-4587-a76c-5212b3b6fcfa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:35:55.627053 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 926/1848] 10.222.0.117 () {58 vars in 1237 bytes} [Tue Jan 25 02:35:55 2022] DELETE /identity/v3/projects/58647b4771c04d1cb0a01d25bd9128f1 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:35:55.630957 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad72233-2092-4d31-94e4-e6ad960d40e3 service neutron] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:55.641517 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad72233-2092-4d31-94e4-e6ad960d40e3 service neutron] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:55.719384 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c120f61d-3ab8-4b13-876b-643685dc6ff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:55.720306 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c120f61d-3ab8-4b13-876b-643685dc6ff6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:55.720591 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c120f61d-3ab8-4b13-876b-643685dc6ff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:55.720868 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c120f61d-3ab8-4b13-876b-643685dc6ff6 admin admin] PATH_INFO: `/v3/users/8c085bb40bdb48ffac31f60f915101e1` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:55.722170 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c120f61d-3ab8-4b13-876b-643685dc6ff6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c085bb40bdb48ffac31f60f915101e1)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:55.724198 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c120f61d-3ab8-4b13-876b-643685dc6ff6 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:55.778834 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-c120f61d-3ab8-4b13-876b-643685dc6ff6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c085bb40bdb48ffac31f60f915101e1'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:35:55.779495 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-c120f61d-3ab8-4b13-876b-643685dc6ff6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c085bb40bdb48ffac31f60f915101e1'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:35:55.786276 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-c120f61d-3ab8-4b13-876b-643685dc6ff6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c085bb40bdb48ffac31f60f915101e1'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:35:55.786922 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-c120f61d-3ab8-4b13-876b-643685dc6ff6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c085bb40bdb48ffac31f60f915101e1'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:35:55.795142 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-c120f61d-3ab8-4b13-876b-643685dc6ff6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c085bb40bdb48ffac31f60f915101e1'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:35:55.814258 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 923/1849] 10.222.0.117 () {58 vars in 1228 bytes} [Tue Jan 25 02:35:55 2022] DELETE /identity/v3/users/8c085bb40bdb48ffac31f60f915101e1 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:35:56.215022 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3688c3ab-ec9e-4587-a76c-5212b3b6fcfa admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:56.216607 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-3688c3ab-ec9e-4587-a76c-5212b3b6fcfa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:35:56.259683 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3688c3ab-ec9e-4587-a76c-5212b3b6fcfa admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:56.349701 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc45220-b7ab-4359-9824-86de0708ad90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:56.351570 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc45220-b7ab-4359-9824-86de0708ad90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:56.352088 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc45220-b7ab-4359-9824-86de0708ad90 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:56.352513 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc45220-b7ab-4359-9824-86de0708ad90 admin admin] PATH_INFO: `/v3/projects/61a73ddc0b6944339705bc095e625c96` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:56.354105 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc45220-b7ab-4359-9824-86de0708ad90 admin admin] RBAC: Authorizing `identity:delete_project(project_id=61a73ddc0b6944339705bc095e625c96)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:56.356267 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc45220-b7ab-4359-9824-86de0708ad90 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:56.413066 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-6bc45220-b7ab-4359-9824-86de0708ad90 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61a73ddc0b6944339705bc095e625c96', 'request_id': 'req-6bc45220-b7ab-4359-9824-86de0708ad90'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:35:56.421918 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-6bc45220-b7ab-4359-9824-86de0708ad90 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61a73ddc0b6944339705bc095e625c96', 'request_id': 'req-6bc45220-b7ab-4359-9824-86de0708ad90'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:35:56.429516 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-6bc45220-b7ab-4359-9824-86de0708ad90 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61a73ddc0b6944339705bc095e625c96', 'request_id': 'req-6bc45220-b7ab-4359-9824-86de0708ad90'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:35:56.449780 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-6bc45220-b7ab-4359-9824-86de0708ad90 admin admin] The token cache is being invalidate because project 61a73ddc0b6944339705bc095e625c96 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79120) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 25 02:35:56.449780 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-6bc45220-b7ab-4359-9824-86de0708ad90 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:35:56.450079 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-6bc45220-b7ab-4359-9824-86de0708ad90 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:35:56.455870 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 927/1850] 10.222.0.117 () {58 vars in 1237 bytes} [Tue Jan 25 02:35:56 2022] DELETE /identity/v3/projects/61a73ddc0b6944339705bc095e625c96 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 25 02:35:56.457576 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92124e2-8f3b-4a22-82ff-dc8cdcea2b47 None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:56.457862 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92124e2-8f3b-4a22-82ff-dc8cdcea2b47 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:56.458632 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92124e2-8f3b-4a22-82ff-dc8cdcea2b47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:56.483541 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-c92124e2-8f3b-4a22-82ff-dc8cdcea2b47 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:35:56.485291 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-c92124e2-8f3b-4a22-82ff-dc8cdcea2b47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:35:56.567270 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 924/1851] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:35:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:35:56.577702 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd4e75f-f970-49ac-9481-7716c4237b1a None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:56.578203 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd4e75f-f970-49ac-9481-7716c4237b1a None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:56.578356 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd4e75f-f970-49ac-9481-7716c4237b1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:56.620354 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-7fd4e75f-f970-49ac-9481-7716c4237b1a None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:35:56.623671 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-7fd4e75f-f970-49ac-9481-7716c4237b1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:35:56.649331 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 928/1852] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:35:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:35:56.653530 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92124e2-8f3b-4a22-82ff-dc8cdcea2b47 None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:56.670001 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92124e2-8f3b-4a22-82ff-dc8cdcea2b47 None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:56.696990 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1590ef-bdc2-4a13-a302-ed17d48d683b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:56.698109 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1590ef-bdc2-4a13-a302-ed17d48d683b admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:56.698552 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1590ef-bdc2-4a13-a302-ed17d48d683b admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:56.698821 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1590ef-bdc2-4a13-a302-ed17d48d683b admin admin] PATH_INFO: `/v3/domains` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:56.699810 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1590ef-bdc2-4a13-a302-ed17d48d683b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:35:56.700154 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1590ef-bdc2-4a13-a302-ed17d48d683b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:56.701806 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1590ef-bdc2-4a13-a302-ed17d48d683b admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:56.728479 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 925/1853] 10.222.0.117 () {58 vars in 1157 bytes} [Tue Jan 25 02:35:56 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:35:56.732831 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd4e75f-f970-49ac-9481-7716c4237b1a None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:56.742782 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd4e75f-f970-49ac-9481-7716c4237b1a None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:56.747829 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6ef660-8daa-4e8c-8e94-5bc1fc522f21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:56.748501 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6ef660-8daa-4e8c-8e94-5bc1fc522f21 admin admin] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:56.748790 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6ef660-8daa-4e8c-8e94-5bc1fc522f21 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:56.749068 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6ef660-8daa-4e8c-8e94-5bc1fc522f21 admin admin] PATH_INFO: `/v3/projects` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:56.749823 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6ef660-8daa-4e8c-8e94-5bc1fc522f21 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:56.751950 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6ef660-8daa-4e8c-8e94-5bc1fc522f21 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:56.784382 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 929/1854] 10.222.0.117 () {60 vars in 1157 bytes} [Tue Jan 25 02:35:56 2022] POST /identity/v3/projects => generated 384 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 25 02:35:56.790239 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1590ef-bdc2-4a13-a302-ed17d48d683b admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:56.816402 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1590ef-bdc2-4a13-a302-ed17d48d683b admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:56.883422 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a75ba0-6eb8-4972-9b5a-1699f93a8faf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:56.884173 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a75ba0-6eb8-4972-9b5a-1699f93a8faf admin admin] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:56.884413 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a75ba0-6eb8-4972-9b5a-1699f93a8faf admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:56.884689 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a75ba0-6eb8-4972-9b5a-1699f93a8faf admin admin] PATH_INFO: `/v3/users` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:56.885401 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a75ba0-6eb8-4972-9b5a-1699f93a8faf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:56.887377 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a75ba0-6eb8-4972-9b5a-1699f93a8faf admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:56.910023 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 926/1855] 10.222.0.117 () {60 vars in 1148 bytes} [Tue Jan 25 02:35:56 2022] POST /identity/v3/users => generated 293 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 02:35:56.914744 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6ef660-8daa-4e8c-8e94-5bc1fc522f21 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:56.926296 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6ef660-8daa-4e8c-8e94-5bc1fc522f21 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:56.932447 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39043eed-7c7a-42c3-889d-2799b8d1580e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:56.933221 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39043eed-7c7a-42c3-889d-2799b8d1580e admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:56.933592 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39043eed-7c7a-42c3-889d-2799b8d1580e admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:56.933932 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39043eed-7c7a-42c3-889d-2799b8d1580e admin admin] PATH_INFO: `/v3/roles` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:56.934749 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39043eed-7c7a-42c3-889d-2799b8d1580e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:56.936523 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39043eed-7c7a-42c3-889d-2799b8d1580e admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:56.947949 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 930/1856] 10.222.0.117 () {58 vars in 1126 bytes} [Tue Jan 25 02:35:56 2022] GET /identity/v3/roles => generated 1427 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 02:35:56.952100 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a75ba0-6eb8-4972-9b5a-1699f93a8faf admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:56.962840 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a75ba0-6eb8-4972-9b5a-1699f93a8faf admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:56.967609 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475b50a5-1f7a-41b6-b5f3-762dd7d08b1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:56.968299 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475b50a5-1f7a-41b6-b5f3-762dd7d08b1f admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:56.968578 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475b50a5-1f7a-41b6-b5f3-762dd7d08b1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:56.968852 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475b50a5-1f7a-41b6-b5f3-762dd7d08b1f admin admin] PATH_INFO: `/v3/roles` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:56.969592 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475b50a5-1f7a-41b6-b5f3-762dd7d08b1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:56.971194 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475b50a5-1f7a-41b6-b5f3-762dd7d08b1f admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:56.983939 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 927/1857] 10.222.0.117 () {58 vars in 1126 bytes} [Tue Jan 25 02:35:56 2022] GET /identity/v3/roles => generated 1427 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 02:35:56.988239 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39043eed-7c7a-42c3-889d-2799b8d1580e admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:57.011475 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39043eed-7c7a-42c3-889d-2799b8d1580e admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:57.017676 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edbedc3-f437-44f0-893e-28a31af5be1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:57.018751 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edbedc3-f437-44f0-893e-28a31af5be1c admin admin] REQUEST_METHOD: `PUT` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:57.019037 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edbedc3-f437-44f0-893e-28a31af5be1c admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:57.019313 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edbedc3-f437-44f0-893e-28a31af5be1c admin admin] PATH_INFO: `/v3/projects/0dff1333b0ca43daae5efd7d6a54e36e/users/5d979e82744b40c09876944742f27aaa/roles/33a8e87420ed423f9cb29e0084eab5d2` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:57.038119 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edbedc3-f437-44f0-893e-28a31af5be1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=0dff1333b0ca43daae5efd7d6a54e36e, user_id=5d979e82744b40c09876944742f27aaa, role_id=33a8e87420ed423f9cb29e0084eab5d2)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:57.041335 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edbedc3-f437-44f0-893e-28a31af5be1c admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:57.055426 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 931/1858] 10.222.0.117 () {60 vars in 1487 bytes} [Tue Jan 25 02:35:56 2022] PUT /identity/v3/projects/0dff1333b0ca43daae5efd7d6a54e36e/users/5d979e82744b40c09876944742f27aaa/roles/33a8e87420ed423f9cb29e0084eab5d2 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:35:57.067102 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3c2f0a-2c3f-493f-b522-c1d3ee3fbac6 None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:57.067473 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3c2f0a-2c3f-493f-b522-c1d3ee3fbac6 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:57.067846 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3c2f0a-2c3f-493f-b522-c1d3ee3fbac6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:57.095661 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-cb3c2f0a-2c3f-493f-b522-c1d3ee3fbac6 None None] MFA Rules not processed for user `5d979e82744b40c09876944742f27aaa`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:35:57.096935 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-cb3c2f0a-2c3f-493f-b522-c1d3ee3fbac6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:35:57.165861 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 928/1859] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:35:57 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:35:57.169387 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edbedc3-f437-44f0-893e-28a31af5be1c admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:57.233290 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edbedc3-f437-44f0-893e-28a31af5be1c admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:57.238046 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6663f0-183a-41af-9f6e-bba2619a7f6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:57.238711 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6663f0-183a-41af-9f6e-bba2619a7f6c admin admin] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:57.238997 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6663f0-183a-41af-9f6e-bba2619a7f6c admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:57.239275 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6663f0-183a-41af-9f6e-bba2619a7f6c admin admin] PATH_INFO: `/v3/projects` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:57.240030 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6663f0-183a-41af-9f6e-bba2619a7f6c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:57.242681 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6663f0-183a-41af-9f6e-bba2619a7f6c admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:57.271455 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 932/1860] 10.222.0.117 () {60 vars in 1157 bytes} [Tue Jan 25 02:35:57 2022] POST /identity/v3/projects => generated 386 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 02:35:57.276543 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3c2f0a-2c3f-493f-b522-c1d3ee3fbac6 None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:57.289375 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3c2f0a-2c3f-493f-b522-c1d3ee3fbac6 None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:57.353418 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b2ec42-6261-4692-b3b3-cb3146f67ae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:57.354099 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b2ec42-6261-4692-b3b3-cb3146f67ae9 admin admin] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:57.354498 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b2ec42-6261-4692-b3b3-cb3146f67ae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:57.354937 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b2ec42-6261-4692-b3b3-cb3146f67ae9 admin admin] PATH_INFO: `/v3/users` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:57.355375 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b2ec42-6261-4692-b3b3-cb3146f67ae9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:57.357359 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b2ec42-6261-4692-b3b3-cb3146f67ae9 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:57.381640 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 929/1861] 10.222.0.117 () {60 vars in 1148 bytes} [Tue Jan 25 02:35:57 2022] POST /identity/v3/users => generated 300 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 02:35:57.383196 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6663f0-183a-41af-9f6e-bba2619a7f6c admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:57.393356 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6663f0-183a-41af-9f6e-bba2619a7f6c admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:57.398511 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5da068-66aa-453c-84a1-bfce18611ac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:57.399177 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5da068-66aa-453c-84a1-bfce18611ac6 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:57.399461 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5da068-66aa-453c-84a1-bfce18611ac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:57.399769 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5da068-66aa-453c-84a1-bfce18611ac6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:57.400515 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5da068-66aa-453c-84a1-bfce18611ac6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:57.402108 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5da068-66aa-453c-84a1-bfce18611ac6 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:57.413118 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 933/1862] 10.222.0.117 () {58 vars in 1126 bytes} [Tue Jan 25 02:35:57 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 25 02:35:57.417086 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b2ec42-6261-4692-b3b3-cb3146f67ae9 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:57.426945 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b2ec42-6261-4692-b3b3-cb3146f67ae9 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:57.432330 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6ad088-829c-4756-96a2-16ead0c8669a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:57.433208 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6ad088-829c-4756-96a2-16ead0c8669a admin admin] REQUEST_METHOD: `PUT` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:57.433495 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6ad088-829c-4756-96a2-16ead0c8669a admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:57.433893 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6ad088-829c-4756-96a2-16ead0c8669a admin admin] PATH_INFO: `/v3/projects/177aba8c082f45d488d8fe79c1687d06/users/35a05eca14c94ad387e3c667a12049b1/roles/d8dbc6d83d9d41d28c3feb8b3485b291` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:57.449883 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6ad088-829c-4756-96a2-16ead0c8669a admin admin] RBAC: Authorizing `identity:create_grant(project_id=177aba8c082f45d488d8fe79c1687d06, user_id=35a05eca14c94ad387e3c667a12049b1, role_id=d8dbc6d83d9d41d28c3feb8b3485b291)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:57.452603 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6ad088-829c-4756-96a2-16ead0c8669a admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:57.466644 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 930/1863] 10.222.0.117 () {60 vars in 1487 bytes} [Tue Jan 25 02:35:57 2022] PUT /identity/v3/projects/177aba8c082f45d488d8fe79c1687d06/users/35a05eca14c94ad387e3c667a12049b1/roles/d8dbc6d83d9d41d28c3feb8b3485b291 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 25 02:35:57.470976 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5da068-66aa-453c-84a1-bfce18611ac6 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:57.482762 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5da068-66aa-453c-84a1-bfce18611ac6 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:57.540010 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb94fd4-3bc2-4f3b-932e-bff8a7b62cb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:57.540692 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb94fd4-3bc2-4f3b-932e-bff8a7b62cb9 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:57.540978 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb94fd4-3bc2-4f3b-932e-bff8a7b62cb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:57.541280 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb94fd4-3bc2-4f3b-932e-bff8a7b62cb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:57.542079 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb94fd4-3bc2-4f3b-932e-bff8a7b62cb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:57.544454 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb94fd4-3bc2-4f3b-932e-bff8a7b62cb9 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:57.561971 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 934/1864] 10.222.0.117 () {58 vars in 1126 bytes} [Tue Jan 25 02:35:57 2022] GET /identity/v3/roles => generated 1427 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 25 02:35:57.563098 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6ad088-829c-4756-96a2-16ead0c8669a admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:57.574068 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6ad088-829c-4756-96a2-16ead0c8669a admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:57.578838 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcef80b-660f-458f-85cc-ffba6c82d6ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:57.579900 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcef80b-660f-458f-85cc-ffba6c82d6ab admin admin] REQUEST_METHOD: `PUT` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:57.580242 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcef80b-660f-458f-85cc-ffba6c82d6ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:57.580582 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcef80b-660f-458f-85cc-ffba6c82d6ab admin admin] PATH_INFO: `/v3/projects/177aba8c082f45d488d8fe79c1687d06/users/35a05eca14c94ad387e3c667a12049b1/roles/d8dbc6d83d9d41d28c3feb8b3485b291` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:57.582815 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcef80b-660f-458f-85cc-ffba6c82d6ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=177aba8c082f45d488d8fe79c1687d06, user_id=35a05eca14c94ad387e3c667a12049b1, role_id=d8dbc6d83d9d41d28c3feb8b3485b291)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:57.588058 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcef80b-660f-458f-85cc-ffba6c82d6ab admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:57.603374 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 931/1865] 10.222.0.117 () {60 vars in 1487 bytes} [Tue Jan 25 02:35:57 2022] PUT /identity/v3/projects/177aba8c082f45d488d8fe79c1687d06/users/35a05eca14c94ad387e3c667a12049b1/roles/d8dbc6d83d9d41d28c3feb8b3485b291 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:35:57.613494 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e951f3-3ea7-47a1-b037-b09d0dbbf674 None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:57.613977 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e951f3-3ea7-47a1-b037-b09d0dbbf674 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:57.614060 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e951f3-3ea7-47a1-b037-b09d0dbbf674 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:57.646575 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-e2e951f3-3ea7-47a1-b037-b09d0dbbf674 None None] MFA Rules not processed for user `35a05eca14c94ad387e3c667a12049b1`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:35:57.648522 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-e2e951f3-3ea7-47a1-b037-b09d0dbbf674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:35:57.750083 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 935/1866] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:35:57 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:35:57.766743 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcef80b-660f-458f-85cc-ffba6c82d6ab admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:35:57.772896 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-7dcef80b-660f-458f-85cc-ffba6c82d6ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:35:57.842139 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcef80b-660f-458f-85cc-ffba6c82d6ab admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:35:57.846727 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72cebcd-5b3a-45dc-b011-ccfde12cdb60 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cc5249aea09430080e232cf17757f86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:35:57.855109 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72cebcd-5b3a-45dc-b011-ccfde12cdb60 service cinder] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:35:57.855730 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72cebcd-5b3a-45dc-b011-ccfde12cdb60 service cinder] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:35:57.856174 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72cebcd-5b3a-45dc-b011-ccfde12cdb60 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:35:57.997813 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72cebcd-5b3a-45dc-b011-ccfde12cdb60 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:35:58.001783 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72cebcd-5b3a-45dc-b011-ccfde12cdb60 service cinder] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:35:58.018322 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 932/1867] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:35:57 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:36:00.380086 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e951f3-3ea7-47a1-b037-b09d0dbbf674 None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:00.382564 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-e2e951f3-3ea7-47a1-b037-b09d0dbbf674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:36:00.495456 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e951f3-3ea7-47a1-b037-b09d0dbbf674 None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:00.501526 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d50dcb-78ba-4846-a1ab-bdef40b8f200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:00.502929 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d50dcb-78ba-4846-a1ab-bdef40b8f200 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:00.503523 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d50dcb-78ba-4846-a1ab-bdef40b8f200 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:00.503732 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d50dcb-78ba-4846-a1ab-bdef40b8f200 admin admin] PATH_INFO: `/v3/users/658856108a774d89b05260b7579813cc` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:00.504988 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d50dcb-78ba-4846-a1ab-bdef40b8f200 admin admin] RBAC: Authorizing `identity:delete_user(user_id=658856108a774d89b05260b7579813cc)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:00.508545 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d50dcb-78ba-4846-a1ab-bdef40b8f200 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:00.565049 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-a2d50dcb-78ba-4846-a1ab-bdef40b8f200 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '658856108a774d89b05260b7579813cc'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:00.581677 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-a2d50dcb-78ba-4846-a1ab-bdef40b8f200 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '658856108a774d89b05260b7579813cc'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:00.582558 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-a2d50dcb-78ba-4846-a1ab-bdef40b8f200 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '658856108a774d89b05260b7579813cc'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:00.583200 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-a2d50dcb-78ba-4846-a1ab-bdef40b8f200 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '658856108a774d89b05260b7579813cc'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:00.605229 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-a2d50dcb-78ba-4846-a1ab-bdef40b8f200 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '658856108a774d89b05260b7579813cc'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:00.633668 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 936/1868] 10.222.0.117 () {58 vars in 1228 bytes} [Tue Jan 25 02:36:00 2022] DELETE /identity/v3/users/658856108a774d89b05260b7579813cc => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:36:00.638886 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964b127c-0407-42e5-ae67-4e435c910dab None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:00.639365 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964b127c-0407-42e5-ae67-4e435c910dab None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:00.639508 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964b127c-0407-42e5-ae67-4e435c910dab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:00.657678 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-964b127c-0407-42e5-ae67-4e435c910dab None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:36:00.659162 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-964b127c-0407-42e5-ae67-4e435c910dab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:36:00.725914 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 933/1869] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:36:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:36:00.733862 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d50dcb-78ba-4846-a1ab-bdef40b8f200 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:00.735276 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-a2d50dcb-78ba-4846-a1ab-bdef40b8f200 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:36:00.793471 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d50dcb-78ba-4846-a1ab-bdef40b8f200 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:00.797154 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248de492-079d-442d-b4fe-f806932ebf39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca4071c5f8f4a31b5edb81fa66a43a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:00.797797 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248de492-079d-442d-b4fe-f806932ebf39 service neutron] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:00.798077 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248de492-079d-442d-b4fe-f806932ebf39 service neutron] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:00.798347 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248de492-079d-442d-b4fe-f806932ebf39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:00.808833 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248de492-079d-442d-b4fe-f806932ebf39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:00.810251 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248de492-079d-442d-b4fe-f806932ebf39 service neutron] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:00.820663 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 937/1870] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:36:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:36:01.121256 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964b127c-0407-42e5-ae67-4e435c910dab None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:01.122799 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-964b127c-0407-42e5-ae67-4e435c910dab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:36:01.138552 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964b127c-0407-42e5-ae67-4e435c910dab None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:01.146232 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d718cd15-777b-4a20-80af-9c11a2e844c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:01.147955 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d718cd15-777b-4a20-80af-9c11a2e844c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:01.148243 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d718cd15-777b-4a20-80af-9c11a2e844c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:01.148523 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d718cd15-777b-4a20-80af-9c11a2e844c5 admin admin] PATH_INFO: `/v3/projects/2ed91c31402047789283f647ff5815fa` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:01.149756 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d718cd15-777b-4a20-80af-9c11a2e844c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ed91c31402047789283f647ff5815fa)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:01.152787 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d718cd15-777b-4a20-80af-9c11a2e844c5 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:01.202864 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-d718cd15-777b-4a20-80af-9c11a2e844c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ed91c31402047789283f647ff5815fa', 'request_id': 'req-d718cd15-777b-4a20-80af-9c11a2e844c5'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:01.212430 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-d718cd15-777b-4a20-80af-9c11a2e844c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ed91c31402047789283f647ff5815fa', 'request_id': 'req-d718cd15-777b-4a20-80af-9c11a2e844c5'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:01.221169 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-d718cd15-777b-4a20-80af-9c11a2e844c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ed91c31402047789283f647ff5815fa', 'request_id': 'req-d718cd15-777b-4a20-80af-9c11a2e844c5'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:01.235231 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-d718cd15-777b-4a20-80af-9c11a2e844c5 admin admin] The token cache is being invalidate because project 2ed91c31402047789283f647ff5815fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79121) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 25 02:36:01.235519 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-d718cd15-777b-4a20-80af-9c11a2e844c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:01.236469 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-d718cd15-777b-4a20-80af-9c11a2e844c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:01.238131 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 934/1871] 10.222.0.117 () {58 vars in 1237 bytes} [Tue Jan 25 02:36:01 2022] DELETE /identity/v3/projects/2ed91c31402047789283f647ff5815fa => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:36:01.244983 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8552b291-7f58-4fff-b82a-3976563800cd None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:01.245505 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8552b291-7f58-4fff-b82a-3976563800cd None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:01.245948 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8552b291-7f58-4fff-b82a-3976563800cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:01.272040 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-8552b291-7f58-4fff-b82a-3976563800cd None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:36:01.273885 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-8552b291-7f58-4fff-b82a-3976563800cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:36:01.358016 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 938/1872] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:36:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:36:01.361838 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914f1b47-49c5-4065-8f2e-3ba79375843f None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:01.362151 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914f1b47-49c5-4065-8f2e-3ba79375843f None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:01.362453 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914f1b47-49c5-4065-8f2e-3ba79375843f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:01.383599 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-914f1b47-49c5-4065-8f2e-3ba79375843f None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:36:01.384922 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-914f1b47-49c5-4065-8f2e-3ba79375843f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:36:01.394337 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 935/1873] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:36:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:36:01.399674 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8552b291-7f58-4fff-b82a-3976563800cd None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:01.410347 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8552b291-7f58-4fff-b82a-3976563800cd None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:01.417596 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3460a1-20ca-4769-b4a4-e21bd9b8a2c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:01.418689 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3460a1-20ca-4769-b4a4-e21bd9b8a2c5 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:01.419076 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3460a1-20ca-4769-b4a4-e21bd9b8a2c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:01.419504 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3460a1-20ca-4769-b4a4-e21bd9b8a2c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:01.420504 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3460a1-20ca-4769-b4a4-e21bd9b8a2c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:36:01.421018 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3460a1-20ca-4769-b4a4-e21bd9b8a2c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:01.423025 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3460a1-20ca-4769-b4a4-e21bd9b8a2c5 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:01.437394 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 939/1874] 10.222.0.117 () {58 vars in 1157 bytes} [Tue Jan 25 02:36:01 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:36:01.442191 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914f1b47-49c5-4065-8f2e-3ba79375843f None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:01.453518 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914f1b47-49c5-4065-8f2e-3ba79375843f None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:01.460268 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92121b4-edc5-469a-b857-4cc711405a70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:01.461826 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92121b4-edc5-469a-b857-4cc711405a70 admin admin] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:01.462494 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92121b4-edc5-469a-b857-4cc711405a70 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:01.462878 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92121b4-edc5-469a-b857-4cc711405a70 admin admin] PATH_INFO: `/v3/projects` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:01.464107 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92121b4-edc5-469a-b857-4cc711405a70 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:01.466208 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92121b4-edc5-469a-b857-4cc711405a70 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:01.508504 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 936/1875] 10.222.0.117 () {60 vars in 1157 bytes} [Tue Jan 25 02:36:01 2022] POST /identity/v3/projects => generated 376 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 25 02:36:01.512540 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3460a1-20ca-4769-b4a4-e21bd9b8a2c5 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:01.525021 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3460a1-20ca-4769-b4a4-e21bd9b8a2c5 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:01.619108 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed935404-212e-4583-8cd3-ae3d8d3b6eb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:01.620684 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed935404-212e-4583-8cd3-ae3d8d3b6eb1 admin admin] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:01.621774 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed935404-212e-4583-8cd3-ae3d8d3b6eb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:01.623047 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed935404-212e-4583-8cd3-ae3d8d3b6eb1 admin admin] PATH_INFO: `/v3/users` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:01.624914 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed935404-212e-4583-8cd3-ae3d8d3b6eb1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:01.627359 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed935404-212e-4583-8cd3-ae3d8d3b6eb1 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:01.675456 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 940/1876] 10.222.0.117 () {60 vars in 1148 bytes} [Tue Jan 25 02:36:01 2022] POST /identity/v3/users => generated 289 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 02:36:01.681242 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92121b4-edc5-469a-b857-4cc711405a70 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:01.694327 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92121b4-edc5-469a-b857-4cc711405a70 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:01.703038 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989af89d-8f0d-4a9a-ac19-b5bbc1b19f1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:01.704020 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989af89d-8f0d-4a9a-ac19-b5bbc1b19f1c admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:01.704382 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989af89d-8f0d-4a9a-ac19-b5bbc1b19f1c admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:01.704777 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989af89d-8f0d-4a9a-ac19-b5bbc1b19f1c admin admin] PATH_INFO: `/v3/roles` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:01.705600 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989af89d-8f0d-4a9a-ac19-b5bbc1b19f1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:01.707654 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989af89d-8f0d-4a9a-ac19-b5bbc1b19f1c admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:01.721384 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 937/1877] 10.222.0.117 () {58 vars in 1126 bytes} [Tue Jan 25 02:36:01 2022] GET /identity/v3/roles => generated 1427 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 02:36:01.726128 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed935404-212e-4583-8cd3-ae3d8d3b6eb1 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:01.736907 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed935404-212e-4583-8cd3-ae3d8d3b6eb1 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:01.746604 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980f1a63-0f3a-422b-924e-44561dd5e2f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:01.747516 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980f1a63-0f3a-422b-924e-44561dd5e2f8 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:01.747969 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980f1a63-0f3a-422b-924e-44561dd5e2f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:01.748375 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980f1a63-0f3a-422b-924e-44561dd5e2f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:01.749559 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980f1a63-0f3a-422b-924e-44561dd5e2f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:01.751445 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980f1a63-0f3a-422b-924e-44561dd5e2f8 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:01.767685 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 941/1878] 10.222.0.117 () {58 vars in 1126 bytes} [Tue Jan 25 02:36:01 2022] GET /identity/v3/roles => generated 1427 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 02:36:01.768422 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989af89d-8f0d-4a9a-ac19-b5bbc1b19f1c admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:01.780375 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989af89d-8f0d-4a9a-ac19-b5bbc1b19f1c admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:01.785979 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe2fd43-fc7d-4595-a243-bc1c612c1714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:01.787047 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe2fd43-fc7d-4595-a243-bc1c612c1714 admin admin] REQUEST_METHOD: `PUT` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:01.788182 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe2fd43-fc7d-4595-a243-bc1c612c1714 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:01.788605 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe2fd43-fc7d-4595-a243-bc1c612c1714 admin admin] PATH_INFO: `/v3/projects/c8955a0c04cb4800969274256ab88b1a/users/8e115dbde688477ead71c57a8ed85416/roles/33a8e87420ed423f9cb29e0084eab5d2` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:01.808092 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe2fd43-fc7d-4595-a243-bc1c612c1714 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8955a0c04cb4800969274256ab88b1a, user_id=8e115dbde688477ead71c57a8ed85416, role_id=33a8e87420ed423f9cb29e0084eab5d2)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:01.811605 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe2fd43-fc7d-4595-a243-bc1c612c1714 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:01.848722 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 938/1879] 10.222.0.117 () {60 vars in 1487 bytes} [Tue Jan 25 02:36:01 2022] PUT /identity/v3/projects/c8955a0c04cb4800969274256ab88b1a/users/8e115dbde688477ead71c57a8ed85416/roles/33a8e87420ed423f9cb29e0084eab5d2 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 25 02:36:01.860966 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa38ec7e-a723-48fb-9833-04c35e37465c None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:01.861401 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa38ec7e-a723-48fb-9833-04c35e37465c None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:01.861836 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa38ec7e-a723-48fb-9833-04c35e37465c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:01.918109 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-aa38ec7e-a723-48fb-9833-04c35e37465c None None] MFA Rules not processed for user `8e115dbde688477ead71c57a8ed85416`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:36:01.919892 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-aa38ec7e-a723-48fb-9833-04c35e37465c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:36:02.025459 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 942/1880] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:36:01 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:36:02.036503 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe2fd43-fc7d-4595-a243-bc1c612c1714 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:02.039330 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-bfe2fd43-fc7d-4595-a243-bc1c612c1714 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:36:02.153437 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe2fd43-fc7d-4595-a243-bc1c612c1714 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:02.164034 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d576877e-f878-4542-872b-6e004906a900 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9ad6269900346458050063c12cac299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:02.164697 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d576877e-f878-4542-872b-6e004906a900 service nova] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:02.164981 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d576877e-f878-4542-872b-6e004906a900 service nova] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:02.165261 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d576877e-f878-4542-872b-6e004906a900 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:02.176291 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d576877e-f878-4542-872b-6e004906a900 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:02.177996 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d576877e-f878-4542-872b-6e004906a900 service nova] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:02.190359 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 939/1881] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:36:02 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:36:02.393697 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa38ec7e-a723-48fb-9833-04c35e37465c None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:02.459187 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa38ec7e-a723-48fb-9833-04c35e37465c None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:02.464035 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d576877e-f878-4542-872b-6e004906a900 service nova] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:02.464458 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f420f18-e683-4501-8149-685ff3a8db8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:02.465330 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f420f18-e683-4501-8149-685ff3a8db8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:02.465487 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-d576877e-f878-4542-872b-6e004906a900 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:36:02.465618 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f420f18-e683-4501-8149-685ff3a8db8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:02.465905 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f420f18-e683-4501-8149-685ff3a8db8f admin admin] PATH_INFO: `/v3/users/8e115dbde688477ead71c57a8ed85416` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:02.467122 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f420f18-e683-4501-8149-685ff3a8db8f admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e115dbde688477ead71c57a8ed85416)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:02.469083 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f420f18-e683-4501-8149-685ff3a8db8f admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:02.515926 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-0f420f18-e683-4501-8149-685ff3a8db8f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e115dbde688477ead71c57a8ed85416'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:02.523384 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d576877e-f878-4542-872b-6e004906a900 service nova] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:02.523908 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-0f420f18-e683-4501-8149-685ff3a8db8f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e115dbde688477ead71c57a8ed85416'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:02.524525 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-0f420f18-e683-4501-8149-685ff3a8db8f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e115dbde688477ead71c57a8ed85416'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:02.525162 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-0f420f18-e683-4501-8149-685ff3a8db8f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e115dbde688477ead71c57a8ed85416'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:02.527716 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985643e2-f569-4c36-acdd-65776e6463a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cc5249aea09430080e232cf17757f86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:02.528386 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985643e2-f569-4c36-acdd-65776e6463a1 service cinder] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:02.528673 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985643e2-f569-4c36-acdd-65776e6463a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:02.528951 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985643e2-f569-4c36-acdd-65776e6463a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:02.530750 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-985643e2-f569-4c36-acdd-65776e6463a1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:36:02.537157 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-0f420f18-e683-4501-8149-685ff3a8db8f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e115dbde688477ead71c57a8ed85416'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:02.549504 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 943/1882] 10.222.0.117 () {58 vars in 1228 bytes} [Tue Jan 25 02:36:02 2022] DELETE /identity/v3/users/8e115dbde688477ead71c57a8ed85416 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:36:02.554419 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf2c25d-a407-422c-bd2f-2da6f44554c3 None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:02.554711 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf2c25d-a407-422c-bd2f-2da6f44554c3 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:02.554992 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf2c25d-a407-422c-bd2f-2da6f44554c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:02.572068 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-1cf2c25d-a407-422c-bd2f-2da6f44554c3 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:36:02.573273 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-1cf2c25d-a407-422c-bd2f-2da6f44554c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:36:02.595904 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985643e2-f569-4c36-acdd-65776e6463a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:02.597372 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985643e2-f569-4c36-acdd-65776e6463a1 service cinder] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:02.607486 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 940/1883] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:36:02 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:36:02.631607 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 944/1884] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:36:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 25 02:36:02.641841 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985643e2-f569-4c36-acdd-65776e6463a1 service cinder] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:02.643266 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-985643e2-f569-4c36-acdd-65776e6463a1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:36:02.713285 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985643e2-f569-4c36-acdd-65776e6463a1 service cinder] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:02.785057 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac07011-fb23-4a1f-bed9-d46c3dffdf74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca4071c5f8f4a31b5edb81fa66a43a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:02.785950 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac07011-fb23-4a1f-bed9-d46c3dffdf74 service neutron] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:02.786337 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac07011-fb23-4a1f-bed9-d46c3dffdf74 service neutron] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:02.786672 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac07011-fb23-4a1f-bed9-d46c3dffdf74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:02.800622 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac07011-fb23-4a1f-bed9-d46c3dffdf74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:02.802430 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac07011-fb23-4a1f-bed9-d46c3dffdf74 service neutron] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:02.817923 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 941/1885] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:36:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:36:03.158901 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf2c25d-a407-422c-bd2f-2da6f44554c3 None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:03.160917 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-1cf2c25d-a407-422c-bd2f-2da6f44554c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:36:03.175599 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf2c25d-a407-422c-bd2f-2da6f44554c3 None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:03.180980 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dacbea-1cdf-4cd8-9b55-3924f0ed0117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:03.181854 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dacbea-1cdf-4cd8-9b55-3924f0ed0117 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:03.182134 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dacbea-1cdf-4cd8-9b55-3924f0ed0117 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:03.182411 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dacbea-1cdf-4cd8-9b55-3924f0ed0117 admin admin] PATH_INFO: `/v3/projects/c8955a0c04cb4800969274256ab88b1a` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:03.183672 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dacbea-1cdf-4cd8-9b55-3924f0ed0117 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8955a0c04cb4800969274256ab88b1a)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:03.185625 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dacbea-1cdf-4cd8-9b55-3924f0ed0117 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:03.235293 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-54dacbea-1cdf-4cd8-9b55-3924f0ed0117 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8955a0c04cb4800969274256ab88b1a', 'request_id': 'req-54dacbea-1cdf-4cd8-9b55-3924f0ed0117'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:03.241994 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-54dacbea-1cdf-4cd8-9b55-3924f0ed0117 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8955a0c04cb4800969274256ab88b1a', 'request_id': 'req-54dacbea-1cdf-4cd8-9b55-3924f0ed0117'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:03.248423 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-54dacbea-1cdf-4cd8-9b55-3924f0ed0117 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8955a0c04cb4800969274256ab88b1a', 'request_id': 'req-54dacbea-1cdf-4cd8-9b55-3924f0ed0117'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:03.261125 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-54dacbea-1cdf-4cd8-9b55-3924f0ed0117 admin admin] The token cache is being invalidate because project c8955a0c04cb4800969274256ab88b1a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79120) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 25 02:36:03.261416 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-54dacbea-1cdf-4cd8-9b55-3924f0ed0117 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:03.262192 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-54dacbea-1cdf-4cd8-9b55-3924f0ed0117 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:03.263611 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 945/1886] 10.222.0.117 () {58 vars in 1237 bytes} [Tue Jan 25 02:36:03 2022] DELETE /identity/v3/projects/c8955a0c04cb4800969274256ab88b1a => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:36:03.269305 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36580253-e0f3-4773-a683-87147381cc49 None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:03.269599 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36580253-e0f3-4773-a683-87147381cc49 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:03.269880 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36580253-e0f3-4773-a683-87147381cc49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:03.295201 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-36580253-e0f3-4773-a683-87147381cc49 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:36:03.297488 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-36580253-e0f3-4773-a683-87147381cc49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:36:03.389451 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 942/1887] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:36:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:36:03.399728 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3cdc0e-e2a1-437e-b6cc-de33c6818b27 None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:03.399977 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3cdc0e-e2a1-437e-b6cc-de33c6818b27 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:03.400316 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3cdc0e-e2a1-437e-b6cc-de33c6818b27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:03.426507 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-8b3cdc0e-e2a1-437e-b6cc-de33c6818b27 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:36:03.428453 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-8b3cdc0e-e2a1-437e-b6cc-de33c6818b27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:36:03.438139 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 946/1888] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:36:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:36:03.442359 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36580253-e0f3-4773-a683-87147381cc49 None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:03.453030 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36580253-e0f3-4773-a683-87147381cc49 None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:03.458125 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4275e5a6-5662-479f-8ec3-7f096095b066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:03.460168 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4275e5a6-5662-479f-8ec3-7f096095b066 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:03.460561 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4275e5a6-5662-479f-8ec3-7f096095b066 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:03.461090 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4275e5a6-5662-479f-8ec3-7f096095b066 admin admin] PATH_INFO: `/v3/domains` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:03.461937 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4275e5a6-5662-479f-8ec3-7f096095b066 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:36:03.462310 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4275e5a6-5662-479f-8ec3-7f096095b066 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:03.464244 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4275e5a6-5662-479f-8ec3-7f096095b066 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:03.480366 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 943/1889] 10.222.0.117 () {58 vars in 1157 bytes} [Tue Jan 25 02:36:03 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:36:03.488842 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3cdc0e-e2a1-437e-b6cc-de33c6818b27 None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:03.498576 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3cdc0e-e2a1-437e-b6cc-de33c6818b27 None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:03.503302 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732c835e-ead0-4ccf-8b6b-5b6b53150d37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:03.504127 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732c835e-ead0-4ccf-8b6b-5b6b53150d37 admin admin] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:03.504588 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732c835e-ead0-4ccf-8b6b-5b6b53150d37 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:03.504864 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732c835e-ead0-4ccf-8b6b-5b6b53150d37 admin admin] PATH_INFO: `/v3/projects` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:03.505574 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732c835e-ead0-4ccf-8b6b-5b6b53150d37 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:03.508857 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732c835e-ead0-4ccf-8b6b-5b6b53150d37 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:03.538546 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 947/1890] 10.222.0.117 () {60 vars in 1157 bytes} [Tue Jan 25 02:36:03 2022] POST /identity/v3/projects => generated 364 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 02:36:03.542807 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4275e5a6-5662-479f-8ec3-7f096095b066 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:03.558481 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4275e5a6-5662-479f-8ec3-7f096095b066 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:03.619248 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b224136d-96b2-4c5c-96e4-e7c1a67d98e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:03.620131 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b224136d-96b2-4c5c-96e4-e7c1a67d98e2 admin admin] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:03.620462 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b224136d-96b2-4c5c-96e4-e7c1a67d98e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:03.622101 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b224136d-96b2-4c5c-96e4-e7c1a67d98e2 admin admin] PATH_INFO: `/v3/users` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:03.622101 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b224136d-96b2-4c5c-96e4-e7c1a67d98e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:03.624410 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b224136d-96b2-4c5c-96e4-e7c1a67d98e2 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:03.656081 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 944/1891] 10.222.0.117 () {60 vars in 1148 bytes} [Tue Jan 25 02:36:03 2022] POST /identity/v3/users => generated 283 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 02:36:03.656330 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732c835e-ead0-4ccf-8b6b-5b6b53150d37 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:03.668025 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732c835e-ead0-4ccf-8b6b-5b6b53150d37 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:03.673474 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea03d964-1d83-4ac8-8394-32eaf863c2c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:03.674252 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea03d964-1d83-4ac8-8394-32eaf863c2c9 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:03.674631 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea03d964-1d83-4ac8-8394-32eaf863c2c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:03.675000 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea03d964-1d83-4ac8-8394-32eaf863c2c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:03.675929 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea03d964-1d83-4ac8-8394-32eaf863c2c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:03.678667 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea03d964-1d83-4ac8-8394-32eaf863c2c9 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:03.689852 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 948/1892] 10.222.0.117 () {58 vars in 1126 bytes} [Tue Jan 25 02:36:03 2022] GET /identity/v3/roles => generated 1427 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 02:36:03.695039 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b224136d-96b2-4c5c-96e4-e7c1a67d98e2 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:03.707614 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b224136d-96b2-4c5c-96e4-e7c1a67d98e2 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:03.713573 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba5f863-52a4-4975-8fbd-51ff8cb4f530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:03.714462 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba5f863-52a4-4975-8fbd-51ff8cb4f530 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:03.714848 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba5f863-52a4-4975-8fbd-51ff8cb4f530 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:03.715210 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba5f863-52a4-4975-8fbd-51ff8cb4f530 admin admin] PATH_INFO: `/v3/roles` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:03.716180 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba5f863-52a4-4975-8fbd-51ff8cb4f530 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:03.718142 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba5f863-52a4-4975-8fbd-51ff8cb4f530 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:03.731868 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 945/1893] 10.222.0.117 () {58 vars in 1126 bytes} [Tue Jan 25 02:36:03 2022] GET /identity/v3/roles => generated 1427 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 02:36:03.733769 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea03d964-1d83-4ac8-8394-32eaf863c2c9 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:03.748756 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea03d964-1d83-4ac8-8394-32eaf863c2c9 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:03.753783 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c572cf-32e8-40fc-b6fd-9cb8eebbd0a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:03.754668 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c572cf-32e8-40fc-b6fd-9cb8eebbd0a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:03.754946 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c572cf-32e8-40fc-b6fd-9cb8eebbd0a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:03.755215 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c572cf-32e8-40fc-b6fd-9cb8eebbd0a5 admin admin] PATH_INFO: `/v3/projects/17892c7b02a444d8abd5ea5517e52e44/users/e258b3c9fef544cd91de92921746e848/roles/33a8e87420ed423f9cb29e0084eab5d2` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:03.770708 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c572cf-32e8-40fc-b6fd-9cb8eebbd0a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17892c7b02a444d8abd5ea5517e52e44, user_id=e258b3c9fef544cd91de92921746e848, role_id=33a8e87420ed423f9cb29e0084eab5d2)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:03.774903 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c572cf-32e8-40fc-b6fd-9cb8eebbd0a5 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:03.787131 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 949/1894] 10.222.0.117 () {60 vars in 1487 bytes} [Tue Jan 25 02:36:03 2022] PUT /identity/v3/projects/17892c7b02a444d8abd5ea5517e52e44/users/e258b3c9fef544cd91de92921746e848/roles/33a8e87420ed423f9cb29e0084eab5d2 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:36:03.798030 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fac4458-5639-4b1a-a4a4-6ee812577c7f None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:03.798376 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fac4458-5639-4b1a-a4a4-6ee812577c7f None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:03.798658 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fac4458-5639-4b1a-a4a4-6ee812577c7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:03.825276 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-9fac4458-5639-4b1a-a4a4-6ee812577c7f None None] MFA Rules not processed for user `e258b3c9fef544cd91de92921746e848`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:36:03.826518 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-9fac4458-5639-4b1a-a4a4-6ee812577c7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:36:03.891455 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 946/1895] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:36:03 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:36:03.897466 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c572cf-32e8-40fc-b6fd-9cb8eebbd0a5 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:03.978175 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c572cf-32e8-40fc-b6fd-9cb8eebbd0a5 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:03.984274 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cde4b4-f074-414d-8988-4778dee2711a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:03.985294 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cde4b4-f074-414d-8988-4778dee2711a admin admin] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:03.985684 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cde4b4-f074-414d-8988-4778dee2711a admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:03.986037 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cde4b4-f074-414d-8988-4778dee2711a admin admin] PATH_INFO: `/v3/projects` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:03.987103 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cde4b4-f074-414d-8988-4778dee2711a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:03.991587 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cde4b4-f074-414d-8988-4778dee2711a admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:04.031617 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 950/1896] 10.222.0.117 () {60 vars in 1157 bytes} [Tue Jan 25 02:36:03 2022] POST /identity/v3/projects => generated 364 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 02:36:04.035622 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fac4458-5639-4b1a-a4a4-6ee812577c7f None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:04.047862 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fac4458-5639-4b1a-a4a4-6ee812577c7f None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:04.119799 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c533472e-388f-4f46-a27f-572fb092fd75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:04.120579 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c533472e-388f-4f46-a27f-572fb092fd75 admin admin] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:04.120928 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c533472e-388f-4f46-a27f-572fb092fd75 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:04.121373 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c533472e-388f-4f46-a27f-572fb092fd75 admin admin] PATH_INFO: `/v3/users` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:04.122229 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c533472e-388f-4f46-a27f-572fb092fd75 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:04.124323 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c533472e-388f-4f46-a27f-572fb092fd75 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:04.156346 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 947/1897] 10.222.0.117 () {60 vars in 1148 bytes} [Tue Jan 25 02:36:04 2022] POST /identity/v3/users => generated 289 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 25 02:36:04.160412 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cde4b4-f074-414d-8988-4778dee2711a admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:04.173774 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cde4b4-f074-414d-8988-4778dee2711a admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:04.179508 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e137432-8c44-485e-b1db-2cfef7edcfb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:04.180314 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e137432-8c44-485e-b1db-2cfef7edcfb1 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:04.180690 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e137432-8c44-485e-b1db-2cfef7edcfb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:04.181044 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e137432-8c44-485e-b1db-2cfef7edcfb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:04.181893 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e137432-8c44-485e-b1db-2cfef7edcfb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:04.183577 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e137432-8c44-485e-b1db-2cfef7edcfb1 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:04.200050 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 951/1898] 10.222.0.117 () {58 vars in 1126 bytes} [Tue Jan 25 02:36:04 2022] GET /identity/v3/roles => generated 1427 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 25 02:36:04.201468 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c533472e-388f-4f46-a27f-572fb092fd75 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:04.213164 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c533472e-388f-4f46-a27f-572fb092fd75 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:04.218314 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd89392-1da3-4faa-9723-6ff396b1a99a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:04.219332 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd89392-1da3-4faa-9723-6ff396b1a99a admin admin] REQUEST_METHOD: `PUT` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:04.219663 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd89392-1da3-4faa-9723-6ff396b1a99a admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:04.219959 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd89392-1da3-4faa-9723-6ff396b1a99a admin admin] PATH_INFO: `/v3/projects/b8cf6a50465c49a8a6145589902bd32e/users/87f59302558943f6a37b2841ac06124e/roles/d8dbc6d83d9d41d28c3feb8b3485b291` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:04.240966 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd89392-1da3-4faa-9723-6ff396b1a99a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8cf6a50465c49a8a6145589902bd32e, user_id=87f59302558943f6a37b2841ac06124e, role_id=d8dbc6d83d9d41d28c3feb8b3485b291)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:04.244053 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd89392-1da3-4faa-9723-6ff396b1a99a admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:04.261145 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 948/1899] 10.222.0.117 () {60 vars in 1487 bytes} [Tue Jan 25 02:36:04 2022] PUT /identity/v3/projects/b8cf6a50465c49a8a6145589902bd32e/users/87f59302558943f6a37b2841ac06124e/roles/d8dbc6d83d9d41d28c3feb8b3485b291 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:36:04.273875 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e137432-8c44-485e-b1db-2cfef7edcfb1 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:04.277660 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e137432-8c44-485e-b1db-2cfef7edcfb1 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:04.336289 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7626db1b-c6a8-4bb9-8cbe-892d855f1e3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:04.336955 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7626db1b-c6a8-4bb9-8cbe-892d855f1e3e admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:04.337256 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7626db1b-c6a8-4bb9-8cbe-892d855f1e3e admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:04.337522 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7626db1b-c6a8-4bb9-8cbe-892d855f1e3e admin admin] PATH_INFO: `/v3/roles` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:04.338278 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7626db1b-c6a8-4bb9-8cbe-892d855f1e3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:04.339918 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7626db1b-c6a8-4bb9-8cbe-892d855f1e3e admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:04.349857 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 952/1900] 10.222.0.117 () {58 vars in 1126 bytes} [Tue Jan 25 02:36:04 2022] GET /identity/v3/roles => generated 1427 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 02:36:04.354260 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd89392-1da3-4faa-9723-6ff396b1a99a admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:04.364389 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd89392-1da3-4faa-9723-6ff396b1a99a admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:04.370361 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4671f9a7-c9df-4828-8196-cc8ad6beaab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:04.371231 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4671f9a7-c9df-4828-8196-cc8ad6beaab4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:04.371509 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4671f9a7-c9df-4828-8196-cc8ad6beaab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:04.371853 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4671f9a7-c9df-4828-8196-cc8ad6beaab4 admin admin] PATH_INFO: `/v3/projects/b8cf6a50465c49a8a6145589902bd32e/users/87f59302558943f6a37b2841ac06124e/roles/d8dbc6d83d9d41d28c3feb8b3485b291` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:04.373798 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4671f9a7-c9df-4828-8196-cc8ad6beaab4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8cf6a50465c49a8a6145589902bd32e, user_id=87f59302558943f6a37b2841ac06124e, role_id=d8dbc6d83d9d41d28c3feb8b3485b291)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:04.376462 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4671f9a7-c9df-4828-8196-cc8ad6beaab4 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:04.389428 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 949/1901] 10.222.0.117 () {60 vars in 1487 bytes} [Tue Jan 25 02:36:04 2022] PUT /identity/v3/projects/b8cf6a50465c49a8a6145589902bd32e/users/87f59302558943f6a37b2841ac06124e/roles/d8dbc6d83d9d41d28c3feb8b3485b291 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:36:04.400192 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ecaafe-eebe-4673-8d95-447b921bb8fc None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:04.400691 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ecaafe-eebe-4673-8d95-447b921bb8fc None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:04.401157 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ecaafe-eebe-4673-8d95-447b921bb8fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:04.429121 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-91ecaafe-eebe-4673-8d95-447b921bb8fc None None] MFA Rules not processed for user `87f59302558943f6a37b2841ac06124e`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:36:04.430035 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-91ecaafe-eebe-4673-8d95-447b921bb8fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:36:04.499759 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 953/1902] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:36:04 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:36:04.510580 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4671f9a7-c9df-4828-8196-cc8ad6beaab4 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:04.513133 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-4671f9a7-c9df-4828-8196-cc8ad6beaab4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:36:04.578305 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4671f9a7-c9df-4828-8196-cc8ad6beaab4 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:04.582473 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80abc4b-ae5a-4ee2-899c-566dd8ba2d35 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cc5249aea09430080e232cf17757f86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:04.583129 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80abc4b-ae5a-4ee2-899c-566dd8ba2d35 service cinder] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:04.583416 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80abc4b-ae5a-4ee2-899c-566dd8ba2d35 service cinder] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:04.584520 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80abc4b-ae5a-4ee2-899c-566dd8ba2d35 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:04.594410 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80abc4b-ae5a-4ee2-899c-566dd8ba2d35 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:04.595894 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80abc4b-ae5a-4ee2-899c-566dd8ba2d35 service cinder] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:04.615734 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 950/1903] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:36:04 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:36:04.863108 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ecaafe-eebe-4673-8d95-447b921bb8fc None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:04.932894 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ecaafe-eebe-4673-8d95-447b921bb8fc None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:04.937341 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd324eb8-5714-4a9f-b567-e0f85e524690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:04.938209 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd324eb8-5714-4a9f-b567-e0f85e524690 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:04.938487 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd324eb8-5714-4a9f-b567-e0f85e524690 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:04.938761 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd324eb8-5714-4a9f-b567-e0f85e524690 admin admin] PATH_INFO: `/v3/users/e258b3c9fef544cd91de92921746e848` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:04.940006 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd324eb8-5714-4a9f-b567-e0f85e524690 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e258b3c9fef544cd91de92921746e848)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:04.941953 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd324eb8-5714-4a9f-b567-e0f85e524690 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:04.994134 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-cd324eb8-5714-4a9f-b567-e0f85e524690 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e258b3c9fef544cd91de92921746e848'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:05.001015 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-cd324eb8-5714-4a9f-b567-e0f85e524690 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e258b3c9fef544cd91de92921746e848'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:05.001818 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-cd324eb8-5714-4a9f-b567-e0f85e524690 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e258b3c9fef544cd91de92921746e848'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:05.002357 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-cd324eb8-5714-4a9f-b567-e0f85e524690 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e258b3c9fef544cd91de92921746e848'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:05.015469 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-cd324eb8-5714-4a9f-b567-e0f85e524690 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e258b3c9fef544cd91de92921746e848'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:05.031022 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 954/1904] 10.222.0.117 () {58 vars in 1228 bytes} [Tue Jan 25 02:36:04 2022] DELETE /identity/v3/users/e258b3c9fef544cd91de92921746e848 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:36:05.034836 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46908c4-2ebe-4577-9ccc-5c170af90069 None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:05.035363 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46908c4-2ebe-4577-9ccc-5c170af90069 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:05.035363 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46908c4-2ebe-4577-9ccc-5c170af90069 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:05.072706 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-f46908c4-2ebe-4577-9ccc-5c170af90069 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:36:05.074353 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-f46908c4-2ebe-4577-9ccc-5c170af90069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:36:05.151215 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 951/1905] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:36:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:36:05.161840 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd324eb8-5714-4a9f-b567-e0f85e524690 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:05.165458 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-cd324eb8-5714-4a9f-b567-e0f85e524690 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:36:05.260084 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9755d1e-5d65-4431-bd5e-b1a96c7991d2 None None] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:05.260803 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9755d1e-5d65-4431-bd5e-b1a96c7991d2 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:05.261099 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9755d1e-5d65-4431-bd5e-b1a96c7991d2 None None] PATH_INFO: `/` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:05.263018 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd324eb8-5714-4a9f-b567-e0f85e524690 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:05.263775 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 952/1906] 10.222.0.117 () {54 vars in 926 bytes} [Tue Jan 25 02:36:05 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:36:05.269165 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38139065-79ab-4589-b1ed-d9a2875691f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca4071c5f8f4a31b5edb81fa66a43a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:05.270846 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38139065-79ab-4589-b1ed-d9a2875691f5 service neutron] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:05.271462 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38139065-79ab-4589-b1ed-d9a2875691f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:05.272380 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38139065-79ab-4589-b1ed-d9a2875691f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:05.281302 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1afdad-c6f1-4912-a8a8-a89bfa8c4ca1 None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:05.282045 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1afdad-c6f1-4912-a8a8-a89bfa8c4ca1 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:05.282355 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1afdad-c6f1-4912-a8a8-a89bfa8c4ca1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:05.288969 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38139065-79ab-4589-b1ed-d9a2875691f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:05.291793 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38139065-79ab-4589-b1ed-d9a2875691f5 service neutron] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:05.309811 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 955/1907] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:36:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 25 02:36:05.324927 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-4d1afdad-c6f1-4912-a8a8-a89bfa8c4ca1 None None] MFA Rules not processed for user `d9ad6269900346458050063c12cac299`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:36:05.326313 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-4d1afdad-c6f1-4912-a8a8-a89bfa8c4ca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:36:05.475104 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 953/1908] 10.222.0.117 () {58 vars in 1023 bytes} [Tue Jan 25 02:36:05 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:36:05.492491 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38139065-79ab-4589-b1ed-d9a2875691f5 service neutron] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:05.494261 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-38139065-79ab-4589-b1ed-d9a2875691f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:36:05.513511 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38139065-79ab-4589-b1ed-d9a2875691f5 service neutron] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:05.522218 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc61207b-fc54-43a9-80bb-25d15eb1c7b8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9ad6269900346458050063c12cac299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:05.523582 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc61207b-fc54-43a9-80bb-25d15eb1c7b8 service nova] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:05.524079 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc61207b-fc54-43a9-80bb-25d15eb1c7b8 service nova] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:05.524493 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc61207b-fc54-43a9-80bb-25d15eb1c7b8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:05.537304 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc61207b-fc54-43a9-80bb-25d15eb1c7b8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:05.539105 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc61207b-fc54-43a9-80bb-25d15eb1c7b8 service nova] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:05.552469 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 956/1909] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:36:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:36:05.866752 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1afdad-c6f1-4912-a8a8-a89bfa8c4ca1 None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:05.868818 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-4d1afdad-c6f1-4912-a8a8-a89bfa8c4ca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:36:05.913828 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1afdad-c6f1-4912-a8a8-a89bfa8c4ca1 None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:05.936194 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ced24f7-4021-4f71-ad09-31d8d07ae292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:05.938867 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ced24f7-4021-4f71-ad09-31d8d07ae292 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:05.939384 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ced24f7-4021-4f71-ad09-31d8d07ae292 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:05.939896 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ced24f7-4021-4f71-ad09-31d8d07ae292 admin admin] PATH_INFO: `/v3/projects/17892c7b02a444d8abd5ea5517e52e44` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:05.941783 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ced24f7-4021-4f71-ad09-31d8d07ae292 admin admin] RBAC: Authorizing `identity:delete_project(project_id=17892c7b02a444d8abd5ea5517e52e44)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:05.944399 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ced24f7-4021-4f71-ad09-31d8d07ae292 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:06.036966 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-0ced24f7-4021-4f71-ad09-31d8d07ae292 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17892c7b02a444d8abd5ea5517e52e44', 'request_id': 'req-0ced24f7-4021-4f71-ad09-31d8d07ae292'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:06.051719 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-0ced24f7-4021-4f71-ad09-31d8d07ae292 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17892c7b02a444d8abd5ea5517e52e44', 'request_id': 'req-0ced24f7-4021-4f71-ad09-31d8d07ae292'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:06.063345 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-0ced24f7-4021-4f71-ad09-31d8d07ae292 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17892c7b02a444d8abd5ea5517e52e44', 'request_id': 'req-0ced24f7-4021-4f71-ad09-31d8d07ae292'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:06.083313 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-0ced24f7-4021-4f71-ad09-31d8d07ae292 admin admin] The token cache is being invalidate because project 17892c7b02a444d8abd5ea5517e52e44 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79121) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 25 02:36:06.084076 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-0ced24f7-4021-4f71-ad09-31d8d07ae292 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:06.085269 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-0ced24f7-4021-4f71-ad09-31d8d07ae292 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:06.093137 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc61207b-fc54-43a9-80bb-25d15eb1c7b8 service nova] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:06.093888 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 954/1910] 10.222.0.117 () {58 vars in 1237 bytes} [Tue Jan 25 02:36:05 2022] DELETE /identity/v3/projects/17892c7b02a444d8abd5ea5517e52e44 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:36:06.110705 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc61207b-fc54-43a9-80bb-25d15eb1c7b8 service nova] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:06.217467 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769c22f1-ad25-484f-96a8-d266788947ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:06.219522 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769c22f1-ad25-484f-96a8-d266788947ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:06.219522 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769c22f1-ad25-484f-96a8-d266788947ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:06.222602 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769c22f1-ad25-484f-96a8-d266788947ba admin admin] PATH_INFO: `/v3/users/87f59302558943f6a37b2841ac06124e` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:06.226325 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769c22f1-ad25-484f-96a8-d266788947ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=87f59302558943f6a37b2841ac06124e)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:06.229510 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769c22f1-ad25-484f-96a8-d266788947ba admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:06.333864 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-769c22f1-ad25-484f-96a8-d266788947ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87f59302558943f6a37b2841ac06124e'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:06.346158 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-769c22f1-ad25-484f-96a8-d266788947ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87f59302558943f6a37b2841ac06124e'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:06.346981 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-769c22f1-ad25-484f-96a8-d266788947ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87f59302558943f6a37b2841ac06124e'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:06.347892 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-769c22f1-ad25-484f-96a8-d266788947ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87f59302558943f6a37b2841ac06124e'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:06.367331 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-769c22f1-ad25-484f-96a8-d266788947ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87f59302558943f6a37b2841ac06124e'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:06.383560 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 957/1911] 10.222.0.117 () {58 vars in 1228 bytes} [Tue Jan 25 02:36:06 2022] DELETE /identity/v3/users/87f59302558943f6a37b2841ac06124e => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:36:07.236788 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ced24f7-4021-4f71-ad09-31d8d07ae292 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:07.238303 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-0ced24f7-4021-4f71-ad09-31d8d07ae292 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:36:07.252388 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ced24f7-4021-4f71-ad09-31d8d07ae292 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:07.332509 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef09418-0949-4f8c-8f88-ef3a731d80f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:07.333436 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef09418-0949-4f8c-8f88-ef3a731d80f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:07.334708 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef09418-0949-4f8c-8f88-ef3a731d80f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:07.335154 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef09418-0949-4f8c-8f88-ef3a731d80f1 admin admin] PATH_INFO: `/v3/projects/b8cf6a50465c49a8a6145589902bd32e` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:07.337108 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef09418-0949-4f8c-8f88-ef3a731d80f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8cf6a50465c49a8a6145589902bd32e)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:07.339291 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef09418-0949-4f8c-8f88-ef3a731d80f1 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:07.388309 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-fef09418-0949-4f8c-8f88-ef3a731d80f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8cf6a50465c49a8a6145589902bd32e', 'request_id': 'req-fef09418-0949-4f8c-8f88-ef3a731d80f1'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:07.393989 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-fef09418-0949-4f8c-8f88-ef3a731d80f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8cf6a50465c49a8a6145589902bd32e', 'request_id': 'req-fef09418-0949-4f8c-8f88-ef3a731d80f1'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:07.401647 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-fef09418-0949-4f8c-8f88-ef3a731d80f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8cf6a50465c49a8a6145589902bd32e', 'request_id': 'req-fef09418-0949-4f8c-8f88-ef3a731d80f1'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:07.412850 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-fef09418-0949-4f8c-8f88-ef3a731d80f1 admin admin] The token cache is being invalidate because project b8cf6a50465c49a8a6145589902bd32e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79121) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 25 02:36:07.413158 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-fef09418-0949-4f8c-8f88-ef3a731d80f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:07.413782 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-fef09418-0949-4f8c-8f88-ef3a731d80f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:07.415328 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 955/1912] 10.222.0.117 () {58 vars in 1237 bytes} [Tue Jan 25 02:36:07 2022] DELETE /identity/v3/projects/b8cf6a50465c49a8a6145589902bd32e => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:36:07.421411 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6049ad1b-cd55-49e3-8883-093600c05e0a None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:07.421880 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6049ad1b-cd55-49e3-8883-093600c05e0a None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:07.421952 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6049ad1b-cd55-49e3-8883-093600c05e0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:07.441688 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-6049ad1b-cd55-49e3-8883-093600c05e0a None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:36:07.442921 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-6049ad1b-cd55-49e3-8883-093600c05e0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:36:07.537078 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 958/1913] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:36:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:36:07.546977 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af10e19c-59d2-4ea8-8b8f-f1f9df9324b1 None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:07.547556 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af10e19c-59d2-4ea8-8b8f-f1f9df9324b1 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:07.547975 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af10e19c-59d2-4ea8-8b8f-f1f9df9324b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:07.569068 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-af10e19c-59d2-4ea8-8b8f-f1f9df9324b1 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:36:07.570668 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-af10e19c-59d2-4ea8-8b8f-f1f9df9324b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:36:07.580420 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 956/1914] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:36:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 25 02:36:07.585330 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6049ad1b-cd55-49e3-8883-093600c05e0a None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:07.595494 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6049ad1b-cd55-49e3-8883-093600c05e0a None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:07.601292 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3024f4-aafa-4348-873d-f4c79956a763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:07.601961 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3024f4-aafa-4348-873d-f4c79956a763 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:07.602278 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3024f4-aafa-4348-873d-f4c79956a763 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:07.602558 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3024f4-aafa-4348-873d-f4c79956a763 admin admin] PATH_INFO: `/v3/domains` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:07.603419 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3024f4-aafa-4348-873d-f4c79956a763 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:36:07.603953 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3024f4-aafa-4348-873d-f4c79956a763 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:07.605912 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3024f4-aafa-4348-873d-f4c79956a763 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:07.621197 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 959/1915] 10.222.0.117 () {58 vars in 1157 bytes} [Tue Jan 25 02:36:07 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:36:07.625537 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af10e19c-59d2-4ea8-8b8f-f1f9df9324b1 None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:07.638067 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af10e19c-59d2-4ea8-8b8f-f1f9df9324b1 None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:07.643014 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748f470f-a815-4f01-b5d5-9b3f8231fae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:07.643905 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748f470f-a815-4f01-b5d5-9b3f8231fae2 admin admin] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:07.644351 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748f470f-a815-4f01-b5d5-9b3f8231fae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:07.645155 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748f470f-a815-4f01-b5d5-9b3f8231fae2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:07.646163 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748f470f-a815-4f01-b5d5-9b3f8231fae2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:07.648901 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748f470f-a815-4f01-b5d5-9b3f8231fae2 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:07.675388 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3024f4-aafa-4348-873d-f4c79956a763 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:07.677465 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-ac3024f4-aafa-4348-873d-f4c79956a763 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:36:07.683213 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 957/1916] 10.222.0.117 () {60 vars in 1157 bytes} [Tue Jan 25 02:36:07 2022] POST /identity/v3/projects => generated 370 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 02:36:07.684242 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748f470f-a815-4f01-b5d5-9b3f8231fae2 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:07.690983 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3024f4-aafa-4348-873d-f4c79956a763 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:07.753797 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748f470f-a815-4f01-b5d5-9b3f8231fae2 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:07.760590 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5abfcdb-72cf-4b61-b625-147ac3f5273d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:07.762762 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5abfcdb-72cf-4b61-b625-147ac3f5273d admin admin] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:07.763238 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5abfcdb-72cf-4b61-b625-147ac3f5273d admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:07.763666 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5abfcdb-72cf-4b61-b625-147ac3f5273d admin admin] PATH_INFO: `/v3/users` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:07.764559 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5abfcdb-72cf-4b61-b625-147ac3f5273d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:07.766714 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5abfcdb-72cf-4b61-b625-147ac3f5273d admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:07.784916 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86115b6b-57f3-4725-8310-8782bc49bccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:07.786628 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86115b6b-57f3-4725-8310-8782bc49bccb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:07.787330 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86115b6b-57f3-4725-8310-8782bc49bccb admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:07.787973 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86115b6b-57f3-4725-8310-8782bc49bccb admin admin] PATH_INFO: `/v3/users/5d979e82744b40c09876944742f27aaa` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:07.789781 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86115b6b-57f3-4725-8310-8782bc49bccb admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d979e82744b40c09876944742f27aaa)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:07.792283 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86115b6b-57f3-4725-8310-8782bc49bccb admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:07.827068 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 958/1917] 10.222.0.117 () {60 vars in 1148 bytes} [Tue Jan 25 02:36:07 2022] POST /identity/v3/users => generated 286 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 02:36:07.828271 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5abfcdb-72cf-4b61-b625-147ac3f5273d admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:07.845945 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5abfcdb-72cf-4b61-b625-147ac3f5273d admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:07.852122 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77adcc36-8f7e-437c-8e54-7760f926dc29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:07.852787 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77adcc36-8f7e-437c-8e54-7760f926dc29 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:07.853247 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77adcc36-8f7e-437c-8e54-7760f926dc29 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:07.853678 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77adcc36-8f7e-437c-8e54-7760f926dc29 admin admin] PATH_INFO: `/v3/roles` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:07.854713 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77adcc36-8f7e-437c-8e54-7760f926dc29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:07.857108 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77adcc36-8f7e-437c-8e54-7760f926dc29 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:07.890400 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 959/1918] 10.222.0.117 () {58 vars in 1126 bytes} [Tue Jan 25 02:36:07 2022] GET /identity/v3/roles => generated 1427 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 02:36:07.894348 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77adcc36-8f7e-437c-8e54-7760f926dc29 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:07.902329 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-86115b6b-57f3-4725-8310-8782bc49bccb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d979e82744b40c09876944742f27aaa'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:07.903878 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-77adcc36-8f7e-437c-8e54-7760f926dc29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:36:07.915354 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-86115b6b-57f3-4725-8310-8782bc49bccb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d979e82744b40c09876944742f27aaa'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:07.917041 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-86115b6b-57f3-4725-8310-8782bc49bccb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d979e82744b40c09876944742f27aaa'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:07.918299 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-86115b6b-57f3-4725-8310-8782bc49bccb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d979e82744b40c09876944742f27aaa'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:07.922553 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77adcc36-8f7e-437c-8e54-7760f926dc29 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:07.928644 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6740bd-77bc-484d-bb31-ef2b75404a42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:07.929708 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6740bd-77bc-484d-bb31-ef2b75404a42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:07.929996 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6740bd-77bc-484d-bb31-ef2b75404a42 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:07.930262 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6740bd-77bc-484d-bb31-ef2b75404a42 admin admin] PATH_INFO: `/v3/users/0637539320dc4e01b5a56ddac980ca14` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:07.931892 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6740bd-77bc-484d-bb31-ef2b75404a42 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0637539320dc4e01b5a56ddac980ca14)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:07.933420 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-86115b6b-57f3-4725-8310-8782bc49bccb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d979e82744b40c09876944742f27aaa'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:07.933942 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6740bd-77bc-484d-bb31-ef2b75404a42 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:07.964898 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 960/1919] 10.222.0.117 () {58 vars in 1228 bytes} [Tue Jan 25 02:36:07 2022] DELETE /identity/v3/users/5d979e82744b40c09876944742f27aaa => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 25 02:36:07.965777 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86115b6b-57f3-4725-8310-8782bc49bccb admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:07.968953 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-86115b6b-57f3-4725-8310-8782bc49bccb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:36:08.012342 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-ca6740bd-77bc-484d-bb31-ef2b75404a42 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0637539320dc4e01b5a56ddac980ca14'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:08.012990 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-ca6740bd-77bc-484d-bb31-ef2b75404a42 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0637539320dc4e01b5a56ddac980ca14'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:08.020206 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-ca6740bd-77bc-484d-bb31-ef2b75404a42 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0637539320dc4e01b5a56ddac980ca14'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:08.020956 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-ca6740bd-77bc-484d-bb31-ef2b75404a42 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0637539320dc4e01b5a56ddac980ca14'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:08.031977 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-ca6740bd-77bc-484d-bb31-ef2b75404a42 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0637539320dc4e01b5a56ddac980ca14'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:08.072585 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 960/1920] 10.222.0.117 () {58 vars in 1228 bytes} [Tue Jan 25 02:36:07 2022] DELETE /identity/v3/users/0637539320dc4e01b5a56ddac980ca14 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:36:08.074143 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb871fb-e619-4163-983b-54314ed68a56 None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:08.074433 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb871fb-e619-4163-983b-54314ed68a56 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:08.074716 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb871fb-e619-4163-983b-54314ed68a56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:08.097062 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-1cb871fb-e619-4163-983b-54314ed68a56 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:36:08.100875 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-1cb871fb-e619-4163-983b-54314ed68a56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:36:08.114315 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86115b6b-57f3-4725-8310-8782bc49bccb admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:08.212817 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 961/1921] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:36:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:36:08.234201 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f306010f-969f-43b0-a183-10b18ff253e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:08.234904 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f306010f-969f-43b0-a183-10b18ff253e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:08.235191 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f306010f-969f-43b0-a183-10b18ff253e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:08.235469 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f306010f-969f-43b0-a183-10b18ff253e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:08.236277 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f306010f-969f-43b0-a183-10b18ff253e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:08.237937 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f306010f-969f-43b0-a183-10b18ff253e5 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:08.244774 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb871fb-e619-4163-983b-54314ed68a56 None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:08.246898 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-1cb871fb-e619-4163-983b-54314ed68a56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:36:08.260055 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 961/1922] 10.222.0.117 () {58 vars in 1126 bytes} [Tue Jan 25 02:36:07 2022] GET /identity/v3/roles => generated 1427 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 02:36:08.261722 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f306010f-969f-43b0-a183-10b18ff253e5 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:08.264675 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-f306010f-969f-43b0-a183-10b18ff253e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:36:08.284885 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f306010f-969f-43b0-a183-10b18ff253e5 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:08.292481 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa89846-38fd-4c3c-8615-02309f0a002d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:08.293403 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa89846-38fd-4c3c-8615-02309f0a002d admin admin] REQUEST_METHOD: `PUT` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:08.293691 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa89846-38fd-4c3c-8615-02309f0a002d admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:08.293983 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa89846-38fd-4c3c-8615-02309f0a002d admin admin] PATH_INFO: `/v3/projects/656c80cb424c43aea15960353dff8397/users/ca1d21bea6b049218f07621e811e3abc/roles/33a8e87420ed423f9cb29e0084eab5d2` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:08.334630 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa89846-38fd-4c3c-8615-02309f0a002d admin admin] RBAC: Authorizing `identity:create_grant(project_id=656c80cb424c43aea15960353dff8397, user_id=ca1d21bea6b049218f07621e811e3abc, role_id=33a8e87420ed423f9cb29e0084eab5d2)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:08.342424 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa89846-38fd-4c3c-8615-02309f0a002d admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:08.361196 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb871fb-e619-4163-983b-54314ed68a56 None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:08.380373 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 962/1923] 10.222.0.117 () {60 vars in 1487 bytes} [Tue Jan 25 02:36:08 2022] PUT /identity/v3/projects/656c80cb424c43aea15960353dff8397/users/ca1d21bea6b049218f07621e811e3abc/roles/33a8e87420ed423f9cb29e0084eab5d2 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:36:08.393872 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a18bb65-57ab-4beb-82df-5440b5f23294 None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:08.394182 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a18bb65-57ab-4beb-82df-5440b5f23294 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:08.394446 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a18bb65-57ab-4beb-82df-5440b5f23294 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:08.452932 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588c9a80-02b0-4b64-9405-bce14c636c8e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca4071c5f8f4a31b5edb81fa66a43a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:08.454429 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588c9a80-02b0-4b64-9405-bce14c636c8e service neutron] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:08.454896 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588c9a80-02b0-4b64-9405-bce14c636c8e service neutron] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:08.455330 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588c9a80-02b0-4b64-9405-bce14c636c8e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:08.507027 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-8a18bb65-57ab-4beb-82df-5440b5f23294 None None] MFA Rules not processed for user `ca1d21bea6b049218f07621e811e3abc`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:36:08.510295 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-8a18bb65-57ab-4beb-82df-5440b5f23294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:36:08.566304 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588c9a80-02b0-4b64-9405-bce14c636c8e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:08.567997 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588c9a80-02b0-4b64-9405-bce14c636c8e service neutron] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:08.583776 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 962/1924] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:36:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 25 02:36:08.585678 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588c9a80-02b0-4b64-9405-bce14c636c8e service neutron] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:08.587392 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-588c9a80-02b0-4b64-9405-bce14c636c8e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:36:08.607353 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588c9a80-02b0-4b64-9405-bce14c636c8e service neutron] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:08.613659 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 963/1925] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:36:08 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:36:08.618314 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a18bb65-57ab-4beb-82df-5440b5f23294 None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:08.628112 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a013959d-c659-47fe-a633-592d97a42971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:08.632847 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a013959d-c659-47fe-a633-592d97a42971 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:08.633268 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a013959d-c659-47fe-a633-592d97a42971 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:08.633866 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a013959d-c659-47fe-a633-592d97a42971 admin admin] PATH_INFO: `/v3/projects/3527f1c56c474c1297106b524103f41b` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:08.637606 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a013959d-c659-47fe-a633-592d97a42971 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3527f1c56c474c1297106b524103f41b)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:08.638102 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a18bb65-57ab-4beb-82df-5440b5f23294 None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:08.643454 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a013959d-c659-47fe-a633-592d97a42971 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:08.652622 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b5dde6-c4b2-4ebe-8188-de6735e9dc71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:08.655524 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b5dde6-c4b2-4ebe-8188-de6735e9dc71 admin admin] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:08.656600 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b5dde6-c4b2-4ebe-8188-de6735e9dc71 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:08.657160 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b5dde6-c4b2-4ebe-8188-de6735e9dc71 admin admin] PATH_INFO: `/v3/projects` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:08.659219 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b5dde6-c4b2-4ebe-8188-de6735e9dc71 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:08.663101 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b5dde6-c4b2-4ebe-8188-de6735e9dc71 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:08.704502 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 964/1926] 10.222.0.117 () {60 vars in 1157 bytes} [Tue Jan 25 02:36:08 2022] POST /identity/v3/projects => generated 370 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 02:36:08.711292 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b5dde6-c4b2-4ebe-8188-de6735e9dc71 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:08.760567 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-a013959d-c659-47fe-a633-592d97a42971 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3527f1c56c474c1297106b524103f41b', 'request_id': 'req-a013959d-c659-47fe-a633-592d97a42971'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:08.779587 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-a013959d-c659-47fe-a633-592d97a42971 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3527f1c56c474c1297106b524103f41b', 'request_id': 'req-a013959d-c659-47fe-a633-592d97a42971'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:08.794895 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-a013959d-c659-47fe-a633-592d97a42971 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3527f1c56c474c1297106b524103f41b', 'request_id': 'req-a013959d-c659-47fe-a633-592d97a42971'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:08.810815 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b5dde6-c4b2-4ebe-8188-de6735e9dc71 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:08.821242 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-a013959d-c659-47fe-a633-592d97a42971 admin admin] The token cache is being invalidate because project 3527f1c56c474c1297106b524103f41b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79121) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 25 02:36:08.821529 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-a013959d-c659-47fe-a633-592d97a42971 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:08.822847 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-a013959d-c659-47fe-a633-592d97a42971 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:08.825819 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 963/1927] 10.222.0.117 () {58 vars in 1237 bytes} [Tue Jan 25 02:36:08 2022] DELETE /identity/v3/projects/3527f1c56c474c1297106b524103f41b => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:36:08.830376 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a013959d-c659-47fe-a633-592d97a42971 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:08.833119 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-a013959d-c659-47fe-a633-592d97a42971 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:36:08.896130 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64887acd-5e64-4b70-8133-bf36a5a5405b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:08.897545 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64887acd-5e64-4b70-8133-bf36a5a5405b admin admin] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:08.897832 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64887acd-5e64-4b70-8133-bf36a5a5405b admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:08.898107 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64887acd-5e64-4b70-8133-bf36a5a5405b admin admin] PATH_INFO: `/v3/users` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:08.898974 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64887acd-5e64-4b70-8133-bf36a5a5405b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:08.901157 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64887acd-5e64-4b70-8133-bf36a5a5405b admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:08.927076 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 965/1928] 10.222.0.117 () {60 vars in 1148 bytes} [Tue Jan 25 02:36:08 2022] POST /identity/v3/users => generated 292 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 02:36:08.928567 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a013959d-c659-47fe-a633-592d97a42971 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:08.931020 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64887acd-5e64-4b70-8133-bf36a5a5405b admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:08.933521 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-64887acd-5e64-4b70-8133-bf36a5a5405b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:36:08.937392 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c785fb8-0e6e-42cf-a1e2-931b34f1945f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:08.938412 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c785fb8-0e6e-42cf-a1e2-931b34f1945f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:08.938799 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c785fb8-0e6e-42cf-a1e2-931b34f1945f admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:08.939292 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c785fb8-0e6e-42cf-a1e2-931b34f1945f admin admin] PATH_INFO: `/v3/users/68a82b6bf8254535a369d5836ee54190` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:08.944196 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c785fb8-0e6e-42cf-a1e2-931b34f1945f admin admin] RBAC: Authorizing `identity:delete_user(user_id=68a82b6bf8254535a369d5836ee54190)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:08.947198 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c785fb8-0e6e-42cf-a1e2-931b34f1945f admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:08.953025 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64887acd-5e64-4b70-8133-bf36a5a5405b admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:08.961075 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f76280-bb6d-4ae5-b255-620f07b87de1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:08.961848 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f76280-bb6d-4ae5-b255-620f07b87de1 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:08.962227 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f76280-bb6d-4ae5-b255-620f07b87de1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:08.962637 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f76280-bb6d-4ae5-b255-620f07b87de1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:08.963983 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f76280-bb6d-4ae5-b255-620f07b87de1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:08.966142 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f76280-bb6d-4ae5-b255-620f07b87de1 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:08.983590 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 966/1929] 10.222.0.117 () {58 vars in 1126 bytes} [Tue Jan 25 02:36:08 2022] GET /identity/v3/roles => generated 1427 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 25 02:36:08.992041 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f76280-bb6d-4ae5-b255-620f07b87de1 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:09.003533 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f76280-bb6d-4ae5-b255-620f07b87de1 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:09.011687 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f552c25d-8a58-4a3c-95f6-b0cd7fb3f054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:09.013134 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f552c25d-8a58-4a3c-95f6-b0cd7fb3f054 admin admin] REQUEST_METHOD: `PUT` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:09.013390 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f552c25d-8a58-4a3c-95f6-b0cd7fb3f054 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:09.013769 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f552c25d-8a58-4a3c-95f6-b0cd7fb3f054 admin admin] PATH_INFO: `/v3/projects/1b54612e9a494839a3f316876dfe9ae0/users/dbc5f730a6784134acd4032f2e6d542b/roles/d8dbc6d83d9d41d28c3feb8b3485b291` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:09.014644 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-9c785fb8-0e6e-42cf-a1e2-931b34f1945f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68a82b6bf8254535a369d5836ee54190'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:09.015403 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-9c785fb8-0e6e-42cf-a1e2-931b34f1945f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68a82b6bf8254535a369d5836ee54190'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:09.023597 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-9c785fb8-0e6e-42cf-a1e2-931b34f1945f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68a82b6bf8254535a369d5836ee54190'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:09.025985 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-9c785fb8-0e6e-42cf-a1e2-931b34f1945f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68a82b6bf8254535a369d5836ee54190'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:09.033066 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f552c25d-8a58-4a3c-95f6-b0cd7fb3f054 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b54612e9a494839a3f316876dfe9ae0, user_id=dbc5f730a6784134acd4032f2e6d542b, role_id=d8dbc6d83d9d41d28c3feb8b3485b291)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:09.036043 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-9c785fb8-0e6e-42cf-a1e2-931b34f1945f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68a82b6bf8254535a369d5836ee54190'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:09.036161 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f552c25d-8a58-4a3c-95f6-b0cd7fb3f054 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:09.056117 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 967/1930] 10.222.0.117 () {60 vars in 1487 bytes} [Tue Jan 25 02:36:08 2022] PUT /identity/v3/projects/1b54612e9a494839a3f316876dfe9ae0/users/dbc5f730a6784134acd4032f2e6d542b/roles/d8dbc6d83d9d41d28c3feb8b3485b291 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 25 02:36:09.057031 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f552c25d-8a58-4a3c-95f6-b0cd7fb3f054 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:09.061714 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-f552c25d-8a58-4a3c-95f6-b0cd7fb3f054 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:36:09.062281 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 964/1931] 10.222.0.117 () {58 vars in 1228 bytes} [Tue Jan 25 02:36:08 2022] DELETE /identity/v3/users/68a82b6bf8254535a369d5836ee54190 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:36:09.063544 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c785fb8-0e6e-42cf-a1e2-931b34f1945f admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:09.072285 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-9c785fb8-0e6e-42cf-a1e2-931b34f1945f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:36:09.157019 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f552c25d-8a58-4a3c-95f6-b0cd7fb3f054 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:09.178406 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c785fb8-0e6e-42cf-a1e2-931b34f1945f admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:09.183673 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f9b043-6d0d-46f3-8da0-6b63b7b9c4cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:09.184513 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f9b043-6d0d-46f3-8da0-6b63b7b9c4cd admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:09.185334 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f9b043-6d0d-46f3-8da0-6b63b7b9c4cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:09.186011 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f9b043-6d0d-46f3-8da0-6b63b7b9c4cd admin admin] PATH_INFO: `/v3/roles` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:09.187051 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f9b043-6d0d-46f3-8da0-6b63b7b9c4cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:09.189998 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f9b043-6d0d-46f3-8da0-6b63b7b9c4cd admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:09.216594 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 965/1932] 10.222.0.117 () {58 vars in 1126 bytes} [Tue Jan 25 02:36:09 2022] GET /identity/v3/roles => generated 1427 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 02:36:09.218654 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f9b043-6d0d-46f3-8da0-6b63b7b9c4cd admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:09.235271 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f9b043-6d0d-46f3-8da0-6b63b7b9c4cd admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:09.241862 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657687e9-56ca-4da4-a9cb-1e1112de75dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:09.242746 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657687e9-56ca-4da4-a9cb-1e1112de75dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:09.243032 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657687e9-56ca-4da4-a9cb-1e1112de75dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:09.243310 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657687e9-56ca-4da4-a9cb-1e1112de75dd admin admin] PATH_INFO: `/v3/projects/0dff1333b0ca43daae5efd7d6a54e36e` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:09.244941 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657687e9-56ca-4da4-a9cb-1e1112de75dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=0dff1333b0ca43daae5efd7d6a54e36e)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:09.247385 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657687e9-56ca-4da4-a9cb-1e1112de75dd admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:09.251323 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4be523c-41a2-4a3b-bc49-678096e38d97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:09.252827 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4be523c-41a2-4a3b-bc49-678096e38d97 admin admin] REQUEST_METHOD: `PUT` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:09.253202 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4be523c-41a2-4a3b-bc49-678096e38d97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:09.253576 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4be523c-41a2-4a3b-bc49-678096e38d97 admin admin] PATH_INFO: `/v3/projects/1b54612e9a494839a3f316876dfe9ae0/users/dbc5f730a6784134acd4032f2e6d542b/roles/d8dbc6d83d9d41d28c3feb8b3485b291` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:09.256718 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4be523c-41a2-4a3b-bc49-678096e38d97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b54612e9a494839a3f316876dfe9ae0, user_id=dbc5f730a6784134acd4032f2e6d542b, role_id=d8dbc6d83d9d41d28c3feb8b3485b291)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:09.259573 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4be523c-41a2-4a3b-bc49-678096e38d97 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:09.273177 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 966/1933] 10.222.0.117 () {60 vars in 1487 bytes} [Tue Jan 25 02:36:09 2022] PUT /identity/v3/projects/1b54612e9a494839a3f316876dfe9ae0/users/dbc5f730a6784134acd4032f2e6d542b/roles/d8dbc6d83d9d41d28c3feb8b3485b291 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:36:09.283226 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3064369-e9bb-4216-be03-419550cd7ea8 None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:09.283517 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3064369-e9bb-4216-be03-419550cd7ea8 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:09.283920 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3064369-e9bb-4216-be03-419550cd7ea8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:09.308967 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-657687e9-56ca-4da4-a9cb-1e1112de75dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0dff1333b0ca43daae5efd7d6a54e36e', 'request_id': 'req-657687e9-56ca-4da4-a9cb-1e1112de75dd'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:09.316105 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-657687e9-56ca-4da4-a9cb-1e1112de75dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0dff1333b0ca43daae5efd7d6a54e36e', 'request_id': 'req-657687e9-56ca-4da4-a9cb-1e1112de75dd'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:09.316960 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-a3064369-e9bb-4216-be03-419550cd7ea8 None None] MFA Rules not processed for user `dbc5f730a6784134acd4032f2e6d542b`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:36:09.318176 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-a3064369-e9bb-4216-be03-419550cd7ea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:36:09.323938 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-657687e9-56ca-4da4-a9cb-1e1112de75dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0dff1333b0ca43daae5efd7d6a54e36e', 'request_id': 'req-657687e9-56ca-4da4-a9cb-1e1112de75dd'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:09.340419 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-657687e9-56ca-4da4-a9cb-1e1112de75dd admin admin] The token cache is being invalidate because project 0dff1333b0ca43daae5efd7d6a54e36e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79120) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 25 02:36:09.341206 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-657687e9-56ca-4da4-a9cb-1e1112de75dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:09.341884 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-657687e9-56ca-4da4-a9cb-1e1112de75dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:09.343626 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 968/1934] 10.222.0.117 () {58 vars in 1237 bytes} [Tue Jan 25 02:36:09 2022] DELETE /identity/v3/projects/0dff1333b0ca43daae5efd7d6a54e36e => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:36:09.344254 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657687e9-56ca-4da4-a9cb-1e1112de75dd admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:09.345578 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-657687e9-56ca-4da4-a9cb-1e1112de75dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:36:09.402440 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 967/1935] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:36:09 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:36:09.404800 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3064369-e9bb-4216-be03-419550cd7ea8 None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:09.408165 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-a3064369-e9bb-4216-be03-419550cd7ea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:36:09.449031 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657687e9-56ca-4da4-a9cb-1e1112de75dd admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:09.455457 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ed457c-a5f0-4fd5-bf36-58f18fa562dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:09.457185 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ed457c-a5f0-4fd5-bf36-58f18fa562dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:09.457619 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ed457c-a5f0-4fd5-bf36-58f18fa562dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:09.458032 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ed457c-a5f0-4fd5-bf36-58f18fa562dc admin admin] PATH_INFO: `/v3/projects/ef5be3473eb744df9d9b4779e46297f1` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:09.460607 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ed457c-a5f0-4fd5-bf36-58f18fa562dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef5be3473eb744df9d9b4779e46297f1)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:09.463358 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ed457c-a5f0-4fd5-bf36-58f18fa562dc admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:09.477792 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3064369-e9bb-4216-be03-419550cd7ea8 None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:09.483261 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72765fc-afd9-46c0-b1cd-593db1fbd835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:09.484413 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72765fc-afd9-46c0-b1cd-593db1fbd835 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:09.484590 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72765fc-afd9-46c0-b1cd-593db1fbd835 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:09.484933 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72765fc-afd9-46c0-b1cd-593db1fbd835 admin admin] PATH_INFO: `/v3/users/35a05eca14c94ad387e3c667a12049b1` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:09.486448 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72765fc-afd9-46c0-b1cd-593db1fbd835 admin admin] RBAC: Authorizing `identity:delete_user(user_id=35a05eca14c94ad387e3c667a12049b1)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:09.488599 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72765fc-afd9-46c0-b1cd-593db1fbd835 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:09.531916 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-22ed457c-a5f0-4fd5-bf36-58f18fa562dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef5be3473eb744df9d9b4779e46297f1', 'request_id': 'req-22ed457c-a5f0-4fd5-bf36-58f18fa562dc'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:09.540914 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-22ed457c-a5f0-4fd5-bf36-58f18fa562dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef5be3473eb744df9d9b4779e46297f1', 'request_id': 'req-22ed457c-a5f0-4fd5-bf36-58f18fa562dc'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:09.549026 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-22ed457c-a5f0-4fd5-bf36-58f18fa562dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef5be3473eb744df9d9b4779e46297f1', 'request_id': 'req-22ed457c-a5f0-4fd5-bf36-58f18fa562dc'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:09.565779 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-22ed457c-a5f0-4fd5-bf36-58f18fa562dc admin admin] The token cache is being invalidate because project ef5be3473eb744df9d9b4779e46297f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79120) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 25 02:36:09.565997 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-22ed457c-a5f0-4fd5-bf36-58f18fa562dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:09.566685 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-22ed457c-a5f0-4fd5-bf36-58f18fa562dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:09.569428 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 969/1936] 10.222.0.117 () {58 vars in 1237 bytes} [Tue Jan 25 02:36:09 2022] DELETE /identity/v3/projects/ef5be3473eb744df9d9b4779e46297f1 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:36:09.570235 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ed457c-a5f0-4fd5-bf36-58f18fa562dc admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:09.575115 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-22ed457c-a5f0-4fd5-bf36-58f18fa562dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:36:09.577887 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-e72765fc-afd9-46c0-b1cd-593db1fbd835 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35a05eca14c94ad387e3c667a12049b1'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:09.579021 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-e72765fc-afd9-46c0-b1cd-593db1fbd835 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35a05eca14c94ad387e3c667a12049b1'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:09.586853 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-e72765fc-afd9-46c0-b1cd-593db1fbd835 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35a05eca14c94ad387e3c667a12049b1'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:09.587605 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-e72765fc-afd9-46c0-b1cd-593db1fbd835 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35a05eca14c94ad387e3c667a12049b1'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:09.596446 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-e72765fc-afd9-46c0-b1cd-593db1fbd835 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35a05eca14c94ad387e3c667a12049b1'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:09.620129 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 968/1937] 10.222.0.117 () {58 vars in 1228 bytes} [Tue Jan 25 02:36:09 2022] DELETE /identity/v3/users/35a05eca14c94ad387e3c667a12049b1 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:36:09.621576 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a834a06d-b8dd-4d8b-8c0f-245bd356e1a1 None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:09.621874 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a834a06d-b8dd-4d8b-8c0f-245bd356e1a1 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:09.622155 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a834a06d-b8dd-4d8b-8c0f-245bd356e1a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:09.642468 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-a834a06d-b8dd-4d8b-8c0f-245bd356e1a1 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:36:09.643569 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-a834a06d-b8dd-4d8b-8c0f-245bd356e1a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:36:09.647512 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ed457c-a5f0-4fd5-bf36-58f18fa562dc admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:09.735562 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1455ba-e967-420b-8b5e-e33bc9356353 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cc5249aea09430080e232cf17757f86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:09.736466 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1455ba-e967-420b-8b5e-e33bc9356353 service cinder] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:09.737047 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1455ba-e967-420b-8b5e-e33bc9356353 service cinder] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:09.737397 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1455ba-e967-420b-8b5e-e33bc9356353 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:09.741905 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-bb1455ba-e967-420b-8b5e-e33bc9356353 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:36:09.745627 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 969/1938] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:36:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:36:09.753967 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ee8f3b-3c97-4ca3-9fa1-c2bd0e095568 None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:09.754364 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ee8f3b-3c97-4ca3-9fa1-c2bd0e095568 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:09.754747 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ee8f3b-3c97-4ca3-9fa1-c2bd0e095568 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:09.778566 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-35ee8f3b-3c97-4ca3-9fa1-c2bd0e095568 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:36:09.780691 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-35ee8f3b-3c97-4ca3-9fa1-c2bd0e095568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:36:09.792778 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 970/1939] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:36:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 25 02:36:09.798508 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ee8f3b-3c97-4ca3-9fa1-c2bd0e095568 None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:09.809621 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ee8f3b-3c97-4ca3-9fa1-c2bd0e095568 None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:09.817097 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7817d831-b966-4697-b9d1-ef09affbe443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:09.819857 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7817d831-b966-4697-b9d1-ef09affbe443 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:09.820282 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7817d831-b966-4697-b9d1-ef09affbe443 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:09.820627 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7817d831-b966-4697-b9d1-ef09affbe443 admin admin] PATH_INFO: `/v3/domains` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:09.821686 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7817d831-b966-4697-b9d1-ef09affbe443 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:36:09.822365 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7817d831-b966-4697-b9d1-ef09affbe443 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:09.827872 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7817d831-b966-4697-b9d1-ef09affbe443 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:09.837677 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1455ba-e967-420b-8b5e-e33bc9356353 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:09.839978 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1455ba-e967-420b-8b5e-e33bc9356353 service cinder] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:09.852921 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 970/1940] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:36:09 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:36:09.857515 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 971/1941] 10.222.0.117 () {58 vars in 1157 bytes} [Tue Jan 25 02:36:09 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:36:09.858894 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1455ba-e967-420b-8b5e-e33bc9356353 service cinder] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:09.873874 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1455ba-e967-420b-8b5e-e33bc9356353 service cinder] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:09.879677 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b296daf-349d-44a3-adde-79ac17d3cc86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:09.882616 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b296daf-349d-44a3-adde-79ac17d3cc86 admin admin] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:09.883014 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b296daf-349d-44a3-adde-79ac17d3cc86 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:09.883528 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b296daf-349d-44a3-adde-79ac17d3cc86 admin admin] PATH_INFO: `/v3/projects` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:09.884444 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b296daf-349d-44a3-adde-79ac17d3cc86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:09.887281 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b296daf-349d-44a3-adde-79ac17d3cc86 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:09.939889 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 971/1942] 10.222.0.117 () {60 vars in 1157 bytes} [Tue Jan 25 02:36:09 2022] POST /identity/v3/projects => generated 386 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 02:36:09.945034 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7817d831-b966-4697-b9d1-ef09affbe443 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:09.956789 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7817d831-b966-4697-b9d1-ef09affbe443 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:10.041678 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b296daf-349d-44a3-adde-79ac17d3cc86 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:10.043821 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-6b296daf-349d-44a3-adde-79ac17d3cc86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:36:10.076937 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe97d56-1256-41c4-84db-b65cc35bc13c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:10.078009 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe97d56-1256-41c4-84db-b65cc35bc13c admin admin] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:10.078443 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe97d56-1256-41c4-84db-b65cc35bc13c admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:10.078914 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe97d56-1256-41c4-84db-b65cc35bc13c admin admin] PATH_INFO: `/v3/users` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:10.079974 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe97d56-1256-41c4-84db-b65cc35bc13c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:10.082716 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe97d56-1256-41c4-84db-b65cc35bc13c admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:10.127677 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 972/1943] 10.222.0.117 () {60 vars in 1148 bytes} [Tue Jan 25 02:36:09 2022] POST /identity/v3/users => generated 294 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 25 02:36:10.128748 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe97d56-1256-41c4-84db-b65cc35bc13c admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:10.142334 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe97d56-1256-41c4-84db-b65cc35bc13c admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:10.148890 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0c4cfe-9070-4175-a94f-3d628f92716a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:10.149732 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0c4cfe-9070-4175-a94f-3d628f92716a admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:10.150151 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0c4cfe-9070-4175-a94f-3d628f92716a admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:10.150970 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0c4cfe-9070-4175-a94f-3d628f92716a admin admin] PATH_INFO: `/v3/roles` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:10.151800 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0c4cfe-9070-4175-a94f-3d628f92716a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:10.154607 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0c4cfe-9070-4175-a94f-3d628f92716a admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:10.172305 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 973/1944] 10.222.0.117 () {58 vars in 1126 bytes} [Tue Jan 25 02:36:10 2022] GET /identity/v3/roles => generated 1427 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 02:36:10.173294 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0c4cfe-9070-4175-a94f-3d628f92716a admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:10.184967 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0c4cfe-9070-4175-a94f-3d628f92716a admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:10.190891 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665f2f53-0d24-4053-b74e-c51a9732542e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:10.192009 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665f2f53-0d24-4053-b74e-c51a9732542e admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:10.192672 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665f2f53-0d24-4053-b74e-c51a9732542e admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:10.193019 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665f2f53-0d24-4053-b74e-c51a9732542e admin admin] PATH_INFO: `/v3/roles` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:10.194640 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665f2f53-0d24-4053-b74e-c51a9732542e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:10.197995 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665f2f53-0d24-4053-b74e-c51a9732542e admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:10.206340 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b296daf-349d-44a3-adde-79ac17d3cc86 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:10.210198 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 974/1945] 10.222.0.117 () {58 vars in 1126 bytes} [Tue Jan 25 02:36:10 2022] GET /identity/v3/roles => generated 1427 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 02:36:10.214518 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665f2f53-0d24-4053-b74e-c51a9732542e admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:10.227333 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d93a9d3-e72e-4c44-bae4-4deb44898409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:10.228594 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d93a9d3-e72e-4c44-bae4-4deb44898409 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:10.228944 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d93a9d3-e72e-4c44-bae4-4deb44898409 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:10.229573 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d93a9d3-e72e-4c44-bae4-4deb44898409 admin admin] PATH_INFO: `/v3/projects/177aba8c082f45d488d8fe79c1687d06` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:10.230796 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d93a9d3-e72e-4c44-bae4-4deb44898409 admin admin] RBAC: Authorizing `identity:delete_project(project_id=177aba8c082f45d488d8fe79c1687d06)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:10.231066 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665f2f53-0d24-4053-b74e-c51a9732542e admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:10.233186 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d93a9d3-e72e-4c44-bae4-4deb44898409 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:10.237253 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b0c886-b3ae-4dc8-8da2-c0ec008e722f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:10.238410 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b0c886-b3ae-4dc8-8da2-c0ec008e722f admin admin] REQUEST_METHOD: `PUT` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:10.238777 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b0c886-b3ae-4dc8-8da2-c0ec008e722f admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:10.239128 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b0c886-b3ae-4dc8-8da2-c0ec008e722f admin admin] PATH_INFO: `/v3/projects/a18d0ebaee0547d4a788f72886c5d961/users/bed5dc85205a484589d1db0122f6add5/roles/33a8e87420ed423f9cb29e0084eab5d2` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:10.262754 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b0c886-b3ae-4dc8-8da2-c0ec008e722f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a18d0ebaee0547d4a788f72886c5d961, user_id=bed5dc85205a484589d1db0122f6add5, role_id=33a8e87420ed423f9cb29e0084eab5d2)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:10.269727 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b0c886-b3ae-4dc8-8da2-c0ec008e722f admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:10.299830 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 975/1946] 10.222.0.117 () {60 vars in 1487 bytes} [Tue Jan 25 02:36:10 2022] PUT /identity/v3/projects/a18d0ebaee0547d4a788f72886c5d961/users/bed5dc85205a484589d1db0122f6add5/roles/33a8e87420ed423f9cb29e0084eab5d2 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:36:10.300798 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af25100c-def9-4689-8388-66ec277c216b None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:10.301083 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af25100c-def9-4689-8388-66ec277c216b None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:10.301358 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af25100c-def9-4689-8388-66ec277c216b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:10.335605 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-0d93a9d3-e72e-4c44-bae4-4deb44898409 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '177aba8c082f45d488d8fe79c1687d06', 'request_id': 'req-0d93a9d3-e72e-4c44-bae4-4deb44898409'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:10.349434 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-0d93a9d3-e72e-4c44-bae4-4deb44898409 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '177aba8c082f45d488d8fe79c1687d06', 'request_id': 'req-0d93a9d3-e72e-4c44-bae4-4deb44898409'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:10.362117 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-0d93a9d3-e72e-4c44-bae4-4deb44898409 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '177aba8c082f45d488d8fe79c1687d06', 'request_id': 'req-0d93a9d3-e72e-4c44-bae4-4deb44898409'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:10.363210 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-af25100c-def9-4689-8388-66ec277c216b None None] MFA Rules not processed for user `bed5dc85205a484589d1db0122f6add5`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:36:10.366376 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-af25100c-def9-4689-8388-66ec277c216b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:36:10.381614 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-0d93a9d3-e72e-4c44-bae4-4deb44898409 admin admin] The token cache is being invalidate because project 177aba8c082f45d488d8fe79c1687d06 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79120) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 25 02:36:10.382100 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-0d93a9d3-e72e-4c44-bae4-4deb44898409 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:10.383653 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-0d93a9d3-e72e-4c44-bae4-4deb44898409 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:10.391042 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 972/1947] 10.222.0.117 () {58 vars in 1237 bytes} [Tue Jan 25 02:36:10 2022] DELETE /identity/v3/projects/177aba8c082f45d488d8fe79c1687d06 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:36:10.392505 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0334a072-5889-47c7-beb6-2263d742c0fc None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:10.392981 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0334a072-5889-47c7-beb6-2263d742c0fc None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:10.393515 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0334a072-5889-47c7-beb6-2263d742c0fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:10.416256 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-0334a072-5889-47c7-beb6-2263d742c0fc None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:36:10.417693 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-0334a072-5889-47c7-beb6-2263d742c0fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:36:10.477242 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 976/1948] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:36:10 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 25 02:36:10.492384 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af25100c-def9-4689-8388-66ec277c216b None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:10.492636 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 973/1949] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:36:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:36:10.494181 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-af25100c-def9-4689-8388-66ec277c216b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:36:10.501496 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54ae9be-ada6-4b73-b63e-9711f2f76c35 None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:10.501790 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54ae9be-ada6-4b73-b63e-9711f2f76c35 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:10.502066 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54ae9be-ada6-4b73-b63e-9711f2f76c35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:10.527172 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-e54ae9be-ada6-4b73-b63e-9711f2f76c35 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:36:10.529015 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-e54ae9be-ada6-4b73-b63e-9711f2f76c35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:36:10.544133 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 974/1950] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:36:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:36:10.545061 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54ae9be-ada6-4b73-b63e-9711f2f76c35 None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:10.561509 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54ae9be-ada6-4b73-b63e-9711f2f76c35 None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:10.572918 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af25100c-def9-4689-8388-66ec277c216b None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:10.578128 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06193a78-83f4-4c21-8033-ce88c71b2ac5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cc5249aea09430080e232cf17757f86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:10.578802 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06193a78-83f4-4c21-8033-ce88c71b2ac5 service cinder] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:10.579091 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06193a78-83f4-4c21-8033-ce88c71b2ac5 service cinder] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:10.579369 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06193a78-83f4-4c21-8033-ce88c71b2ac5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:10.586028 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4299b285-a11d-48b0-b5cf-78d88b194545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:10.592934 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4299b285-a11d-48b0-b5cf-78d88b194545 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:10.592934 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4299b285-a11d-48b0-b5cf-78d88b194545 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:10.592934 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4299b285-a11d-48b0-b5cf-78d88b194545 admin admin] PATH_INFO: `/v3/domains` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:10.592934 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4299b285-a11d-48b0-b5cf-78d88b194545 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:36:10.592934 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4299b285-a11d-48b0-b5cf-78d88b194545 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:10.592934 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4299b285-a11d-48b0-b5cf-78d88b194545 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:10.596836 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06193a78-83f4-4c21-8033-ce88c71b2ac5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:10.597784 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06193a78-83f4-4c21-8033-ce88c71b2ac5 service cinder] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:10.611779 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 975/1951] 10.222.0.117 () {58 vars in 1157 bytes} [Tue Jan 25 02:36:10 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:36:10.614320 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4299b285-a11d-48b0-b5cf-78d88b194545 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:10.619898 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 977/1952] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:36:10 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:36:10.638593 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4299b285-a11d-48b0-b5cf-78d88b194545 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:10.642380 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06193a78-83f4-4c21-8033-ce88c71b2ac5 service cinder] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:10.643931 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-06193a78-83f4-4c21-8033-ce88c71b2ac5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:36:10.645350 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1e61b0-d7f1-4db7-8218-4fa9a47e9dd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:10.646125 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1e61b0-d7f1-4db7-8218-4fa9a47e9dd1 admin admin] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:10.646548 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1e61b0-d7f1-4db7-8218-4fa9a47e9dd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:10.646931 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1e61b0-d7f1-4db7-8218-4fa9a47e9dd1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:10.647778 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1e61b0-d7f1-4db7-8218-4fa9a47e9dd1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:10.650257 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1e61b0-d7f1-4db7-8218-4fa9a47e9dd1 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:10.670205 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06193a78-83f4-4c21-8033-ce88c71b2ac5 service cinder] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:10.681005 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91c4f11-b5fe-4ca1-99f2-651ebecb110d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:10.681941 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91c4f11-b5fe-4ca1-99f2-651ebecb110d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:10.682238 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91c4f11-b5fe-4ca1-99f2-651ebecb110d admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:10.682598 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91c4f11-b5fe-4ca1-99f2-651ebecb110d admin admin] PATH_INFO: `/v3/users/bed5dc85205a484589d1db0122f6add5` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:10.684029 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91c4f11-b5fe-4ca1-99f2-651ebecb110d admin admin] RBAC: Authorizing `identity:delete_user(user_id=bed5dc85205a484589d1db0122f6add5)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:10.688101 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 976/1953] 10.222.0.117 () {60 vars in 1157 bytes} [Tue Jan 25 02:36:10 2022] POST /identity/v3/projects => generated 368 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 02:36:10.688259 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91c4f11-b5fe-4ca1-99f2-651ebecb110d admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:10.689337 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1e61b0-d7f1-4db7-8218-4fa9a47e9dd1 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:10.779964 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1e61b0-d7f1-4db7-8218-4fa9a47e9dd1 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:10.786655 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04321ca-1965-4644-a719-99fe99323dcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:10.786904 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-d91c4f11-b5fe-4ca1-99f2-651ebecb110d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bed5dc85205a484589d1db0122f6add5'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:10.787837 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04321ca-1965-4644-a719-99fe99323dcc admin admin] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:10.788007 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-d91c4f11-b5fe-4ca1-99f2-651ebecb110d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bed5dc85205a484589d1db0122f6add5'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:10.788309 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04321ca-1965-4644-a719-99fe99323dcc admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:10.788685 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04321ca-1965-4644-a719-99fe99323dcc admin admin] PATH_INFO: `/v3/users` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:10.789721 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04321ca-1965-4644-a719-99fe99323dcc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:10.792651 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04321ca-1965-4644-a719-99fe99323dcc admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:10.795553 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-d91c4f11-b5fe-4ca1-99f2-651ebecb110d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bed5dc85205a484589d1db0122f6add5'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:10.796340 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-d91c4f11-b5fe-4ca1-99f2-651ebecb110d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bed5dc85205a484589d1db0122f6add5'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:10.806388 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-d91c4f11-b5fe-4ca1-99f2-651ebecb110d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bed5dc85205a484589d1db0122f6add5'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:10.835946 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 977/1954] 10.222.0.117 () {60 vars in 1148 bytes} [Tue Jan 25 02:36:10 2022] POST /identity/v3/users => generated 285 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 02:36:10.836215 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 978/1955] 10.222.0.117 () {58 vars in 1228 bytes} [Tue Jan 25 02:36:10 2022] DELETE /identity/v3/users/bed5dc85205a484589d1db0122f6add5 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:36:10.838079 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91c4f11-b5fe-4ca1-99f2-651ebecb110d admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:10.839282 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccc54ac-5811-4b9e-b26d-cd955cad3ef8 None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:10.839571 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-d91c4f11-b5fe-4ca1-99f2-651ebecb110d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:36:10.839686 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccc54ac-5811-4b9e-b26d-cd955cad3ef8 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:10.840054 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccc54ac-5811-4b9e-b26d-cd955cad3ef8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:10.863402 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-cccc54ac-5811-4b9e-b26d-cd955cad3ef8 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:36:10.865209 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-cccc54ac-5811-4b9e-b26d-cd955cad3ef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:36:10.947733 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91c4f11-b5fe-4ca1-99f2-651ebecb110d admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:10.953463 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac25b978-7e4a-4021-af64-805233080526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:10.954974 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac25b978-7e4a-4021-af64-805233080526 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:10.955343 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac25b978-7e4a-4021-af64-805233080526 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:10.956325 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac25b978-7e4a-4021-af64-805233080526 admin admin] PATH_INFO: `/v3/roles` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:10.957631 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac25b978-7e4a-4021-af64-805233080526 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:10.960321 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac25b978-7e4a-4021-af64-805233080526 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:10.963817 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 978/1956] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:36:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:36:10.970961 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccc54ac-5811-4b9e-b26d-cd955cad3ef8 None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:10.972415 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-cccc54ac-5811-4b9e-b26d-cd955cad3ef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:36:10.983235 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 979/1957] 10.222.0.117 () {58 vars in 1126 bytes} [Tue Jan 25 02:36:10 2022] GET /identity/v3/roles => generated 1427 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 02:36:10.989093 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac25b978-7e4a-4021-af64-805233080526 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:11.007299 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac25b978-7e4a-4021-af64-805233080526 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:11.013573 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4cd998-e241-4be5-94ba-293c2fda85d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:11.014320 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4cd998-e241-4be5-94ba-293c2fda85d9 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:11.015114 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4cd998-e241-4be5-94ba-293c2fda85d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:11.015114 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4cd998-e241-4be5-94ba-293c2fda85d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:11.016027 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4cd998-e241-4be5-94ba-293c2fda85d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:11.018013 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4cd998-e241-4be5-94ba-293c2fda85d9 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:11.030800 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 980/1958] 10.222.0.117 () {58 vars in 1126 bytes} [Tue Jan 25 02:36:10 2022] GET /identity/v3/roles => generated 1427 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 02:36:11.034714 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4cd998-e241-4be5-94ba-293c2fda85d9 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:11.058757 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4cd998-e241-4be5-94ba-293c2fda85d9 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:11.070537 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79afa325-6728-499f-bb69-2a4e0bcfd778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:11.071502 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79afa325-6728-499f-bb69-2a4e0bcfd778 admin admin] REQUEST_METHOD: `PUT` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:11.073757 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79afa325-6728-499f-bb69-2a4e0bcfd778 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:11.073876 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79afa325-6728-499f-bb69-2a4e0bcfd778 admin admin] PATH_INFO: `/v3/projects/12f72946428a4b5e936cd73d5dfd6c9c/users/0100ebd352fe45da854323b9f38b153f/roles/33a8e87420ed423f9cb29e0084eab5d2` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:11.094413 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccc54ac-5811-4b9e-b26d-cd955cad3ef8 None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:11.099606 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ded439-5704-46b3-8409-0149d79ca62f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca4071c5f8f4a31b5edb81fa66a43a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:11.101159 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ded439-5704-46b3-8409-0149d79ca62f service neutron] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:11.101452 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ded439-5704-46b3-8409-0149d79ca62f service neutron] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:11.101727 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ded439-5704-46b3-8409-0149d79ca62f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:11.112775 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79afa325-6728-499f-bb69-2a4e0bcfd778 admin admin] RBAC: Authorizing `identity:create_grant(project_id=12f72946428a4b5e936cd73d5dfd6c9c, user_id=0100ebd352fe45da854323b9f38b153f, role_id=33a8e87420ed423f9cb29e0084eab5d2)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:11.117061 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79afa325-6728-499f-bb69-2a4e0bcfd778 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:11.119387 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ded439-5704-46b3-8409-0149d79ca62f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:11.121330 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ded439-5704-46b3-8409-0149d79ca62f service neutron] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:11.133159 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 979/1959] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:36:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:36:11.149301 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 981/1960] 10.222.0.117 () {60 vars in 1487 bytes} [Tue Jan 25 02:36:11 2022] PUT /identity/v3/projects/12f72946428a4b5e936cd73d5dfd6c9c/users/0100ebd352fe45da854323b9f38b153f/roles/33a8e87420ed423f9cb29e0084eab5d2 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:36:11.161902 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cb920a-6207-48d2-8ade-d4f057998134 None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:11.162285 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cb920a-6207-48d2-8ade-d4f057998134 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:11.162742 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cb920a-6207-48d2-8ade-d4f057998134 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:11.195616 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-45cb920a-6207-48d2-8ade-d4f057998134 None None] MFA Rules not processed for user `0100ebd352fe45da854323b9f38b153f`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:36:11.200173 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-45cb920a-6207-48d2-8ade-d4f057998134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:36:11.359429 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 980/1961] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:36:11 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:36:11.361751 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79afa325-6728-499f-bb69-2a4e0bcfd778 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:11.364683 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-79afa325-6728-499f-bb69-2a4e0bcfd778 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:36:11.440277 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79afa325-6728-499f-bb69-2a4e0bcfd778 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:11.450009 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e504c830-f187-45a1-9aef-b1fca7444ea0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db3663416137459d9da4a71032505b0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:11.451287 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e504c830-f187-45a1-9aef-b1fca7444ea0 service glance] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:11.455750 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e504c830-f187-45a1-9aef-b1fca7444ea0 service glance] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:11.455750 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e504c830-f187-45a1-9aef-b1fca7444ea0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:11.465821 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e504c830-f187-45a1-9aef-b1fca7444ea0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:11.467529 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e504c830-f187-45a1-9aef-b1fca7444ea0 service glance] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:11.489603 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 982/1962] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:36:11 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:36:11.707671 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cb920a-6207-48d2-8ade-d4f057998134 None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:11.710515 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-45cb920a-6207-48d2-8ade-d4f057998134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:36:11.820887 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cb920a-6207-48d2-8ade-d4f057998134 None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:11.827434 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264b3b1c-384f-4501-a288-a12c5e4b065d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:11.827996 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264b3b1c-384f-4501-a288-a12c5e4b065d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:11.828532 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264b3b1c-384f-4501-a288-a12c5e4b065d admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:11.828978 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264b3b1c-384f-4501-a288-a12c5e4b065d admin admin] PATH_INFO: `/v3/projects/a18d0ebaee0547d4a788f72886c5d961` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:11.830314 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264b3b1c-384f-4501-a288-a12c5e4b065d admin admin] RBAC: Authorizing `identity:delete_project(project_id=a18d0ebaee0547d4a788f72886c5d961)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:11.832391 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264b3b1c-384f-4501-a288-a12c5e4b065d admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:11.949461 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-264b3b1c-384f-4501-a288-a12c5e4b065d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a18d0ebaee0547d4a788f72886c5d961', 'request_id': 'req-264b3b1c-384f-4501-a288-a12c5e4b065d'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:11.963285 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-264b3b1c-384f-4501-a288-a12c5e4b065d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a18d0ebaee0547d4a788f72886c5d961', 'request_id': 'req-264b3b1c-384f-4501-a288-a12c5e4b065d'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:11.975708 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-264b3b1c-384f-4501-a288-a12c5e4b065d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a18d0ebaee0547d4a788f72886c5d961', 'request_id': 'req-264b3b1c-384f-4501-a288-a12c5e4b065d'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:12.013373 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-264b3b1c-384f-4501-a288-a12c5e4b065d admin admin] The token cache is being invalidate because project a18d0ebaee0547d4a788f72886c5d961 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79120) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 25 02:36:12.013719 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-264b3b1c-384f-4501-a288-a12c5e4b065d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:12.017051 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-264b3b1c-384f-4501-a288-a12c5e4b065d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:12.019243 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 981/1963] 10.222.0.117 () {58 vars in 1237 bytes} [Tue Jan 25 02:36:11 2022] DELETE /identity/v3/projects/a18d0ebaee0547d4a788f72886c5d961 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:36:12.031613 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57c5f81-8bf4-4002-9eea-8cbae72f48b0 None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:12.031922 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57c5f81-8bf4-4002-9eea-8cbae72f48b0 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:12.032256 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57c5f81-8bf4-4002-9eea-8cbae72f48b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:12.057788 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-b57c5f81-8bf4-4002-9eea-8cbae72f48b0 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:36:12.059226 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-b57c5f81-8bf4-4002-9eea-8cbae72f48b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:36:12.197955 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 983/1964] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:36:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:36:12.202512 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5990ef0c-03cd-4386-8a29-7d5117784130 None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:12.202792 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5990ef0c-03cd-4386-8a29-7d5117784130 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:12.203076 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5990ef0c-03cd-4386-8a29-7d5117784130 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:12.235055 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-5990ef0c-03cd-4386-8a29-7d5117784130 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:36:12.236771 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-5990ef0c-03cd-4386-8a29-7d5117784130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:36:12.248670 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 982/1965] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:36:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:36:12.252862 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57c5f81-8bf4-4002-9eea-8cbae72f48b0 None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:12.270456 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57c5f81-8bf4-4002-9eea-8cbae72f48b0 None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:12.284071 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19627fef-d229-437d-97f9-7ba470f09e86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:12.284808 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19627fef-d229-437d-97f9-7ba470f09e86 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:12.285044 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19627fef-d229-437d-97f9-7ba470f09e86 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:12.285321 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19627fef-d229-437d-97f9-7ba470f09e86 admin admin] PATH_INFO: `/v3/domains` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:12.286650 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19627fef-d229-437d-97f9-7ba470f09e86 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:36:12.286650 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19627fef-d229-437d-97f9-7ba470f09e86 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:12.294643 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19627fef-d229-437d-97f9-7ba470f09e86 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:12.342449 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 984/1966] 10.222.0.117 () {58 vars in 1157 bytes} [Tue Jan 25 02:36:12 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:36:12.346909 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5990ef0c-03cd-4386-8a29-7d5117784130 None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:12.361108 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5990ef0c-03cd-4386-8a29-7d5117784130 None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:12.377641 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d1fe5d-ebd2-4290-8368-b640d16cdfcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:12.379640 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d1fe5d-ebd2-4290-8368-b640d16cdfcf admin admin] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:12.381576 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d1fe5d-ebd2-4290-8368-b640d16cdfcf admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:12.382331 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d1fe5d-ebd2-4290-8368-b640d16cdfcf admin admin] PATH_INFO: `/v3/projects` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:12.384085 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d1fe5d-ebd2-4290-8368-b640d16cdfcf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:12.388665 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d1fe5d-ebd2-4290-8368-b640d16cdfcf admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:12.481991 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 983/1967] 10.222.0.117 () {60 vars in 1157 bytes} [Tue Jan 25 02:36:12 2022] POST /identity/v3/projects => generated 374 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 02:36:12.483948 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19627fef-d229-437d-97f9-7ba470f09e86 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:12.490510 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d1fe5d-ebd2-4290-8368-b640d16cdfcf admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:12.494675 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-b4d1fe5d-ebd2-4290-8368-b640d16cdfcf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:36:12.498645 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19627fef-d229-437d-97f9-7ba470f09e86 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:12.626697 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d1fe5d-ebd2-4290-8368-b640d16cdfcf admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:12.629853 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e107f0-9da7-4a03-a954-c9ad6abc9ac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:12.632635 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e107f0-9da7-4a03-a954-c9ad6abc9ac1 admin admin] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:12.633128 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c46908f-040a-40d9-8d07-9e471c16848a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:12.633593 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e107f0-9da7-4a03-a954-c9ad6abc9ac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:12.633996 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e107f0-9da7-4a03-a954-c9ad6abc9ac1 admin admin] PATH_INFO: `/v3/users` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:12.634112 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c46908f-040a-40d9-8d07-9e471c16848a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:12.634295 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c46908f-040a-40d9-8d07-9e471c16848a admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:12.634577 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c46908f-040a-40d9-8d07-9e471c16848a admin admin] PATH_INFO: `/v3/users/ca1d21bea6b049218f07621e811e3abc` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:12.634942 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e107f0-9da7-4a03-a954-c9ad6abc9ac1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:12.635893 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c46908f-040a-40d9-8d07-9e471c16848a admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca1d21bea6b049218f07621e811e3abc)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:12.637589 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e107f0-9da7-4a03-a954-c9ad6abc9ac1 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:12.637830 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c46908f-040a-40d9-8d07-9e471c16848a admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:12.669868 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 985/1968] 10.222.0.117 () {60 vars in 1148 bytes} [Tue Jan 25 02:36:12 2022] POST /identity/v3/users => generated 288 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 02:36:12.669868 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e107f0-9da7-4a03-a954-c9ad6abc9ac1 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:12.678886 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-d2e107f0-9da7-4a03-a954-c9ad6abc9ac1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:36:12.696486 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e107f0-9da7-4a03-a954-c9ad6abc9ac1 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:12.703992 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1302b7b-288a-4fca-a4d8-f559d244f3de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:12.706384 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1302b7b-288a-4fca-a4d8-f559d244f3de admin admin] REQUEST_METHOD: `DELETE` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:12.706732 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1302b7b-288a-4fca-a4d8-f559d244f3de admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:12.707046 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1302b7b-288a-4fca-a4d8-f559d244f3de admin admin] PATH_INFO: `/v3/users/5b7ae346f76d434f8d38ccd5901b5199` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:12.709747 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1302b7b-288a-4fca-a4d8-f559d244f3de admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b7ae346f76d434f8d38ccd5901b5199)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:12.713831 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1302b7b-288a-4fca-a4d8-f559d244f3de admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:12.756455 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-0c46908f-040a-40d9-8d07-9e471c16848a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca1d21bea6b049218f07621e811e3abc'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:12.786044 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-0c46908f-040a-40d9-8d07-9e471c16848a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca1d21bea6b049218f07621e811e3abc'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:12.786747 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-0c46908f-040a-40d9-8d07-9e471c16848a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca1d21bea6b049218f07621e811e3abc'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:12.788188 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-0c46908f-040a-40d9-8d07-9e471c16848a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca1d21bea6b049218f07621e811e3abc'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:12.793209 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-a1302b7b-288a-4fca-a4d8-f559d244f3de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b7ae346f76d434f8d38ccd5901b5199'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:12.793209 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-a1302b7b-288a-4fca-a4d8-f559d244f3de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b7ae346f76d434f8d38ccd5901b5199'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:12.801412 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-a1302b7b-288a-4fca-a4d8-f559d244f3de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b7ae346f76d434f8d38ccd5901b5199'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:12.802183 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-a1302b7b-288a-4fca-a4d8-f559d244f3de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b7ae346f76d434f8d38ccd5901b5199'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:12.812220 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-a1302b7b-288a-4fca-a4d8-f559d244f3de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b7ae346f76d434f8d38ccd5901b5199'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:12.823131 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-0c46908f-040a-40d9-8d07-9e471c16848a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca1d21bea6b049218f07621e811e3abc'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:12.840694 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 986/1969] 10.222.0.117 () {58 vars in 1228 bytes} [Tue Jan 25 02:36:12 2022] DELETE /identity/v3/users/5b7ae346f76d434f8d38ccd5901b5199 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:36:12.841559 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1302b7b-288a-4fca-a4d8-f559d244f3de admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:12.843049 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-a1302b7b-288a-4fca-a4d8-f559d244f3de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:36:12.848828 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 984/1970] 10.222.0.117 () {58 vars in 1228 bytes} [Tue Jan 25 02:36:12 2022] DELETE /identity/v3/users/ca1d21bea6b049218f07621e811e3abc => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:36:12.852443 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81f0423-ecdb-4584-ab72-2c0d95a077d7 None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:12.852995 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81f0423-ecdb-4584-ab72-2c0d95a077d7 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:12.853424 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81f0423-ecdb-4584-ab72-2c0d95a077d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:12.903393 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-c81f0423-ecdb-4584-ab72-2c0d95a077d7 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:36:12.906775 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-c81f0423-ecdb-4584-ab72-2c0d95a077d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:36:12.939439 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1302b7b-288a-4fca-a4d8-f559d244f3de admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:13.034011 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d0019b-c0f0-467e-871b-31778d6d66b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:13.035255 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d0019b-c0f0-467e-871b-31778d6d66b5 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:13.035573 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d0019b-c0f0-467e-871b-31778d6d66b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:13.035886 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d0019b-c0f0-467e-871b-31778d6d66b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:13.036654 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d0019b-c0f0-467e-871b-31778d6d66b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:13.060396 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d0019b-c0f0-467e-871b-31778d6d66b5 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:13.078236 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 987/1971] 10.222.0.117 () {58 vars in 1126 bytes} [Tue Jan 25 02:36:12 2022] GET /identity/v3/roles => generated 1427 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 02:36:13.078236 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0a653e-292c-475a-ad47-bea903e1b36a None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:13.078236 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0a653e-292c-475a-ad47-bea903e1b36a None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:13.078236 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0a653e-292c-475a-ad47-bea903e1b36a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:13.112225 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-6a0a653e-292c-475a-ad47-bea903e1b36a None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:36:13.115028 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-6a0a653e-292c-475a-ad47-bea903e1b36a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:36:13.121521 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 985/1972] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:36:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:36:13.124616 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81f0423-ecdb-4584-ab72-2c0d95a077d7 None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:13.150235 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81f0423-ecdb-4584-ab72-2c0d95a077d7 None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:13.152472 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 988/1973] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:36:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:36:13.155077 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0a653e-292c-475a-ad47-bea903e1b36a None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:13.156940 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-6a0a653e-292c-475a-ad47-bea903e1b36a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:36:13.165800 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2435eed5-97f2-47a0-966f-e5e6df6e7844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:13.166663 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2435eed5-97f2-47a0-966f-e5e6df6e7844 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:13.167341 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2435eed5-97f2-47a0-966f-e5e6df6e7844 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:13.167341 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2435eed5-97f2-47a0-966f-e5e6df6e7844 admin admin] PATH_INFO: `/v3/roles` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:13.168470 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2435eed5-97f2-47a0-966f-e5e6df6e7844 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:13.175030 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2435eed5-97f2-47a0-966f-e5e6df6e7844 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:13.189120 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 986/1974] 10.222.0.117 () {58 vars in 1126 bytes} [Tue Jan 25 02:36:13 2022] GET /identity/v3/roles => generated 1427 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 02:36:13.189120 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2435eed5-97f2-47a0-966f-e5e6df6e7844 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:13.204938 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-2435eed5-97f2-47a0-966f-e5e6df6e7844 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:36:13.312989 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0a653e-292c-475a-ad47-bea903e1b36a None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:13.326233 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62d42fd-1726-4428-a90c-4a5e8becac28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca4071c5f8f4a31b5edb81fa66a43a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:13.326914 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62d42fd-1726-4428-a90c-4a5e8becac28 service neutron] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:13.327203 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62d42fd-1726-4428-a90c-4a5e8becac28 service neutron] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:13.327515 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62d42fd-1726-4428-a90c-4a5e8becac28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:13.356117 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62d42fd-1726-4428-a90c-4a5e8becac28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:13.356625 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2435eed5-97f2-47a0-966f-e5e6df6e7844 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:13.357831 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62d42fd-1726-4428-a90c-4a5e8becac28 service neutron] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:13.363990 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd969e52-8aae-473d-93eb-c4ab442ce1f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca4071c5f8f4a31b5edb81fa66a43a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:13.365896 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd969e52-8aae-473d-93eb-c4ab442ce1f5 service neutron] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:13.366735 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd969e52-8aae-473d-93eb-c4ab442ce1f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:13.368821 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd969e52-8aae-473d-93eb-c4ab442ce1f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:13.385103 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd969e52-8aae-473d-93eb-c4ab442ce1f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:13.386769 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd969e52-8aae-473d-93eb-c4ab442ce1f5 service neutron] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:13.388192 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 989/1975] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:36:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:36:13.389277 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62d42fd-1726-4428-a90c-4a5e8becac28 service neutron] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:13.419862 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62d42fd-1726-4428-a90c-4a5e8becac28 service neutron] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:13.435569 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 987/1976] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:36:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:36:13.439425 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0c9cb7-efee-43d4-8d52-6710dcbb4ff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:13.440507 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0c9cb7-efee-43d4-8d52-6710dcbb4ff2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:13.440889 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0c9cb7-efee-43d4-8d52-6710dcbb4ff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:13.452247 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0c9cb7-efee-43d4-8d52-6710dcbb4ff2 admin admin] PATH_INFO: `/v3/projects/a6e22b8b58184e559891734bf006de1b/users/7d2b2516e1694156bf40f40b434e0f9f/roles/33a8e87420ed423f9cb29e0084eab5d2` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:13.483206 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0c9cb7-efee-43d4-8d52-6710dcbb4ff2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6e22b8b58184e559891734bf006de1b, user_id=7d2b2516e1694156bf40f40b434e0f9f, role_id=33a8e87420ed423f9cb29e0084eab5d2)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:13.487455 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0c9cb7-efee-43d4-8d52-6710dcbb4ff2 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:13.509882 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 990/1977] 10.222.0.117 () {60 vars in 1487 bytes} [Tue Jan 25 02:36:13 2022] PUT /identity/v3/projects/a6e22b8b58184e559891734bf006de1b/users/7d2b2516e1694156bf40f40b434e0f9f/roles/33a8e87420ed423f9cb29e0084eab5d2 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:36:13.523961 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755db3c7-7774-4c7f-81d2-97a9498f4cf1 None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:13.523961 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755db3c7-7774-4c7f-81d2-97a9498f4cf1 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:13.524175 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755db3c7-7774-4c7f-81d2-97a9498f4cf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:13.558981 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-755db3c7-7774-4c7f-81d2-97a9498f4cf1 None None] MFA Rules not processed for user `7d2b2516e1694156bf40f40b434e0f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:36:13.561212 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-755db3c7-7774-4c7f-81d2-97a9498f4cf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:36:13.671123 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 988/1978] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:36:13 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:36:13.686047 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0c9cb7-efee-43d4-8d52-6710dcbb4ff2 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:13.690597 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-6b0c9cb7-efee-43d4-8d52-6710dcbb4ff2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:36:13.805847 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0c9cb7-efee-43d4-8d52-6710dcbb4ff2 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:13.812291 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bbb72d-10cf-4fcd-bcd6-b912809c5c2d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cc5249aea09430080e232cf17757f86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:13.813050 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bbb72d-10cf-4fcd-bcd6-b912809c5c2d service cinder] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:13.813411 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bbb72d-10cf-4fcd-bcd6-b912809c5c2d service cinder] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:13.814142 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bbb72d-10cf-4fcd-bcd6-b912809c5c2d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:13.838670 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bbb72d-10cf-4fcd-bcd6-b912809c5c2d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:13.841305 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bbb72d-10cf-4fcd-bcd6-b912809c5c2d service cinder] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:13.858898 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 991/1979] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:36:13 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:36:13.902188 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755db3c7-7774-4c7f-81d2-97a9498f4cf1 None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:13.946366 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bbb72d-10cf-4fcd-bcd6-b912809c5c2d service cinder] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:13.947955 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-86bbb72d-10cf-4fcd-bcd6-b912809c5c2d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:36:14.048286 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755db3c7-7774-4c7f-81d2-97a9498f4cf1 None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:14.055999 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323bf437-3293-44f6-bfb9-240857afb0fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:14.058102 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323bf437-3293-44f6-bfb9-240857afb0fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:14.058635 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323bf437-3293-44f6-bfb9-240857afb0fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:14.059174 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323bf437-3293-44f6-bfb9-240857afb0fc admin admin] PATH_INFO: `/v3/users/7d2b2516e1694156bf40f40b434e0f9f` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:14.061792 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323bf437-3293-44f6-bfb9-240857afb0fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d2b2516e1694156bf40f40b434e0f9f)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:14.065379 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323bf437-3293-44f6-bfb9-240857afb0fc admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:14.127728 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bbb72d-10cf-4fcd-bcd6-b912809c5c2d service cinder] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:14.139207 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbef26e5-67d2-4705-a512-c6831409e824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:14.140115 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbef26e5-67d2-4705-a512-c6831409e824 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:14.140406 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbef26e5-67d2-4705-a512-c6831409e824 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:14.140685 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbef26e5-67d2-4705-a512-c6831409e824 admin admin] PATH_INFO: `/v3/projects/be17c78cfd2a4125996a10e3841aa4d6` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:14.145717 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbef26e5-67d2-4705-a512-c6831409e824 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be17c78cfd2a4125996a10e3841aa4d6)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:14.148531 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbef26e5-67d2-4705-a512-c6831409e824 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:14.176277 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-323bf437-3293-44f6-bfb9-240857afb0fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d2b2516e1694156bf40f40b434e0f9f'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:14.193052 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-323bf437-3293-44f6-bfb9-240857afb0fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d2b2516e1694156bf40f40b434e0f9f'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:14.193992 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-323bf437-3293-44f6-bfb9-240857afb0fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d2b2516e1694156bf40f40b434e0f9f'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:14.194837 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-323bf437-3293-44f6-bfb9-240857afb0fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d2b2516e1694156bf40f40b434e0f9f'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:14.242067 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-323bf437-3293-44f6-bfb9-240857afb0fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d2b2516e1694156bf40f40b434e0f9f'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:14.251662 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-dbef26e5-67d2-4705-a512-c6831409e824 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be17c78cfd2a4125996a10e3841aa4d6', 'request_id': 'req-dbef26e5-67d2-4705-a512-c6831409e824'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:14.259749 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-dbef26e5-67d2-4705-a512-c6831409e824 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be17c78cfd2a4125996a10e3841aa4d6', 'request_id': 'req-dbef26e5-67d2-4705-a512-c6831409e824'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:14.285890 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 989/1980] 10.222.0.117 () {58 vars in 1228 bytes} [Tue Jan 25 02:36:13 2022] DELETE /identity/v3/users/7d2b2516e1694156bf40f40b434e0f9f => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 25 02:36:14.290383 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323bf437-3293-44f6-bfb9-240857afb0fc admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:14.291170 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-dbef26e5-67d2-4705-a512-c6831409e824 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be17c78cfd2a4125996a10e3841aa4d6', 'request_id': 'req-dbef26e5-67d2-4705-a512-c6831409e824'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:14.291902 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-323bf437-3293-44f6-bfb9-240857afb0fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:36:14.309254 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-dbef26e5-67d2-4705-a512-c6831409e824 admin admin] The token cache is being invalidate because project be17c78cfd2a4125996a10e3841aa4d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79121) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 25 02:36:14.309547 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-dbef26e5-67d2-4705-a512-c6831409e824 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:14.310211 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-dbef26e5-67d2-4705-a512-c6831409e824 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:14.312175 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 992/1981] 10.222.0.117 () {58 vars in 1237 bytes} [Tue Jan 25 02:36:13 2022] DELETE /identity/v3/projects/be17c78cfd2a4125996a10e3841aa4d6 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:36:14.313623 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b72113a-a010-498c-9580-c2e63066681f None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:14.313779 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b72113a-a010-498c-9580-c2e63066681f None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:14.314056 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b72113a-a010-498c-9580-c2e63066681f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:14.341824 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-3b72113a-a010-498c-9580-c2e63066681f None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:36:14.345400 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-3b72113a-a010-498c-9580-c2e63066681f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:36:14.448641 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 993/1982] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:36:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:36:14.449274 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b72113a-a010-498c-9580-c2e63066681f None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:14.450696 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-3b72113a-a010-498c-9580-c2e63066681f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:36:14.465660 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323bf437-3293-44f6-bfb9-240857afb0fc admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:14.466835 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b72113a-a010-498c-9580-c2e63066681f None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:14.471902 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9b22dd-1f35-4120-a100-9e5e58b7fcf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:14.472841 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9b22dd-1f35-4120-a100-9e5e58b7fcf3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:14.473192 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9b22dd-1f35-4120-a100-9e5e58b7fcf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:14.473780 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9b22dd-1f35-4120-a100-9e5e58b7fcf3 admin admin] PATH_INFO: `/v3/projects/656c80cb424c43aea15960353dff8397` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:14.478006 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9b22dd-1f35-4120-a100-9e5e58b7fcf3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=656c80cb424c43aea15960353dff8397)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:14.479802 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e14ce5e-20a9-425f-8f43-75a9b5b6d191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:14.480616 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9b22dd-1f35-4120-a100-9e5e58b7fcf3 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:14.480735 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e14ce5e-20a9-425f-8f43-75a9b5b6d191 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:14.480929 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e14ce5e-20a9-425f-8f43-75a9b5b6d191 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:14.481203 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e14ce5e-20a9-425f-8f43-75a9b5b6d191 admin admin] PATH_INFO: `/v3/users/f70eacac146d410e8b969042a91be9b0` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:14.482436 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e14ce5e-20a9-425f-8f43-75a9b5b6d191 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f70eacac146d410e8b969042a91be9b0)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:14.484463 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e14ce5e-20a9-425f-8f43-75a9b5b6d191 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:14.542391 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-ec9b22dd-1f35-4120-a100-9e5e58b7fcf3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '656c80cb424c43aea15960353dff8397', 'request_id': 'req-ec9b22dd-1f35-4120-a100-9e5e58b7fcf3'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:14.545963 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-1e14ce5e-20a9-425f-8f43-75a9b5b6d191 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f70eacac146d410e8b969042a91be9b0'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:14.547494 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-1e14ce5e-20a9-425f-8f43-75a9b5b6d191 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f70eacac146d410e8b969042a91be9b0'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:14.548069 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-ec9b22dd-1f35-4120-a100-9e5e58b7fcf3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '656c80cb424c43aea15960353dff8397', 'request_id': 'req-ec9b22dd-1f35-4120-a100-9e5e58b7fcf3'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:14.557643 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-1e14ce5e-20a9-425f-8f43-75a9b5b6d191 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f70eacac146d410e8b969042a91be9b0'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:14.558863 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-1e14ce5e-20a9-425f-8f43-75a9b5b6d191 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f70eacac146d410e8b969042a91be9b0'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:14.565853 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-ec9b22dd-1f35-4120-a100-9e5e58b7fcf3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '656c80cb424c43aea15960353dff8397', 'request_id': 'req-ec9b22dd-1f35-4120-a100-9e5e58b7fcf3'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:14.567952 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-1e14ce5e-20a9-425f-8f43-75a9b5b6d191 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f70eacac146d410e8b969042a91be9b0'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:14.596241 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-ec9b22dd-1f35-4120-a100-9e5e58b7fcf3 admin admin] The token cache is being invalidate because project 656c80cb424c43aea15960353dff8397 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79120) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 25 02:36:14.596663 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-ec9b22dd-1f35-4120-a100-9e5e58b7fcf3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:14.597617 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-ec9b22dd-1f35-4120-a100-9e5e58b7fcf3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:14.602086 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 990/1983] 10.222.0.117 () {58 vars in 1237 bytes} [Tue Jan 25 02:36:14 2022] DELETE /identity/v3/projects/656c80cb424c43aea15960353dff8397 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:36:14.602086 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9b22dd-1f35-4120-a100-9e5e58b7fcf3 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:14.606432 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-ec9b22dd-1f35-4120-a100-9e5e58b7fcf3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:36:14.612493 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 994/1984] 10.222.0.117 () {58 vars in 1228 bytes} [Tue Jan 25 02:36:14 2022] DELETE /identity/v3/users/f70eacac146d410e8b969042a91be9b0 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:36:14.613502 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e14ce5e-20a9-425f-8f43-75a9b5b6d191 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:14.633845 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-1e14ce5e-20a9-425f-8f43-75a9b5b6d191 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:36:14.752944 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9b22dd-1f35-4120-a100-9e5e58b7fcf3 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:14.789912 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e14ce5e-20a9-425f-8f43-75a9b5b6d191 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:14.795165 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a0e993-0166-460c-8d12-6e0119c6c7a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:14.796104 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a0e993-0166-460c-8d12-6e0119c6c7a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:14.796384 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a0e993-0166-460c-8d12-6e0119c6c7a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:14.796660 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a0e993-0166-460c-8d12-6e0119c6c7a2 admin admin] PATH_INFO: `/v3/users/dbc5f730a6784134acd4032f2e6d542b` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:14.798078 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a0e993-0166-460c-8d12-6e0119c6c7a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dbc5f730a6784134acd4032f2e6d542b)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:14.800130 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a0e993-0166-460c-8d12-6e0119c6c7a2 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:14.882913 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93226dd-f70a-4b21-aaaf-2f5abf78835a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca4071c5f8f4a31b5edb81fa66a43a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:14.883948 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93226dd-f70a-4b21-aaaf-2f5abf78835a service neutron] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:14.884908 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93226dd-f70a-4b21-aaaf-2f5abf78835a service neutron] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:14.885481 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93226dd-f70a-4b21-aaaf-2f5abf78835a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:14.889244 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-f93226dd-f70a-4b21-aaaf-2f5abf78835a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:36:14.894143 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-37a0e993-0166-460c-8d12-6e0119c6c7a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dbc5f730a6784134acd4032f2e6d542b'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:14.894785 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-37a0e993-0166-460c-8d12-6e0119c6c7a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dbc5f730a6784134acd4032f2e6d542b'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:14.909330 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93226dd-f70a-4b21-aaaf-2f5abf78835a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:14.911544 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93226dd-f70a-4b21-aaaf-2f5abf78835a service neutron] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:14.912545 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-37a0e993-0166-460c-8d12-6e0119c6c7a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dbc5f730a6784134acd4032f2e6d542b'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:14.914836 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-37a0e993-0166-460c-8d12-6e0119c6c7a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dbc5f730a6784134acd4032f2e6d542b'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:14.925917 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 991/1985] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:36:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:36:14.947678 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-37a0e993-0166-460c-8d12-6e0119c6c7a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dbc5f730a6784134acd4032f2e6d542b'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:14.996601 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 995/1986] 10.222.0.117 () {58 vars in 1228 bytes} [Tue Jan 25 02:36:14 2022] DELETE /identity/v3/users/dbc5f730a6784134acd4032f2e6d542b => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:36:15.188393 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93226dd-f70a-4b21-aaaf-2f5abf78835a service neutron] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:15.189939 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-f93226dd-f70a-4b21-aaaf-2f5abf78835a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:36:15.213472 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93226dd-f70a-4b21-aaaf-2f5abf78835a service neutron] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:15.335803 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768688fa-4fbc-40a4-accb-553b57ff33d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:15.336962 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768688fa-4fbc-40a4-accb-553b57ff33d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:15.337081 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768688fa-4fbc-40a4-accb-553b57ff33d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:15.338716 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768688fa-4fbc-40a4-accb-553b57ff33d1 admin admin] PATH_INFO: `/v3/projects/6a77a5a817cc4ed5bcde8b9baa441997` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:15.342534 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768688fa-4fbc-40a4-accb-553b57ff33d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a77a5a817cc4ed5bcde8b9baa441997)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:15.347883 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768688fa-4fbc-40a4-accb-553b57ff33d1 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:15.410767 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-768688fa-4fbc-40a4-accb-553b57ff33d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a77a5a817cc4ed5bcde8b9baa441997', 'request_id': 'req-768688fa-4fbc-40a4-accb-553b57ff33d1'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:15.419230 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a0e993-0166-460c-8d12-6e0119c6c7a2 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:15.419647 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-768688fa-4fbc-40a4-accb-553b57ff33d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a77a5a817cc4ed5bcde8b9baa441997', 'request_id': 'req-768688fa-4fbc-40a4-accb-553b57ff33d1'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:15.420855 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-37a0e993-0166-460c-8d12-6e0119c6c7a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:36:15.436734 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-768688fa-4fbc-40a4-accb-553b57ff33d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a77a5a817cc4ed5bcde8b9baa441997', 'request_id': 'req-768688fa-4fbc-40a4-accb-553b57ff33d1'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:15.453174 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a0e993-0166-460c-8d12-6e0119c6c7a2 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:15.469739 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-768688fa-4fbc-40a4-accb-553b57ff33d1 admin admin] The token cache is being invalidate because project 6a77a5a817cc4ed5bcde8b9baa441997 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79120) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 25 02:36:15.470090 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-768688fa-4fbc-40a4-accb-553b57ff33d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:15.473501 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-768688fa-4fbc-40a4-accb-553b57ff33d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:15.477365 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 992/1987] 10.222.0.117 () {58 vars in 1237 bytes} [Tue Jan 25 02:36:15 2022] DELETE /identity/v3/projects/6a77a5a817cc4ed5bcde8b9baa441997 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:36:15.483840 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba11ca0-1029-4fc6-9599-94819ca79c37 None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:15.484241 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba11ca0-1029-4fc6-9599-94819ca79c37 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:15.484519 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba11ca0-1029-4fc6-9599-94819ca79c37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:15.507073 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-dba11ca0-1029-4fc6-9599-94819ca79c37 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:36:15.508342 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-dba11ca0-1029-4fc6-9599-94819ca79c37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:36:15.534245 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201eed82-f0e1-4053-aa78-476aee65d5d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:15.535330 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201eed82-f0e1-4053-aa78-476aee65d5d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:15.535803 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201eed82-f0e1-4053-aa78-476aee65d5d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:15.536203 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201eed82-f0e1-4053-aa78-476aee65d5d4 admin admin] PATH_INFO: `/v3/projects/a6e22b8b58184e559891734bf006de1b` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:15.538190 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201eed82-f0e1-4053-aa78-476aee65d5d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6e22b8b58184e559891734bf006de1b)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:15.540207 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201eed82-f0e1-4053-aa78-476aee65d5d4 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:15.575552 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 993/1988] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:36:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:36:15.576650 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba11ca0-1029-4fc6-9599-94819ca79c37 None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:15.577843 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-dba11ca0-1029-4fc6-9599-94819ca79c37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:36:15.592288 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-201eed82-f0e1-4053-aa78-476aee65d5d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6e22b8b58184e559891734bf006de1b', 'request_id': 'req-201eed82-f0e1-4053-aa78-476aee65d5d4'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:15.596071 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba11ca0-1029-4fc6-9599-94819ca79c37 None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:15.598511 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-201eed82-f0e1-4053-aa78-476aee65d5d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6e22b8b58184e559891734bf006de1b', 'request_id': 'req-201eed82-f0e1-4053-aa78-476aee65d5d4'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:15.607201 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-201eed82-f0e1-4053-aa78-476aee65d5d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6e22b8b58184e559891734bf006de1b', 'request_id': 'req-201eed82-f0e1-4053-aa78-476aee65d5d4'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:15.618895 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-201eed82-f0e1-4053-aa78-476aee65d5d4 admin admin] The token cache is being invalidate because project a6e22b8b58184e559891734bf006de1b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79121) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 25 02:36:15.619185 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-201eed82-f0e1-4053-aa78-476aee65d5d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:15.619867 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-201eed82-f0e1-4053-aa78-476aee65d5d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:15.621401 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 996/1989] 10.222.0.117 () {58 vars in 1237 bytes} [Tue Jan 25 02:36:15 2022] DELETE /identity/v3/projects/a6e22b8b58184e559891734bf006de1b => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:36:15.626004 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceb6eb9-7470-4f9d-acc0-2752ba2cc8b8 None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:15.626004 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceb6eb9-7470-4f9d-acc0-2752ba2cc8b8 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:15.626004 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceb6eb9-7470-4f9d-acc0-2752ba2cc8b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:15.645672 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-1ceb6eb9-7470-4f9d-acc0-2752ba2cc8b8 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:36:15.647676 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-1ceb6eb9-7470-4f9d-acc0-2752ba2cc8b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:36:15.656740 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af309a70-8e05-4c52-ab83-a3c7a370fa61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:15.657957 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af309a70-8e05-4c52-ab83-a3c7a370fa61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:15.658250 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af309a70-8e05-4c52-ab83-a3c7a370fa61 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:15.658596 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af309a70-8e05-4c52-ab83-a3c7a370fa61 admin admin] PATH_INFO: `/v3/projects/1b54612e9a494839a3f316876dfe9ae0` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:15.660103 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af309a70-8e05-4c52-ab83-a3c7a370fa61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b54612e9a494839a3f316876dfe9ae0)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:15.663013 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af309a70-8e05-4c52-ab83-a3c7a370fa61 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:15.720754 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-af309a70-8e05-4c52-ab83-a3c7a370fa61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b54612e9a494839a3f316876dfe9ae0', 'request_id': 'req-af309a70-8e05-4c52-ab83-a3c7a370fa61'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:15.726505 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 997/1990] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:36:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:36:15.728581 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8167a66-4902-4530-b6d0-112c23129cda None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:15.729249 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8167a66-4902-4530-b6d0-112c23129cda None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:15.730581 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8167a66-4902-4530-b6d0-112c23129cda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:15.730699 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-af309a70-8e05-4c52-ab83-a3c7a370fa61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b54612e9a494839a3f316876dfe9ae0', 'request_id': 'req-af309a70-8e05-4c52-ab83-a3c7a370fa61'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:15.737584 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-af309a70-8e05-4c52-ab83-a3c7a370fa61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b54612e9a494839a3f316876dfe9ae0', 'request_id': 'req-af309a70-8e05-4c52-ab83-a3c7a370fa61'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:15.753525 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-af309a70-8e05-4c52-ab83-a3c7a370fa61 admin admin] The token cache is being invalidate because project 1b54612e9a494839a3f316876dfe9ae0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79120) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 25 02:36:15.753899 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-af309a70-8e05-4c52-ab83-a3c7a370fa61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:15.755110 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-af309a70-8e05-4c52-ab83-a3c7a370fa61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:15.755896 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-c8167a66-4902-4530-b6d0-112c23129cda None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:36:15.757051 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-c8167a66-4902-4530-b6d0-112c23129cda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:36:15.757744 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 994/1991] 10.222.0.117 () {58 vars in 1237 bytes} [Tue Jan 25 02:36:15 2022] DELETE /identity/v3/projects/1b54612e9a494839a3f316876dfe9ae0 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:36:15.758666 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af309a70-8e05-4c52-ab83-a3c7a370fa61 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:15.760112 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-af309a70-8e05-4c52-ab83-a3c7a370fa61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:36:15.852254 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af309a70-8e05-4c52-ab83-a3c7a370fa61 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:15.857412 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01337d59-5965-40fc-94b2-23810b3c118c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:15.858117 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01337d59-5965-40fc-94b2-23810b3c118c admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:15.858475 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01337d59-5965-40fc-94b2-23810b3c118c admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:15.858981 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01337d59-5965-40fc-94b2-23810b3c118c admin admin] PATH_INFO: `/v3/domains` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:15.859904 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01337d59-5965-40fc-94b2-23810b3c118c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:36:15.861405 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 998/1992] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:36:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:36:15.861559 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01337d59-5965-40fc-94b2-23810b3c118c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:15.862965 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3237bb30-b435-4850-bace-bd57c155a83f None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:15.863313 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3237bb30-b435-4850-bace-bd57c155a83f None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:15.863417 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01337d59-5965-40fc-94b2-23810b3c118c admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:15.863596 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3237bb30-b435-4850-bace-bd57c155a83f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:15.880366 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 995/1993] 10.222.0.117 () {58 vars in 1157 bytes} [Tue Jan 25 02:36:15 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:36:15.882590 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf5456c-2226-4136-b833-aaf8e4217aa6 None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:15.882994 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf5456c-2226-4136-b833-aaf8e4217aa6 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:15.883709 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf5456c-2226-4136-b833-aaf8e4217aa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:15.886464 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-3237bb30-b435-4850-bace-bd57c155a83f None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:36:15.887679 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-3237bb30-b435-4850-bace-bd57c155a83f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:36:15.908029 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 999/1994] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:36:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:36:15.908029 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3237bb30-b435-4850-bace-bd57c155a83f None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:15.913936 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3237bb30-b435-4850-bace-bd57c155a83f None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:15.919293 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c930ea3b-e65d-4657-849a-a9b365f89327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:15.920110 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c930ea3b-e65d-4657-849a-a9b365f89327 admin admin] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:15.920388 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c930ea3b-e65d-4657-849a-a9b365f89327 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:15.920664 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c930ea3b-e65d-4657-849a-a9b365f89327 admin admin] PATH_INFO: `/v3/projects` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:15.921475 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c930ea3b-e65d-4657-849a-a9b365f89327 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:15.923619 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c930ea3b-e65d-4657-849a-a9b365f89327 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:15.926681 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-dbf5456c-2226-4136-b833-aaf8e4217aa6 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:36:15.928037 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-dbf5456c-2226-4136-b833-aaf8e4217aa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:36:15.936641 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 996/1995] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:36:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:36:15.938327 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bdac70-c615-486b-b043-dff9ba5a9268 None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:15.938783 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bdac70-c615-486b-b043-dff9ba5a9268 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:15.939160 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bdac70-c615-486b-b043-dff9ba5a9268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:15.955849 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1000/1996] 10.222.0.117 () {60 vars in 1157 bytes} [Tue Jan 25 02:36:15 2022] POST /identity/v3/projects => generated 388 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 02:36:15.955849 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c930ea3b-e65d-4657-849a-a9b365f89327 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:15.964824 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-c0bdac70-c615-486b-b043-dff9ba5a9268 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:36:15.966104 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-c0bdac70-c615-486b-b043-dff9ba5a9268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:36:16.033840 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c930ea3b-e65d-4657-849a-a9b365f89327 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:16.038568 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 997/1997] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:36:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:36:16.040192 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb38caa-06e1-4770-b3db-55a4002ffd34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:16.040899 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bdac70-c615-486b-b043-dff9ba5a9268 None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:16.041192 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb38caa-06e1-4770-b3db-55a4002ffd34 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:16.041572 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb38caa-06e1-4770-b3db-55a4002ffd34 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:16.041873 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb38caa-06e1-4770-b3db-55a4002ffd34 admin admin] PATH_INFO: `/v3/domains` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:16.042643 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb38caa-06e1-4770-b3db-55a4002ffd34 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:36:16.042951 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb38caa-06e1-4770-b3db-55a4002ffd34 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:16.044823 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb38caa-06e1-4770-b3db-55a4002ffd34 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:16.060899 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1001/1998] 10.222.0.117 () {58 vars in 1157 bytes} [Tue Jan 25 02:36:15 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:36:16.061206 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bdac70-c615-486b-b043-dff9ba5a9268 None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:16.061849 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb38caa-06e1-4770-b3db-55a4002ffd34 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:16.066763 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd08d183-d1ae-412a-985e-689262abf2e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:16.067506 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd08d183-d1ae-412a-985e-689262abf2e2 admin admin] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:16.067740 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd08d183-d1ae-412a-985e-689262abf2e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:16.068659 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd08d183-d1ae-412a-985e-689262abf2e2 admin admin] PATH_INFO: `/v3/users` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:16.069634 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd08d183-d1ae-412a-985e-689262abf2e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:16.071615 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd08d183-d1ae-412a-985e-689262abf2e2 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:16.076431 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb38caa-06e1-4770-b3db-55a4002ffd34 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:16.082470 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe3f3bc-26cb-4d16-b2e7-426a19304471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:16.083143 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe3f3bc-26cb-4d16-b2e7-426a19304471 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:16.084443 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe3f3bc-26cb-4d16-b2e7-426a19304471 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:16.085374 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe3f3bc-26cb-4d16-b2e7-426a19304471 admin admin] PATH_INFO: `/v3/domains` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:16.087396 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe3f3bc-26cb-4d16-b2e7-426a19304471 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:36:16.087746 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe3f3bc-26cb-4d16-b2e7-426a19304471 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:16.089542 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe3f3bc-26cb-4d16-b2e7-426a19304471 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:16.094414 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 998/1999] 10.222.0.117 () {60 vars in 1148 bytes} [Tue Jan 25 02:36:16 2022] POST /identity/v3/users => generated 295 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 02:36:16.095395 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd08d183-d1ae-412a-985e-689262abf2e2 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:16.103350 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1002/2000] 10.222.0.117 () {58 vars in 1157 bytes} [Tue Jan 25 02:36:16 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:36:16.103935 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe3f3bc-26cb-4d16-b2e7-426a19304471 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:16.114552 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd08d183-d1ae-412a-985e-689262abf2e2 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:16.124238 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe3f3bc-26cb-4d16-b2e7-426a19304471 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:16.125541 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb59bce8-9cd9-4839-abda-9bcf46c62ad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:16.126586 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb59bce8-9cd9-4839-abda-9bcf46c62ad3 admin admin] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:16.126970 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb59bce8-9cd9-4839-abda-9bcf46c62ad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:16.127392 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb59bce8-9cd9-4839-abda-9bcf46c62ad3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:16.128345 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb59bce8-9cd9-4839-abda-9bcf46c62ad3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:16.129350 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff859fa-eb37-42a7-9718-f33a0a237258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:16.130016 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff859fa-eb37-42a7-9718-f33a0a237258 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:16.130301 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff859fa-eb37-42a7-9718-f33a0a237258 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:16.130717 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff859fa-eb37-42a7-9718-f33a0a237258 admin admin] PATH_INFO: `/v3/roles` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:16.131517 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb59bce8-9cd9-4839-abda-9bcf46c62ad3 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:16.132049 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff859fa-eb37-42a7-9718-f33a0a237258 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:16.133681 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff859fa-eb37-42a7-9718-f33a0a237258 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:16.145131 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1003/2001] 10.222.0.117 () {58 vars in 1126 bytes} [Tue Jan 25 02:36:16 2022] GET /identity/v3/roles => generated 1427 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 02:36:16.148879 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff859fa-eb37-42a7-9718-f33a0a237258 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:16.159372 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff859fa-eb37-42a7-9718-f33a0a237258 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:16.160220 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 999/2002] 10.222.0.117 () {60 vars in 1157 bytes} [Tue Jan 25 02:36:16 2022] POST /identity/v3/projects => generated 386 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 02:36:16.161609 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb59bce8-9cd9-4839-abda-9bcf46c62ad3 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:16.225154 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a44e4ca-c235-47ee-8352-579f201fa673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:16.226249 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a44e4ca-c235-47ee-8352-579f201fa673 admin admin] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:16.226662 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a44e4ca-c235-47ee-8352-579f201fa673 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:16.226907 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a44e4ca-c235-47ee-8352-579f201fa673 admin admin] PATH_INFO: `/v3/projects` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:16.227633 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a44e4ca-c235-47ee-8352-579f201fa673 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:16.229604 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a44e4ca-c235-47ee-8352-579f201fa673 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:16.241538 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb59bce8-9cd9-4839-abda-9bcf46c62ad3 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:16.246993 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72f7014-3cab-4041-97b3-b8c057671f24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:16.247755 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72f7014-3cab-4041-97b3-b8c057671f24 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:16.248052 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72f7014-3cab-4041-97b3-b8c057671f24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:16.248412 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72f7014-3cab-4041-97b3-b8c057671f24 admin admin] PATH_INFO: `/v3/roles` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:16.249192 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72f7014-3cab-4041-97b3-b8c057671f24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:16.250787 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72f7014-3cab-4041-97b3-b8c057671f24 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:16.257059 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1004/2003] 10.222.0.117 () {60 vars in 1157 bytes} [Tue Jan 25 02:36:16 2022] POST /identity/v3/projects => generated 382 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 02:36:16.268207 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a44e4ca-c235-47ee-8352-579f201fa673 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:16.268579 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1000/2004] 10.222.0.117 () {58 vars in 1126 bytes} [Tue Jan 25 02:36:16 2022] GET /identity/v3/roles => generated 1427 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 02:36:16.269230 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72f7014-3cab-4041-97b3-b8c057671f24 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:16.280715 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72f7014-3cab-4041-97b3-b8c057671f24 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:16.334875 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a44e4ca-c235-47ee-8352-579f201fa673 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:16.344102 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679d0966-f708-46f0-ac51-605f1a42c299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:16.344407 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c18bfea-9915-47d6-b637-4b2623f605ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:16.345185 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c18bfea-9915-47d6-b637-4b2623f605ae admin admin] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:16.345399 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c18bfea-9915-47d6-b637-4b2623f605ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:16.345609 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679d0966-f708-46f0-ac51-605f1a42c299 admin admin] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:16.345702 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c18bfea-9915-47d6-b637-4b2623f605ae admin admin] PATH_INFO: `/v3/users` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:16.346140 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679d0966-f708-46f0-ac51-605f1a42c299 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:16.346419 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c18bfea-9915-47d6-b637-4b2623f605ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:16.346598 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679d0966-f708-46f0-ac51-605f1a42c299 admin admin] PATH_INFO: `/v3/users` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:16.347452 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679d0966-f708-46f0-ac51-605f1a42c299 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:16.348543 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c18bfea-9915-47d6-b637-4b2623f605ae admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:16.350517 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679d0966-f708-46f0-ac51-605f1a42c299 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:16.371477 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1001/2005] 10.222.0.117 () {60 vars in 1148 bytes} [Tue Jan 25 02:36:16 2022] POST /identity/v3/users => generated 292 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 25 02:36:16.372331 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c18bfea-9915-47d6-b637-4b2623f605ae admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:16.375731 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1005/2006] 10.222.0.117 () {60 vars in 1148 bytes} [Tue Jan 25 02:36:16 2022] POST /identity/v3/users => generated 294 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 02:36:16.375997 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679d0966-f708-46f0-ac51-605f1a42c299 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:16.383208 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c18bfea-9915-47d6-b637-4b2623f605ae admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:16.387759 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679d0966-f708-46f0-ac51-605f1a42c299 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:16.388535 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e520c0-a382-4eef-baab-4f78efc011bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:16.389573 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e520c0-a382-4eef-baab-4f78efc011bb admin admin] REQUEST_METHOD: `PUT` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:16.389858 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e520c0-a382-4eef-baab-4f78efc011bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:16.390134 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e520c0-a382-4eef-baab-4f78efc011bb admin admin] PATH_INFO: `/v3/projects/30b744a70e484c3cafe97d69118bba09/users/307e4d027d88437c972fa1fee4d028aa/roles/33a8e87420ed423f9cb29e0084eab5d2` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:16.392742 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14db0ed-cd3e-4928-a59e-c519374645b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:16.393480 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14db0ed-cd3e-4928-a59e-c519374645b8 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:16.393769 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14db0ed-cd3e-4928-a59e-c519374645b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:16.394123 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14db0ed-cd3e-4928-a59e-c519374645b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:16.394878 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14db0ed-cd3e-4928-a59e-c519374645b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:16.396564 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14db0ed-cd3e-4928-a59e-c519374645b8 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:16.404950 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e520c0-a382-4eef-baab-4f78efc011bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=30b744a70e484c3cafe97d69118bba09, user_id=307e4d027d88437c972fa1fee4d028aa, role_id=33a8e87420ed423f9cb29e0084eab5d2)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:16.409594 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1006/2007] 10.222.0.117 () {58 vars in 1126 bytes} [Tue Jan 25 02:36:16 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 02:36:16.409594 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14db0ed-cd3e-4928-a59e-c519374645b8 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:16.409801 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e520c0-a382-4eef-baab-4f78efc011bb admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:16.418444 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14db0ed-cd3e-4928-a59e-c519374645b8 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:16.421362 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1002/2008] 10.222.0.117 () {60 vars in 1487 bytes} [Tue Jan 25 02:36:16 2022] PUT /identity/v3/projects/30b744a70e484c3cafe97d69118bba09/users/307e4d027d88437c972fa1fee4d028aa/roles/33a8e87420ed423f9cb29e0084eab5d2 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:36:16.422307 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e520c0-a382-4eef-baab-4f78efc011bb admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:16.484275 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097e7869-8cd7-4670-85d0-c727304875dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:16.485055 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097e7869-8cd7-4670-85d0-c727304875dc admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:16.485338 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097e7869-8cd7-4670-85d0-c727304875dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:16.485616 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097e7869-8cd7-4670-85d0-c727304875dc admin admin] PATH_INFO: `/v3/roles` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:16.486362 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097e7869-8cd7-4670-85d0-c727304875dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:16.488004 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097e7869-8cd7-4670-85d0-c727304875dc admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:16.488109 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e520c0-a382-4eef-baab-4f78efc011bb admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:16.499017 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a26bd3-6947-4b03-8b49-b35960e4ce3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:16.499808 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a26bd3-6947-4b03-8b49-b35960e4ce3e admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:16.500164 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a26bd3-6947-4b03-8b49-b35960e4ce3e admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:16.500321 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1007/2009] 10.222.0.117 () {58 vars in 1126 bytes} [Tue Jan 25 02:36:16 2022] GET /identity/v3/roles => generated 1427 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 02:36:16.501743 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71793eaa-f70d-4610-9bde-72c80369f0fa None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:16.502038 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71793eaa-f70d-4610-9bde-72c80369f0fa None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:16.502319 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71793eaa-f70d-4610-9bde-72c80369f0fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:16.503625 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a26bd3-6947-4b03-8b49-b35960e4ce3e admin admin] PATH_INFO: `/v3/roles` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:16.504471 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a26bd3-6947-4b03-8b49-b35960e4ce3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:16.506502 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a26bd3-6947-4b03-8b49-b35960e4ce3e admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:16.520135 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1003/2010] 10.222.0.117 () {58 vars in 1126 bytes} [Tue Jan 25 02:36:16 2022] GET /identity/v3/roles => generated 1427 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 02:36:16.520135 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a26bd3-6947-4b03-8b49-b35960e4ce3e admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:16.530777 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a26bd3-6947-4b03-8b49-b35960e4ce3e admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:16.531712 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-71793eaa-f70d-4610-9bde-72c80369f0fa None None] MFA Rules not processed for user `307e4d027d88437c972fa1fee4d028aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:36:16.532949 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-71793eaa-f70d-4610-9bde-72c80369f0fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:36:16.538457 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e519cf-01f2-4fd4-846c-81b4cb04d823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:16.539311 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e519cf-01f2-4fd4-846c-81b4cb04d823 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:16.539777 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e519cf-01f2-4fd4-846c-81b4cb04d823 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:16.540205 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e519cf-01f2-4fd4-846c-81b4cb04d823 admin admin] PATH_INFO: `/v3/roles` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:16.541114 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e519cf-01f2-4fd4-846c-81b4cb04d823 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:16.542853 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e519cf-01f2-4fd4-846c-81b4cb04d823 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:16.554460 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1004/2011] 10.222.0.117 () {58 vars in 1126 bytes} [Tue Jan 25 02:36:16 2022] GET /identity/v3/roles => generated 1427 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 02:36:16.555329 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e519cf-01f2-4fd4-846c-81b4cb04d823 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:16.565407 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e519cf-01f2-4fd4-846c-81b4cb04d823 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:16.570950 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116e1bc1-7a1e-4afd-ad1d-ae6aa28c6f93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:16.571996 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116e1bc1-7a1e-4afd-ad1d-ae6aa28c6f93 admin admin] REQUEST_METHOD: `PUT` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:16.572351 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116e1bc1-7a1e-4afd-ad1d-ae6aa28c6f93 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:16.572638 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116e1bc1-7a1e-4afd-ad1d-ae6aa28c6f93 admin admin] PATH_INFO: `/v3/projects/f8075d3b78024563acca678a7a829a69/users/4419eca8f1594eb39af58322d2e13604/roles/33a8e87420ed423f9cb29e0084eab5d2` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:16.592445 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116e1bc1-7a1e-4afd-ad1d-ae6aa28c6f93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8075d3b78024563acca678a7a829a69, user_id=4419eca8f1594eb39af58322d2e13604, role_id=33a8e87420ed423f9cb29e0084eab5d2)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:16.592445 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116e1bc1-7a1e-4afd-ad1d-ae6aa28c6f93 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:16.604392 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1005/2012] 10.222.0.117 () {60 vars in 1487 bytes} [Tue Jan 25 02:36:16 2022] PUT /identity/v3/projects/f8075d3b78024563acca678a7a829a69/users/4419eca8f1594eb39af58322d2e13604/roles/33a8e87420ed423f9cb29e0084eab5d2 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:36:16.605324 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116e1bc1-7a1e-4afd-ad1d-ae6aa28c6f93 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:16.616190 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1008/2013] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:36:16 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:36:16.617598 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06288043-0903-497e-9f3a-bb2aec103261 None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:16.617891 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06288043-0903-497e-9f3a-bb2aec103261 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:16.618170 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06288043-0903-497e-9f3a-bb2aec103261 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:16.645155 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-06288043-0903-497e-9f3a-bb2aec103261 None None] MFA Rules not processed for user `4419eca8f1594eb39af58322d2e13604`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:36:16.646971 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-06288043-0903-497e-9f3a-bb2aec103261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:36:16.671261 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116e1bc1-7a1e-4afd-ad1d-ae6aa28c6f93 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:16.675959 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588f1144-540b-452e-a205-ce61df75a123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:16.676855 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588f1144-540b-452e-a205-ce61df75a123 admin admin] REQUEST_METHOD: `PUT` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:16.677140 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588f1144-540b-452e-a205-ce61df75a123 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:16.678007 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588f1144-540b-452e-a205-ce61df75a123 admin admin] PATH_INFO: `/v3/projects/420e54880e0e49999ee0ca6050023575/users/4cd46fc7a1d84effa41ba0f8935fcf68/roles/33a8e87420ed423f9cb29e0084eab5d2` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:16.692611 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588f1144-540b-452e-a205-ce61df75a123 admin admin] RBAC: Authorizing `identity:create_grant(project_id=420e54880e0e49999ee0ca6050023575, user_id=4cd46fc7a1d84effa41ba0f8935fcf68, role_id=33a8e87420ed423f9cb29e0084eab5d2)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:16.696186 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588f1144-540b-452e-a205-ce61df75a123 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:16.711134 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1006/2014] 10.222.0.117 () {60 vars in 1487 bytes} [Tue Jan 25 02:36:16 2022] PUT /identity/v3/projects/420e54880e0e49999ee0ca6050023575/users/4cd46fc7a1d84effa41ba0f8935fcf68/roles/33a8e87420ed423f9cb29e0084eab5d2 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:36:16.712009 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588f1144-540b-452e-a205-ce61df75a123 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:16.722134 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1009/2015] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:36:16 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:36:16.723542 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258b970c-4e57-4786-b836-3ad6b936a28a None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:16.723878 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258b970c-4e57-4786-b836-3ad6b936a28a None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:16.724161 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258b970c-4e57-4786-b836-3ad6b936a28a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:16.741941 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-258b970c-4e57-4786-b836-3ad6b936a28a None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:36:16.743161 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-258b970c-4e57-4786-b836-3ad6b936a28a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:36:16.774836 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588f1144-540b-452e-a205-ce61df75a123 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:16.783137 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8de80f-4a79-4cd2-80e9-29692ee5df49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:16.783987 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8de80f-4a79-4cd2-80e9-29692ee5df49 admin admin] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:16.784905 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8de80f-4a79-4cd2-80e9-29692ee5df49 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:16.785192 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8de80f-4a79-4cd2-80e9-29692ee5df49 admin admin] PATH_INFO: `/v3/projects` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:16.785915 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8de80f-4a79-4cd2-80e9-29692ee5df49 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:16.788775 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8de80f-4a79-4cd2-80e9-29692ee5df49 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:16.810831 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1010/2016] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:36:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:36:16.811716 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258b970c-4e57-4786-b836-3ad6b936a28a None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:16.819558 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1007/2017] 10.222.0.117 () {60 vars in 1157 bytes} [Tue Jan 25 02:36:16 2022] POST /identity/v3/projects => generated 388 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 02:36:16.821985 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258b970c-4e57-4786-b836-3ad6b936a28a None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:16.823472 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8de80f-4a79-4cd2-80e9-29692ee5df49 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:16.825055 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-eb8de80f-4a79-4cd2-80e9-29692ee5df49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:36:16.887334 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8de80f-4a79-4cd2-80e9-29692ee5df49 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:16.891159 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7fab34-6c66-4ea7-a41e-e8b8d7569b6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca4071c5f8f4a31b5edb81fa66a43a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:16.891833 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7fab34-6c66-4ea7-a41e-e8b8d7569b6f service neutron] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:16.892285 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7fab34-6c66-4ea7-a41e-e8b8d7569b6f service neutron] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:16.892566 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7fab34-6c66-4ea7-a41e-e8b8d7569b6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:16.898118 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f44bbdb-9c74-458b-8938-ecacd505bb24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:16.898801 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f44bbdb-9c74-458b-8938-ecacd505bb24 admin admin] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:16.899085 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f44bbdb-9c74-458b-8938-ecacd505bb24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:16.899358 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f44bbdb-9c74-458b-8938-ecacd505bb24 admin admin] PATH_INFO: `/v3/projects` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:16.900290 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f44bbdb-9c74-458b-8938-ecacd505bb24 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:16.902221 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f44bbdb-9c74-458b-8938-ecacd505bb24 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:16.902727 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7fab34-6c66-4ea7-a41e-e8b8d7569b6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:16.904206 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7fab34-6c66-4ea7-a41e-e8b8d7569b6f service neutron] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:16.917444 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1008/2018] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:36:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:36:16.918265 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7fab34-6c66-4ea7-a41e-e8b8d7569b6f service neutron] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:16.928352 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7fab34-6c66-4ea7-a41e-e8b8d7569b6f service neutron] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:16.933300 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1011/2019] 10.222.0.117 () {60 vars in 1157 bytes} [Tue Jan 25 02:36:16 2022] POST /identity/v3/projects => generated 382 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 02:36:16.934359 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23250128-204a-49bf-a6d1-717ec9ba8553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:16.935054 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23250128-204a-49bf-a6d1-717ec9ba8553 admin admin] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:16.935325 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23250128-204a-49bf-a6d1-717ec9ba8553 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:16.935614 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23250128-204a-49bf-a6d1-717ec9ba8553 admin admin] PATH_INFO: `/v3/users` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:16.936513 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23250128-204a-49bf-a6d1-717ec9ba8553 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:16.938629 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23250128-204a-49bf-a6d1-717ec9ba8553 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:16.940212 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f44bbdb-9c74-458b-8938-ecacd505bb24 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:16.964241 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1009/2020] 10.222.0.117 () {60 vars in 1148 bytes} [Tue Jan 25 02:36:16 2022] POST /identity/v3/users => generated 301 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 02:36:16.967864 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23250128-204a-49bf-a6d1-717ec9ba8553 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:16.979031 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23250128-204a-49bf-a6d1-717ec9ba8553 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:17.017462 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f44bbdb-9c74-458b-8938-ecacd505bb24 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:17.024031 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4470d1da-7fbb-4ff5-9f08-a3f21a54acc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:17.024708 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4470d1da-7fbb-4ff5-9f08-a3f21a54acc8 admin admin] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:17.025045 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4470d1da-7fbb-4ff5-9f08-a3f21a54acc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:17.025260 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4470d1da-7fbb-4ff5-9f08-a3f21a54acc8 admin admin] PATH_INFO: `/v3/users` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:17.025969 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4470d1da-7fbb-4ff5-9f08-a3f21a54acc8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:17.027970 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4470d1da-7fbb-4ff5-9f08-a3f21a54acc8 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:17.055050 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba81ba4-a8fb-4981-a08b-d450d585b37e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:17.055050 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba81ba4-a8fb-4981-a08b-d450d585b37e admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:17.055050 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba81ba4-a8fb-4981-a08b-d450d585b37e admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:17.055050 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba81ba4-a8fb-4981-a08b-d450d585b37e admin admin] PATH_INFO: `/v3/roles` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:17.066485 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba81ba4-a8fb-4981-a08b-d450d585b37e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:17.070301 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba81ba4-a8fb-4981-a08b-d450d585b37e admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:17.075734 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1012/2021] 10.222.0.117 () {60 vars in 1148 bytes} [Tue Jan 25 02:36:16 2022] POST /identity/v3/users => generated 298 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 25 02:36:17.079186 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4470d1da-7fbb-4ff5-9f08-a3f21a54acc8 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:17.097622 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4470d1da-7fbb-4ff5-9f08-a3f21a54acc8 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:17.106581 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98e2282-78d3-4cb2-8332-8c6e16a0d86f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:17.107994 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98e2282-78d3-4cb2-8332-8c6e16a0d86f admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:17.108438 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98e2282-78d3-4cb2-8332-8c6e16a0d86f admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:17.108832 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98e2282-78d3-4cb2-8332-8c6e16a0d86f admin admin] PATH_INFO: `/v3/roles` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:17.110304 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98e2282-78d3-4cb2-8332-8c6e16a0d86f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:17.119964 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98e2282-78d3-4cb2-8332-8c6e16a0d86f admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:17.120094 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1010/2022] 10.222.0.117 () {58 vars in 1126 bytes} [Tue Jan 25 02:36:16 2022] GET /identity/v3/roles => generated 1427 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 02:36:17.120094 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba81ba4-a8fb-4981-a08b-d450d585b37e admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:17.137650 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1013/2023] 10.222.0.117 () {58 vars in 1126 bytes} [Tue Jan 25 02:36:17 2022] GET /identity/v3/roles => generated 1427 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 25 02:36:17.137912 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba81ba4-a8fb-4981-a08b-d450d585b37e admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:17.138770 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98e2282-78d3-4cb2-8332-8c6e16a0d86f admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:17.145286 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34435f2-cab1-4212-9c55-6bd1ca9b1f33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:17.146384 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34435f2-cab1-4212-9c55-6bd1ca9b1f33 admin admin] REQUEST_METHOD: `PUT` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:17.146765 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34435f2-cab1-4212-9c55-6bd1ca9b1f33 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:17.147189 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34435f2-cab1-4212-9c55-6bd1ca9b1f33 admin admin] PATH_INFO: `/v3/projects/df379a66bd814ec3a84d542478c2d8e8/users/726596beef63417bb03bcee5c2e989cc/roles/d8dbc6d83d9d41d28c3feb8b3485b291` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:17.151378 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98e2282-78d3-4cb2-8332-8c6e16a0d86f admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:17.157341 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae95a61-0ea7-4eb3-91a1-998bf613f711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:17.158798 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae95a61-0ea7-4eb3-91a1-998bf613f711 admin admin] REQUEST_METHOD: `PUT` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:17.159159 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae95a61-0ea7-4eb3-91a1-998bf613f711 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:17.159439 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae95a61-0ea7-4eb3-91a1-998bf613f711 admin admin] PATH_INFO: `/v3/projects/0c876718a336412f98534032f64a9513/users/9149f899f2ac43eca131896e20565b5e/roles/d8dbc6d83d9d41d28c3feb8b3485b291` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:17.174271 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34435f2-cab1-4212-9c55-6bd1ca9b1f33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df379a66bd814ec3a84d542478c2d8e8, user_id=726596beef63417bb03bcee5c2e989cc, role_id=d8dbc6d83d9d41d28c3feb8b3485b291)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:17.185341 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae95a61-0ea7-4eb3-91a1-998bf613f711 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c876718a336412f98534032f64a9513, user_id=9149f899f2ac43eca131896e20565b5e, role_id=d8dbc6d83d9d41d28c3feb8b3485b291)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:17.185707 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34435f2-cab1-4212-9c55-6bd1ca9b1f33 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:17.188935 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae95a61-0ea7-4eb3-91a1-998bf613f711 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:17.206558 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1011/2024] 10.222.0.117 () {60 vars in 1487 bytes} [Tue Jan 25 02:36:17 2022] PUT /identity/v3/projects/df379a66bd814ec3a84d542478c2d8e8/users/726596beef63417bb03bcee5c2e989cc/roles/d8dbc6d83d9d41d28c3feb8b3485b291 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:36:17.206910 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1014/2025] 10.222.0.117 () {60 vars in 1487 bytes} [Tue Jan 25 02:36:17 2022] PUT /identity/v3/projects/0c876718a336412f98534032f64a9513/users/9149f899f2ac43eca131896e20565b5e/roles/d8dbc6d83d9d41d28c3feb8b3485b291 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:36:17.212372 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae95a61-0ea7-4eb3-91a1-998bf613f711 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:17.213457 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34435f2-cab1-4212-9c55-6bd1ca9b1f33 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:17.306032 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae95a61-0ea7-4eb3-91a1-998bf613f711 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:17.312447 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac636159-d35c-4182-8686-7e487d7ca9f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:17.313047 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34435f2-cab1-4212-9c55-6bd1ca9b1f33 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:17.313162 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac636159-d35c-4182-8686-7e487d7ca9f0 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:17.313410 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac636159-d35c-4182-8686-7e487d7ca9f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:17.313696 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac636159-d35c-4182-8686-7e487d7ca9f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:17.315585 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac636159-d35c-4182-8686-7e487d7ca9f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:17.317246 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac636159-d35c-4182-8686-7e487d7ca9f0 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:17.319376 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbde3da-b1c3-44df-bd45-3f373cf2efc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:17.320157 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbde3da-b1c3-44df-bd45-3f373cf2efc1 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:17.320445 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbde3da-b1c3-44df-bd45-3f373cf2efc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:17.320811 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbde3da-b1c3-44df-bd45-3f373cf2efc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:17.321831 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbde3da-b1c3-44df-bd45-3f373cf2efc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:17.324264 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbde3da-b1c3-44df-bd45-3f373cf2efc1 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:17.339822 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1015/2026] 10.222.0.117 () {58 vars in 1126 bytes} [Tue Jan 25 02:36:17 2022] GET /identity/v3/roles => generated 1427 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 02:36:17.340928 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac636159-d35c-4182-8686-7e487d7ca9f0 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:17.349649 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1012/2027] 10.222.0.117 () {58 vars in 1126 bytes} [Tue Jan 25 02:36:17 2022] GET /identity/v3/roles => generated 1427 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 25 02:36:17.353704 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbde3da-b1c3-44df-bd45-3f373cf2efc1 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:17.357039 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac636159-d35c-4182-8686-7e487d7ca9f0 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:17.372471 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbde3da-b1c3-44df-bd45-3f373cf2efc1 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:17.373271 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae42c0ab-ff47-411f-8b4d-d16421592309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:17.374448 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae42c0ab-ff47-411f-8b4d-d16421592309 admin admin] REQUEST_METHOD: `PUT` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:17.375111 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae42c0ab-ff47-411f-8b4d-d16421592309 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:17.376184 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae42c0ab-ff47-411f-8b4d-d16421592309 admin admin] PATH_INFO: `/v3/projects/0c876718a336412f98534032f64a9513/users/9149f899f2ac43eca131896e20565b5e/roles/d8dbc6d83d9d41d28c3feb8b3485b291` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:17.377804 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ffeccd-4437-4981-84a0-3e6353cbaed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:17.378440 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae42c0ab-ff47-411f-8b4d-d16421592309 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c876718a336412f98534032f64a9513, user_id=9149f899f2ac43eca131896e20565b5e, role_id=d8dbc6d83d9d41d28c3feb8b3485b291)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:17.379221 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ffeccd-4437-4981-84a0-3e6353cbaed2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:17.379552 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ffeccd-4437-4981-84a0-3e6353cbaed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:17.379866 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ffeccd-4437-4981-84a0-3e6353cbaed2 admin admin] PATH_INFO: `/v3/projects/df379a66bd814ec3a84d542478c2d8e8/users/726596beef63417bb03bcee5c2e989cc/roles/d8dbc6d83d9d41d28c3feb8b3485b291` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:17.381498 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae42c0ab-ff47-411f-8b4d-d16421592309 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:17.382273 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ffeccd-4437-4981-84a0-3e6353cbaed2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df379a66bd814ec3a84d542478c2d8e8, user_id=726596beef63417bb03bcee5c2e989cc, role_id=d8dbc6d83d9d41d28c3feb8b3485b291)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:17.386156 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ffeccd-4437-4981-84a0-3e6353cbaed2 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:17.399562 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1016/2028] 10.222.0.117 () {60 vars in 1487 bytes} [Tue Jan 25 02:36:17 2022] PUT /identity/v3/projects/0c876718a336412f98534032f64a9513/users/9149f899f2ac43eca131896e20565b5e/roles/d8dbc6d83d9d41d28c3feb8b3485b291 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:36:17.410154 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191ffaa3-6250-4ee5-9621-a25fb7bb4a79 None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:17.410450 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191ffaa3-6250-4ee5-9621-a25fb7bb4a79 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:17.410734 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191ffaa3-6250-4ee5-9621-a25fb7bb4a79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:17.414796 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1013/2029] 10.222.0.117 () {60 vars in 1487 bytes} [Tue Jan 25 02:36:17 2022] PUT /identity/v3/projects/df379a66bd814ec3a84d542478c2d8e8/users/726596beef63417bb03bcee5c2e989cc/roles/d8dbc6d83d9d41d28c3feb8b3485b291 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:36:17.427351 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab97778-7a09-4cba-a576-820821bd095f None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:17.428182 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab97778-7a09-4cba-a576-820821bd095f None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:17.428460 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab97778-7a09-4cba-a576-820821bd095f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:17.441863 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-191ffaa3-6250-4ee5-9621-a25fb7bb4a79 None None] MFA Rules not processed for user `9149f899f2ac43eca131896e20565b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:36:17.444329 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-191ffaa3-6250-4ee5-9621-a25fb7bb4a79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:36:17.465527 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-9ab97778-7a09-4cba-a576-820821bd095f None None] MFA Rules not processed for user `726596beef63417bb03bcee5c2e989cc`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:36:17.467082 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-9ab97778-7a09-4cba-a576-820821bd095f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:36:17.533581 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1017/2030] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:36:17 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 25 02:36:17.540875 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191ffaa3-6250-4ee5-9621-a25fb7bb4a79 None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:17.542262 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-191ffaa3-6250-4ee5-9621-a25fb7bb4a79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:36:17.569026 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1014/2031] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:36:17 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:36:17.595046 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab97778-7a09-4cba-a576-820821bd095f None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:17.596955 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-9ab97778-7a09-4cba-a576-820821bd095f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:36:17.606339 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191ffaa3-6250-4ee5-9621-a25fb7bb4a79 None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:17.610296 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab97778-7a09-4cba-a576-820821bd095f None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:17.610472 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25c0cca-5103-4dbd-94ad-927316cf3bf8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cc5249aea09430080e232cf17757f86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:17.611181 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25c0cca-5103-4dbd-94ad-927316cf3bf8 service cinder] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:17.611541 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25c0cca-5103-4dbd-94ad-927316cf3bf8 service cinder] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:17.611846 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25c0cca-5103-4dbd-94ad-927316cf3bf8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:17.614606 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2d137f-f27a-4b60-8ae5-a1db92342d42 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cc5249aea09430080e232cf17757f86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:17.616006 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2d137f-f27a-4b60-8ae5-a1db92342d42 service cinder] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:17.616457 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2d137f-f27a-4b60-8ae5-a1db92342d42 service cinder] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:17.616874 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2d137f-f27a-4b60-8ae5-a1db92342d42 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:17.623068 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25c0cca-5103-4dbd-94ad-927316cf3bf8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:17.624829 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25c0cca-5103-4dbd-94ad-927316cf3bf8 service cinder] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:17.628151 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2d137f-f27a-4b60-8ae5-a1db92342d42 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:17.631124 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2d137f-f27a-4b60-8ae5-a1db92342d42 service cinder] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:17.637549 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1018/2032] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:36:17 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 25 02:36:17.640528 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1015/2033] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:36:17 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 25 02:36:17.678925 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25c0cca-5103-4dbd-94ad-927316cf3bf8 service cinder] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:17.759640 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25c0cca-5103-4dbd-94ad-927316cf3bf8 service cinder] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:17.767768 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17de1975-5d7a-402e-9604-923a75d39a02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:17.768817 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17de1975-5d7a-402e-9604-923a75d39a02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:17.769502 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17de1975-5d7a-402e-9604-923a75d39a02 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:17.771741 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17de1975-5d7a-402e-9604-923a75d39a02 admin admin] PATH_INFO: `/v3/users/307e4d027d88437c972fa1fee4d028aa` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:17.774314 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17de1975-5d7a-402e-9604-923a75d39a02 admin admin] RBAC: Authorizing `identity:delete_user(user_id=307e4d027d88437c972fa1fee4d028aa)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:17.778349 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17de1975-5d7a-402e-9604-923a75d39a02 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:17.842582 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-17de1975-5d7a-402e-9604-923a75d39a02 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '307e4d027d88437c972fa1fee4d028aa'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:17.843751 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-17de1975-5d7a-402e-9604-923a75d39a02 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '307e4d027d88437c972fa1fee4d028aa'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:17.856729 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-17de1975-5d7a-402e-9604-923a75d39a02 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '307e4d027d88437c972fa1fee4d028aa'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:17.858319 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-17de1975-5d7a-402e-9604-923a75d39a02 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '307e4d027d88437c972fa1fee4d028aa'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:17.872885 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-17de1975-5d7a-402e-9604-923a75d39a02 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '307e4d027d88437c972fa1fee4d028aa'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:17.915018 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1019/2034] 10.222.0.117 () {58 vars in 1228 bytes} [Tue Jan 25 02:36:17 2022] DELETE /identity/v3/users/307e4d027d88437c972fa1fee4d028aa => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:36:17.919970 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814afdf4-a092-484f-9987-4f42d602f9d6 None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:17.920435 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814afdf4-a092-484f-9987-4f42d602f9d6 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:17.920793 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814afdf4-a092-484f-9987-4f42d602f9d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:17.942255 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-814afdf4-a092-484f-9987-4f42d602f9d6 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:36:17.944233 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-814afdf4-a092-484f-9987-4f42d602f9d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:36:18.028712 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1016/2035] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:36:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:36:18.036316 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17de1975-5d7a-402e-9604-923a75d39a02 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:18.038997 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-17de1975-5d7a-402e-9604-923a75d39a02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:36:18.140096 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17de1975-5d7a-402e-9604-923a75d39a02 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:18.146945 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde7d1af-4127-48b4-a815-2fa7be968ea7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca4071c5f8f4a31b5edb81fa66a43a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:18.148116 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde7d1af-4127-48b4-a815-2fa7be968ea7 service neutron] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:18.148594 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde7d1af-4127-48b4-a815-2fa7be968ea7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:18.148991 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde7d1af-4127-48b4-a815-2fa7be968ea7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:18.169739 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde7d1af-4127-48b4-a815-2fa7be968ea7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:18.171356 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde7d1af-4127-48b4-a815-2fa7be968ea7 service neutron] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:18.186801 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1020/2036] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:36:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:36:18.265411 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814afdf4-a092-484f-9987-4f42d602f9d6 None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:18.270762 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-814afdf4-a092-484f-9987-4f42d602f9d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:36:18.286791 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814afdf4-a092-484f-9987-4f42d602f9d6 None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:18.292983 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afe1c33-7575-438d-a10b-2768d31bcc43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:18.294119 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afe1c33-7575-438d-a10b-2768d31bcc43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:18.294477 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afe1c33-7575-438d-a10b-2768d31bcc43 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:18.294894 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afe1c33-7575-438d-a10b-2768d31bcc43 admin admin] PATH_INFO: `/v3/users/4419eca8f1594eb39af58322d2e13604` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:18.296374 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afe1c33-7575-438d-a10b-2768d31bcc43 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4419eca8f1594eb39af58322d2e13604)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:18.298803 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afe1c33-7575-438d-a10b-2768d31bcc43 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:18.398392 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-8afe1c33-7575-438d-a10b-2768d31bcc43 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4419eca8f1594eb39af58322d2e13604'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:18.423926 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-8afe1c33-7575-438d-a10b-2768d31bcc43 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4419eca8f1594eb39af58322d2e13604'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:18.425225 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-8afe1c33-7575-438d-a10b-2768d31bcc43 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4419eca8f1594eb39af58322d2e13604'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:18.426926 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-8afe1c33-7575-438d-a10b-2768d31bcc43 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4419eca8f1594eb39af58322d2e13604'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:18.477542 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-8afe1c33-7575-438d-a10b-2768d31bcc43 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4419eca8f1594eb39af58322d2e13604'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:18.493843 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1017/2037] 10.222.0.117 () {58 vars in 1228 bytes} [Tue Jan 25 02:36:18 2022] DELETE /identity/v3/users/4419eca8f1594eb39af58322d2e13604 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:36:18.498465 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1432fd8-fbab-4101-95d1-84b7694a2e60 None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:18.498762 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1432fd8-fbab-4101-95d1-84b7694a2e60 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:18.499046 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1432fd8-fbab-4101-95d1-84b7694a2e60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:18.523722 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-e1432fd8-fbab-4101-95d1-84b7694a2e60 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:36:18.525464 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-e1432fd8-fbab-4101-95d1-84b7694a2e60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:36:18.616846 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1021/2038] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:36:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 25 02:36:18.634811 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afe1c33-7575-438d-a10b-2768d31bcc43 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:18.637693 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-8afe1c33-7575-438d-a10b-2768d31bcc43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:36:18.735048 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afe1c33-7575-438d-a10b-2768d31bcc43 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:18.740054 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4645439-fe55-407d-a79b-01b0b1a07af2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca4071c5f8f4a31b5edb81fa66a43a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:18.741405 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4645439-fe55-407d-a79b-01b0b1a07af2 service neutron] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:18.742145 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4645439-fe55-407d-a79b-01b0b1a07af2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:18.742733 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4645439-fe55-407d-a79b-01b0b1a07af2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:18.758027 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4645439-fe55-407d-a79b-01b0b1a07af2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:18.760077 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4645439-fe55-407d-a79b-01b0b1a07af2 service neutron] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:18.773282 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1018/2039] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:36:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:36:18.878912 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1432fd8-fbab-4101-95d1-84b7694a2e60 None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:18.880840 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-e1432fd8-fbab-4101-95d1-84b7694a2e60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:36:18.895608 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1432fd8-fbab-4101-95d1-84b7694a2e60 None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:18.901196 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130c806d-b6ab-413e-85e7-72de36f13df4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:18.902105 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130c806d-b6ab-413e-85e7-72de36f13df4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:18.902386 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130c806d-b6ab-413e-85e7-72de36f13df4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:18.902669 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130c806d-b6ab-413e-85e7-72de36f13df4 admin admin] PATH_INFO: `/v3/projects/30b744a70e484c3cafe97d69118bba09` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:18.903960 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130c806d-b6ab-413e-85e7-72de36f13df4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=30b744a70e484c3cafe97d69118bba09)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:18.905931 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130c806d-b6ab-413e-85e7-72de36f13df4 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:18.973722 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-130c806d-b6ab-413e-85e7-72de36f13df4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30b744a70e484c3cafe97d69118bba09', 'request_id': 'req-130c806d-b6ab-413e-85e7-72de36f13df4'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:18.981991 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-130c806d-b6ab-413e-85e7-72de36f13df4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30b744a70e484c3cafe97d69118bba09', 'request_id': 'req-130c806d-b6ab-413e-85e7-72de36f13df4'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:18.994179 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-130c806d-b6ab-413e-85e7-72de36f13df4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30b744a70e484c3cafe97d69118bba09', 'request_id': 'req-130c806d-b6ab-413e-85e7-72de36f13df4'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:19.027962 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-130c806d-b6ab-413e-85e7-72de36f13df4 admin admin] The token cache is being invalidate because project 30b744a70e484c3cafe97d69118bba09 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79121) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 25 02:36:19.031601 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-130c806d-b6ab-413e-85e7-72de36f13df4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:19.032680 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-130c806d-b6ab-413e-85e7-72de36f13df4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:19.042459 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1022/2040] 10.222.0.117 () {58 vars in 1237 bytes} [Tue Jan 25 02:36:18 2022] DELETE /identity/v3/projects/30b744a70e484c3cafe97d69118bba09 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:36:19.046802 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4645439-fe55-407d-a79b-01b0b1a07af2 service neutron] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:19.057358 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4645439-fe55-407d-a79b-01b0b1a07af2 service neutron] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:19.190881 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2a799a-9d7e-41b2-807a-ba37c8d24b8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:19.192124 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2a799a-9d7e-41b2-807a-ba37c8d24b8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:19.192421 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2a799a-9d7e-41b2-807a-ba37c8d24b8d admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:19.192699 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2a799a-9d7e-41b2-807a-ba37c8d24b8d admin admin] PATH_INFO: `/v3/users/726596beef63417bb03bcee5c2e989cc` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:19.194622 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2a799a-9d7e-41b2-807a-ba37c8d24b8d admin admin] RBAC: Authorizing `identity:delete_user(user_id=726596beef63417bb03bcee5c2e989cc)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:19.201047 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2a799a-9d7e-41b2-807a-ba37c8d24b8d admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:19.289415 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-bd2a799a-9d7e-41b2-807a-ba37c8d24b8d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '726596beef63417bb03bcee5c2e989cc'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:19.301083 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-bd2a799a-9d7e-41b2-807a-ba37c8d24b8d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '726596beef63417bb03bcee5c2e989cc'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:19.304456 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-bd2a799a-9d7e-41b2-807a-ba37c8d24b8d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '726596beef63417bb03bcee5c2e989cc'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:19.305424 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-bd2a799a-9d7e-41b2-807a-ba37c8d24b8d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '726596beef63417bb03bcee5c2e989cc'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:19.330411 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-bd2a799a-9d7e-41b2-807a-ba37c8d24b8d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '726596beef63417bb03bcee5c2e989cc'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:19.348353 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1019/2041] 10.222.0.117 () {58 vars in 1228 bytes} [Tue Jan 25 02:36:19 2022] DELETE /identity/v3/users/726596beef63417bb03bcee5c2e989cc => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:36:19.453814 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130c806d-b6ab-413e-85e7-72de36f13df4 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:19.455325 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-130c806d-b6ab-413e-85e7-72de36f13df4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:36:19.473958 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130c806d-b6ab-413e-85e7-72de36f13df4 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:19.581384 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0c6225-58a2-4b47-8a16-d630a9ef3ef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:19.584937 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0c6225-58a2-4b47-8a16-d630a9ef3ef8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:19.584937 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0c6225-58a2-4b47-8a16-d630a9ef3ef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:19.585992 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0c6225-58a2-4b47-8a16-d630a9ef3ef8 admin admin] PATH_INFO: `/v3/projects/f8075d3b78024563acca678a7a829a69` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:19.594526 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0c6225-58a2-4b47-8a16-d630a9ef3ef8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8075d3b78024563acca678a7a829a69)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:19.597615 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0c6225-58a2-4b47-8a16-d630a9ef3ef8 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:19.710393 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-ea0c6225-58a2-4b47-8a16-d630a9ef3ef8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8075d3b78024563acca678a7a829a69', 'request_id': 'req-ea0c6225-58a2-4b47-8a16-d630a9ef3ef8'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:19.722439 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-ea0c6225-58a2-4b47-8a16-d630a9ef3ef8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8075d3b78024563acca678a7a829a69', 'request_id': 'req-ea0c6225-58a2-4b47-8a16-d630a9ef3ef8'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:19.741627 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-ea0c6225-58a2-4b47-8a16-d630a9ef3ef8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8075d3b78024563acca678a7a829a69', 'request_id': 'req-ea0c6225-58a2-4b47-8a16-d630a9ef3ef8'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:19.757837 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-ea0c6225-58a2-4b47-8a16-d630a9ef3ef8 admin admin] The token cache is being invalidate because project f8075d3b78024563acca678a7a829a69 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79121) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 25 02:36:19.758272 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-ea0c6225-58a2-4b47-8a16-d630a9ef3ef8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:19.759044 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-ea0c6225-58a2-4b47-8a16-d630a9ef3ef8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:19.762720 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1023/2042] 10.222.0.117 () {58 vars in 1237 bytes} [Tue Jan 25 02:36:19 2022] DELETE /identity/v3/projects/f8075d3b78024563acca678a7a829a69 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:36:19.766586 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2a799a-9d7e-41b2-807a-ba37c8d24b8d admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:19.768056 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-bd2a799a-9d7e-41b2-807a-ba37c8d24b8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:36:19.804317 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2a799a-9d7e-41b2-807a-ba37c8d24b8d admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:19.852730 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0c6225-58a2-4b47-8a16-d630a9ef3ef8 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:19.854636 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-ea0c6225-58a2-4b47-8a16-d630a9ef3ef8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:36:19.885677 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152b761a-761f-4d81-9ca6-dd71d48e3cd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:19.886768 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152b761a-761f-4d81-9ca6-dd71d48e3cd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:19.887126 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152b761a-761f-4d81-9ca6-dd71d48e3cd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:19.887475 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152b761a-761f-4d81-9ca6-dd71d48e3cd2 admin admin] PATH_INFO: `/v3/users/9149f899f2ac43eca131896e20565b5e` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:19.890314 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152b761a-761f-4d81-9ca6-dd71d48e3cd2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9149f899f2ac43eca131896e20565b5e)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:19.892795 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152b761a-761f-4d81-9ca6-dd71d48e3cd2 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:19.973764 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0c6225-58a2-4b47-8a16-d630a9ef3ef8 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:19.980429 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-152b761a-761f-4d81-9ca6-dd71d48e3cd2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9149f899f2ac43eca131896e20565b5e'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:19.994691 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-152b761a-761f-4d81-9ca6-dd71d48e3cd2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9149f899f2ac43eca131896e20565b5e'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:19.997639 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021199da-fa6e-4a53-897b-24ced2d562be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:19.998541 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021199da-fa6e-4a53-897b-24ced2d562be admin admin] REQUEST_METHOD: `DELETE` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:19.998828 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021199da-fa6e-4a53-897b-24ced2d562be admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:19.999108 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021199da-fa6e-4a53-897b-24ced2d562be admin admin] PATH_INFO: `/v3/projects/df379a66bd814ec3a84d542478c2d8e8` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:20.004186 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021199da-fa6e-4a53-897b-24ced2d562be admin admin] RBAC: Authorizing `identity:delete_project(project_id=df379a66bd814ec3a84d542478c2d8e8)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:20.005059 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-152b761a-761f-4d81-9ca6-dd71d48e3cd2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9149f899f2ac43eca131896e20565b5e'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:20.006650 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-152b761a-761f-4d81-9ca6-dd71d48e3cd2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9149f899f2ac43eca131896e20565b5e'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:20.010734 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021199da-fa6e-4a53-897b-24ced2d562be admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:20.022716 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-152b761a-761f-4d81-9ca6-dd71d48e3cd2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9149f899f2ac43eca131896e20565b5e'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:20.038032 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1020/2043] 10.222.0.117 () {58 vars in 1228 bytes} [Tue Jan 25 02:36:19 2022] DELETE /identity/v3/users/9149f899f2ac43eca131896e20565b5e => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:36:20.068925 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-021199da-fa6e-4a53-897b-24ced2d562be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df379a66bd814ec3a84d542478c2d8e8', 'request_id': 'req-021199da-fa6e-4a53-897b-24ced2d562be'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:20.075199 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-021199da-fa6e-4a53-897b-24ced2d562be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df379a66bd814ec3a84d542478c2d8e8', 'request_id': 'req-021199da-fa6e-4a53-897b-24ced2d562be'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:20.087509 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-021199da-fa6e-4a53-897b-24ced2d562be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df379a66bd814ec3a84d542478c2d8e8', 'request_id': 'req-021199da-fa6e-4a53-897b-24ced2d562be'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:20.103729 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-021199da-fa6e-4a53-897b-24ced2d562be admin admin] The token cache is being invalidate because project df379a66bd814ec3a84d542478c2d8e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79121) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 25 02:36:20.104368 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-021199da-fa6e-4a53-897b-24ced2d562be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:20.105225 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-021199da-fa6e-4a53-897b-24ced2d562be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:20.107470 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1024/2044] 10.222.0.117 () {58 vars in 1237 bytes} [Tue Jan 25 02:36:19 2022] DELETE /identity/v3/projects/df379a66bd814ec3a84d542478c2d8e8 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:36:20.113860 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56bdbbb-53bb-4687-b7d5-706a5eb1360a None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:20.115029 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56bdbbb-53bb-4687-b7d5-706a5eb1360a None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:20.115794 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56bdbbb-53bb-4687-b7d5-706a5eb1360a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:20.138284 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-b56bdbbb-53bb-4687-b7d5-706a5eb1360a None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:36:20.140237 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-b56bdbbb-53bb-4687-b7d5-706a5eb1360a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:36:20.265869 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4551a0c-8c0e-403e-a7bd-bff2bf6a9a4e None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:20.266616 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4551a0c-8c0e-403e-a7bd-bff2bf6a9a4e None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:20.267118 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4551a0c-8c0e-403e-a7bd-bff2bf6a9a4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:20.271207 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1021/2045] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:36:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 25 02:36:20.293432 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-e4551a0c-8c0e-403e-a7bd-bff2bf6a9a4e None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:36:20.295147 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-e4551a0c-8c0e-403e-a7bd-bff2bf6a9a4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:36:20.308677 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1025/2046] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:36:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:36:20.313731 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56bdbbb-53bb-4687-b7d5-706a5eb1360a None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:20.326140 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56bdbbb-53bb-4687-b7d5-706a5eb1360a None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:20.331432 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f044c0a-1eb7-444f-a21b-9bf19b66f485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:20.334929 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f044c0a-1eb7-444f-a21b-9bf19b66f485 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:20.335682 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f044c0a-1eb7-444f-a21b-9bf19b66f485 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:20.336494 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f044c0a-1eb7-444f-a21b-9bf19b66f485 admin admin] PATH_INFO: `/v3/domains` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:20.336952 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f044c0a-1eb7-444f-a21b-9bf19b66f485 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:36:20.337323 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f044c0a-1eb7-444f-a21b-9bf19b66f485 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:20.339022 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f044c0a-1eb7-444f-a21b-9bf19b66f485 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:20.357882 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4551a0c-8c0e-403e-a7bd-bff2bf6a9a4e None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:20.371289 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1022/2047] 10.222.0.117 () {58 vars in 1157 bytes} [Tue Jan 25 02:36:20 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:36:20.372086 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4551a0c-8c0e-403e-a7bd-bff2bf6a9a4e None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:20.378163 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75af455d-71ea-4a80-80db-6915f087cab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:20.379478 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75af455d-71ea-4a80-80db-6915f087cab7 admin admin] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:20.379869 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75af455d-71ea-4a80-80db-6915f087cab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:20.381417 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75af455d-71ea-4a80-80db-6915f087cab7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:20.382397 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75af455d-71ea-4a80-80db-6915f087cab7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:20.384636 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75af455d-71ea-4a80-80db-6915f087cab7 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:20.426102 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1026/2048] 10.222.0.117 () {60 vars in 1157 bytes} [Tue Jan 25 02:36:20 2022] POST /identity/v3/projects => generated 388 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 02:36:20.430358 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f044c0a-1eb7-444f-a21b-9bf19b66f485 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:20.444939 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f044c0a-1eb7-444f-a21b-9bf19b66f485 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:20.495350 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75af455d-71ea-4a80-80db-6915f087cab7 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:20.497264 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-75af455d-71ea-4a80-80db-6915f087cab7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:36:20.565575 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0856a2ac-4313-4069-a438-45ef949c6a5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:20.566266 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0856a2ac-4313-4069-a438-45ef949c6a5b admin admin] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:20.566554 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0856a2ac-4313-4069-a438-45ef949c6a5b admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:20.566834 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0856a2ac-4313-4069-a438-45ef949c6a5b admin admin] PATH_INFO: `/v3/users` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:20.567779 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0856a2ac-4313-4069-a438-45ef949c6a5b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:20.570319 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0856a2ac-4313-4069-a438-45ef949c6a5b admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:20.622287 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1023/2049] 10.222.0.117 () {60 vars in 1148 bytes} [Tue Jan 25 02:36:20 2022] POST /identity/v3/users => generated 295 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 02:36:20.626606 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0856a2ac-4313-4069-a438-45ef949c6a5b admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:20.626787 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75af455d-71ea-4a80-80db-6915f087cab7 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:20.639824 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0856a2ac-4313-4069-a438-45ef949c6a5b admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:20.642748 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064d99b0-415d-4c9f-90ee-bf8d2c8d44f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:20.643925 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064d99b0-415d-4c9f-90ee-bf8d2c8d44f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:20.644651 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064d99b0-415d-4c9f-90ee-bf8d2c8d44f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:20.645312 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064d99b0-415d-4c9f-90ee-bf8d2c8d44f1 admin admin] PATH_INFO: `/v3/projects/0c876718a336412f98534032f64a9513` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:20.648169 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064d99b0-415d-4c9f-90ee-bf8d2c8d44f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c876718a336412f98534032f64a9513)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:20.650446 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064d99b0-415d-4c9f-90ee-bf8d2c8d44f1 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:20.652234 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e149a003-9e71-4a60-9555-802e3a75bd8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:20.653038 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e149a003-9e71-4a60-9555-802e3a75bd8b admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:20.653354 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e149a003-9e71-4a60-9555-802e3a75bd8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:20.653581 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e149a003-9e71-4a60-9555-802e3a75bd8b admin admin] PATH_INFO: `/v3/roles` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:20.654418 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e149a003-9e71-4a60-9555-802e3a75bd8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:20.656321 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e149a003-9e71-4a60-9555-802e3a75bd8b admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:20.682370 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1024/2050] 10.222.0.117 () {58 vars in 1126 bytes} [Tue Jan 25 02:36:20 2022] GET /identity/v3/roles => generated 1427 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 25 02:36:20.683581 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e149a003-9e71-4a60-9555-802e3a75bd8b admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:20.696920 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e149a003-9e71-4a60-9555-802e3a75bd8b admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:20.702193 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3791acb6-db44-4325-a8cb-1136d01b7b2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:20.703034 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3791acb6-db44-4325-a8cb-1136d01b7b2c admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:20.703317 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3791acb6-db44-4325-a8cb-1136d01b7b2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:20.703593 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3791acb6-db44-4325-a8cb-1136d01b7b2c admin admin] PATH_INFO: `/v3/roles` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:20.704375 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3791acb6-db44-4325-a8cb-1136d01b7b2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:20.705988 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3791acb6-db44-4325-a8cb-1136d01b7b2c admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:20.725801 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1025/2051] 10.222.0.117 () {58 vars in 1126 bytes} [Tue Jan 25 02:36:20 2022] GET /identity/v3/roles => generated 1427 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 02:36:20.730060 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3791acb6-db44-4325-a8cb-1136d01b7b2c admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:20.730426 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-064d99b0-415d-4c9f-90ee-bf8d2c8d44f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c876718a336412f98534032f64a9513', 'request_id': 'req-064d99b0-415d-4c9f-90ee-bf8d2c8d44f1'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:20.736619 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-064d99b0-415d-4c9f-90ee-bf8d2c8d44f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c876718a336412f98534032f64a9513', 'request_id': 'req-064d99b0-415d-4c9f-90ee-bf8d2c8d44f1'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:20.744365 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3791acb6-db44-4325-a8cb-1136d01b7b2c admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:20.746347 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-064d99b0-415d-4c9f-90ee-bf8d2c8d44f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c876718a336412f98534032f64a9513', 'request_id': 'req-064d99b0-415d-4c9f-90ee-bf8d2c8d44f1'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:20.764690 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-064d99b0-415d-4c9f-90ee-bf8d2c8d44f1 admin admin] The token cache is being invalidate because project 0c876718a336412f98534032f64a9513 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79121) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 25 02:36:20.765046 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-064d99b0-415d-4c9f-90ee-bf8d2c8d44f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:20.768125 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-064d99b0-415d-4c9f-90ee-bf8d2c8d44f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:20.772834 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1027/2052] 10.222.0.117 () {58 vars in 1237 bytes} [Tue Jan 25 02:36:20 2022] DELETE /identity/v3/projects/0c876718a336412f98534032f64a9513 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:36:20.778432 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0fbd4b-3736-4f72-a9a4-fe61023bb661 None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:20.778972 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0fbd4b-3736-4f72-a9a4-fe61023bb661 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:20.779756 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0fbd4b-3736-4f72-a9a4-fe61023bb661 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:20.809120 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-fc0fbd4b-3736-4f72-a9a4-fe61023bb661 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:36:20.815454 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-fc0fbd4b-3736-4f72-a9a4-fe61023bb661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:36:20.824269 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d9ccaf-6cc3-41c9-bc13-16c479a177e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:20.825224 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d9ccaf-6cc3-41c9-bc13-16c479a177e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:20.826187 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d9ccaf-6cc3-41c9-bc13-16c479a177e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:20.826474 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d9ccaf-6cc3-41c9-bc13-16c479a177e8 admin admin] PATH_INFO: `/v3/projects/e9ce293c57cf4af6b990811fd5e9401b/users/cb05f82caecc436cb3dce351523bcc9d/roles/33a8e87420ed423f9cb29e0084eab5d2` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:20.841157 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1028/2053] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:36:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:36:20.848886 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34374b00-735f-4d8f-8589-a3f61110878b None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:20.849575 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34374b00-735f-4d8f-8589-a3f61110878b None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:20.849875 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34374b00-735f-4d8f-8589-a3f61110878b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:20.862690 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d9ccaf-6cc3-41c9-bc13-16c479a177e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9ce293c57cf4af6b990811fd5e9401b, user_id=cb05f82caecc436cb3dce351523bcc9d, role_id=33a8e87420ed423f9cb29e0084eab5d2)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:20.866711 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d9ccaf-6cc3-41c9-bc13-16c479a177e8 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:20.892955 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-34374b00-735f-4d8f-8589-a3f61110878b None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:36:20.895490 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-34374b00-735f-4d8f-8589-a3f61110878b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:36:20.918548 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1026/2054] 10.222.0.117 () {60 vars in 1487 bytes} [Tue Jan 25 02:36:20 2022] PUT /identity/v3/projects/e9ce293c57cf4af6b990811fd5e9401b/users/cb05f82caecc436cb3dce351523bcc9d/roles/33a8e87420ed423f9cb29e0084eab5d2 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:36:20.920138 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b1bcc5-78bd-4707-b1c0-598571a901b7 None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:20.920426 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b1bcc5-78bd-4707-b1c0-598571a901b7 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:20.920702 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b1bcc5-78bd-4707-b1c0-598571a901b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:20.970086 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-98b1bcc5-78bd-4707-b1c0-598571a901b7 None None] MFA Rules not processed for user `cb05f82caecc436cb3dce351523bcc9d`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:36:20.971307 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-98b1bcc5-78bd-4707-b1c0-598571a901b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:36:21.013284 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1029/2055] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:36:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:36:21.020016 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34374b00-735f-4d8f-8589-a3f61110878b None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:21.049645 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34374b00-735f-4d8f-8589-a3f61110878b None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:21.067547 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4e9345-0162-4013-8d10-f531b1ae2c01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:21.068631 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4e9345-0162-4013-8d10-f531b1ae2c01 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:21.069320 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4e9345-0162-4013-8d10-f531b1ae2c01 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:21.069793 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4e9345-0162-4013-8d10-f531b1ae2c01 admin admin] PATH_INFO: `/v3/domains` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:21.077403 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4e9345-0162-4013-8d10-f531b1ae2c01 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:36:21.078119 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4e9345-0162-4013-8d10-f531b1ae2c01 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:21.080033 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4e9345-0162-4013-8d10-f531b1ae2c01 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:21.109064 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1030/2056] 10.222.0.117 () {58 vars in 1157 bytes} [Tue Jan 25 02:36:21 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:36:21.110149 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4e9345-0162-4013-8d10-f531b1ae2c01 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:21.125625 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4e9345-0162-4013-8d10-f531b1ae2c01 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:21.128213 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1027/2057] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:36:20 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:36:21.132294 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1c61eb-ca52-46c6-947b-18f1a49d98ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:21.133329 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1c61eb-ca52-46c6-947b-18f1a49d98ab admin admin] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:21.133566 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1c61eb-ca52-46c6-947b-18f1a49d98ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:21.133948 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1c61eb-ca52-46c6-947b-18f1a49d98ab admin admin] PATH_INFO: `/v3/projects` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:21.135479 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1c61eb-ca52-46c6-947b-18f1a49d98ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:21.137801 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b1bcc5-78bd-4707-b1c0-598571a901b7 None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:21.139419 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1c61eb-ca52-46c6-947b-18f1a49d98ab admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:21.142209 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-98b1bcc5-78bd-4707-b1c0-598571a901b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:36:21.169864 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b1bcc5-78bd-4707-b1c0-598571a901b7 None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:21.176837 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ddcc27-2f69-4870-ab22-78c091550a84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:21.177831 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ddcc27-2f69-4870-ab22-78c091550a84 admin admin] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:21.178221 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ddcc27-2f69-4870-ab22-78c091550a84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:21.178506 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ddcc27-2f69-4870-ab22-78c091550a84 admin admin] PATH_INFO: `/v3/projects` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:21.179231 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ddcc27-2f69-4870-ab22-78c091550a84 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:21.181318 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ddcc27-2f69-4870-ab22-78c091550a84 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:21.187815 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1031/2058] 10.222.0.117 () {60 vars in 1157 bytes} [Tue Jan 25 02:36:21 2022] POST /identity/v3/projects => generated 378 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 02:36:21.188603 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1c61eb-ca52-46c6-947b-18f1a49d98ab admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:21.232440 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1028/2059] 10.222.0.117 () {60 vars in 1157 bytes} [Tue Jan 25 02:36:21 2022] POST /identity/v3/projects => generated 388 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 02:36:21.234362 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ddcc27-2f69-4870-ab22-78c091550a84 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:21.294023 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1c61eb-ca52-46c6-947b-18f1a49d98ab admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:21.353351 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ddcc27-2f69-4870-ab22-78c091550a84 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:21.366846 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee52b07-e455-4a87-9182-85433f3cfb81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:21.367646 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee52b07-e455-4a87-9182-85433f3cfb81 admin admin] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:21.367952 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee52b07-e455-4a87-9182-85433f3cfb81 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:21.368228 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee52b07-e455-4a87-9182-85433f3cfb81 admin admin] PATH_INFO: `/v3/users` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:21.368945 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee52b07-e455-4a87-9182-85433f3cfb81 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:21.371629 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee52b07-e455-4a87-9182-85433f3cfb81 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:21.404380 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1029/2060] 10.222.0.117 () {60 vars in 1148 bytes} [Tue Jan 25 02:36:21 2022] POST /identity/v3/users => generated 301 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 25 02:36:21.405591 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee52b07-e455-4a87-9182-85433f3cfb81 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:21.425219 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee52b07-e455-4a87-9182-85433f3cfb81 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:21.428424 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b0f563-a656-4be1-b9e0-a6f87e3cfb35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:21.430256 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b0f563-a656-4be1-b9e0-a6f87e3cfb35 admin admin] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:21.430754 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b0f563-a656-4be1-b9e0-a6f87e3cfb35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:21.431357 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b0f563-a656-4be1-b9e0-a6f87e3cfb35 admin admin] PATH_INFO: `/v3/users` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:21.432825 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b0f563-a656-4be1-b9e0-a6f87e3cfb35 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:21.436903 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b0f563-a656-4be1-b9e0-a6f87e3cfb35 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:21.440894 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50ad41f-87ce-4b68-a07b-e8c582e17bea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:21.441578 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50ad41f-87ce-4b68-a07b-e8c582e17bea admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:21.441864 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50ad41f-87ce-4b68-a07b-e8c582e17bea admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:21.442143 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50ad41f-87ce-4b68-a07b-e8c582e17bea admin admin] PATH_INFO: `/v3/roles` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:21.443468 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50ad41f-87ce-4b68-a07b-e8c582e17bea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:21.445131 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50ad41f-87ce-4b68-a07b-e8c582e17bea admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:21.462937 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1030/2061] 10.222.0.117 () {58 vars in 1126 bytes} [Tue Jan 25 02:36:21 2022] GET /identity/v3/roles => generated 1427 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 25 02:36:21.467208 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50ad41f-87ce-4b68-a07b-e8c582e17bea admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:21.495842 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50ad41f-87ce-4b68-a07b-e8c582e17bea admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:21.499740 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1032/2062] 10.222.0.117 () {60 vars in 1148 bytes} [Tue Jan 25 02:36:21 2022] POST /identity/v3/users => generated 290 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 02:36:21.501606 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bbe341-9a8b-485d-b587-792ce08e914c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:21.502494 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b0f563-a656-4be1-b9e0-a6f87e3cfb35 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:21.503050 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bbe341-9a8b-485d-b587-792ce08e914c admin admin] REQUEST_METHOD: `PUT` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:21.503166 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bbe341-9a8b-485d-b587-792ce08e914c admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:21.503382 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bbe341-9a8b-485d-b587-792ce08e914c admin admin] PATH_INFO: `/v3/projects/da836b133a65491faf5f7cb6f86fe28b/users/4c273d970a8e4dafbc657b4e00212717/roles/d8dbc6d83d9d41d28c3feb8b3485b291` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:21.520971 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b0f563-a656-4be1-b9e0-a6f87e3cfb35 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:21.528005 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df055ed-275d-4fb1-a4f2-671e342b340d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:21.529339 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df055ed-275d-4fb1-a4f2-671e342b340d admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:21.529545 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df055ed-275d-4fb1-a4f2-671e342b340d admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:21.529815 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df055ed-275d-4fb1-a4f2-671e342b340d admin admin] PATH_INFO: `/v3/roles` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:21.530059 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bbe341-9a8b-485d-b587-792ce08e914c admin admin] RBAC: Authorizing `identity:create_grant(project_id=da836b133a65491faf5f7cb6f86fe28b, user_id=4c273d970a8e4dafbc657b4e00212717, role_id=d8dbc6d83d9d41d28c3feb8b3485b291)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:21.531150 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df055ed-275d-4fb1-a4f2-671e342b340d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:21.532516 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df055ed-275d-4fb1-a4f2-671e342b340d admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:21.533537 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bbe341-9a8b-485d-b587-792ce08e914c admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:21.551293 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1033/2063] 10.222.0.117 () {58 vars in 1126 bytes} [Tue Jan 25 02:36:21 2022] GET /identity/v3/roles => generated 1427 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 25 02:36:21.556185 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df055ed-275d-4fb1-a4f2-671e342b340d admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:21.556805 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1031/2064] 10.222.0.117 () {60 vars in 1487 bytes} [Tue Jan 25 02:36:21 2022] PUT /identity/v3/projects/da836b133a65491faf5f7cb6f86fe28b/users/4c273d970a8e4dafbc657b4e00212717/roles/d8dbc6d83d9d41d28c3feb8b3485b291 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:36:21.560466 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bbe341-9a8b-485d-b587-792ce08e914c admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:21.566458 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df055ed-275d-4fb1-a4f2-671e342b340d admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:21.664096 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bbe341-9a8b-485d-b587-792ce08e914c admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:21.664294 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad5be99-9e84-4301-ab6b-75cdff3092b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:21.664294 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad5be99-9e84-4301-ab6b-75cdff3092b0 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:21.664294 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad5be99-9e84-4301-ab6b-75cdff3092b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:21.664684 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad5be99-9e84-4301-ab6b-75cdff3092b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:21.665612 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad5be99-9e84-4301-ab6b-75cdff3092b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:21.667492 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad5be99-9e84-4301-ab6b-75cdff3092b0 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:21.675425 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fe5cd6-140f-4fb4-9072-aa4045ad09ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:21.676224 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fe5cd6-140f-4fb4-9072-aa4045ad09ce admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:21.676885 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fe5cd6-140f-4fb4-9072-aa4045ad09ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:21.679023 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fe5cd6-140f-4fb4-9072-aa4045ad09ce admin admin] PATH_INFO: `/v3/roles` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:21.680467 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fe5cd6-140f-4fb4-9072-aa4045ad09ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:21.684887 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1034/2065] 10.222.0.117 () {58 vars in 1126 bytes} [Tue Jan 25 02:36:21 2022] GET /identity/v3/roles => generated 1427 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 02:36:21.685039 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fe5cd6-140f-4fb4-9072-aa4045ad09ce admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:21.687955 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad5be99-9e84-4301-ab6b-75cdff3092b0 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:21.697456 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1032/2066] 10.222.0.117 () {58 vars in 1126 bytes} [Tue Jan 25 02:36:21 2022] GET /identity/v3/roles => generated 1427 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 02:36:21.701657 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fe5cd6-140f-4fb4-9072-aa4045ad09ce admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:21.712422 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad5be99-9e84-4301-ab6b-75cdff3092b0 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:21.717527 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc082409-3f47-4b1a-9f23-19df92278fc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:21.718880 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc082409-3f47-4b1a-9f23-19df92278fc0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:21.719241 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc082409-3f47-4b1a-9f23-19df92278fc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:21.720292 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc082409-3f47-4b1a-9f23-19df92278fc0 admin admin] PATH_INFO: `/v3/projects/fba913a167544c5289051e9d0dc233e0/users/7469e0f9408f400296d4e53b20480aa9/roles/33a8e87420ed423f9cb29e0084eab5d2` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:21.725989 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fe5cd6-140f-4fb4-9072-aa4045ad09ce admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:21.732559 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdab95b-903e-4891-947a-3686880eb8c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:21.733474 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdab95b-903e-4891-947a-3686880eb8c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:21.733940 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdab95b-903e-4891-947a-3686880eb8c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:21.734262 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdab95b-903e-4891-947a-3686880eb8c6 admin admin] PATH_INFO: `/v3/projects/da836b133a65491faf5f7cb6f86fe28b/users/4c273d970a8e4dafbc657b4e00212717/roles/d8dbc6d83d9d41d28c3feb8b3485b291` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:21.737756 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdab95b-903e-4891-947a-3686880eb8c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da836b133a65491faf5f7cb6f86fe28b, user_id=4c273d970a8e4dafbc657b4e00212717, role_id=d8dbc6d83d9d41d28c3feb8b3485b291)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:21.738515 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc082409-3f47-4b1a-9f23-19df92278fc0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fba913a167544c5289051e9d0dc233e0, user_id=7469e0f9408f400296d4e53b20480aa9, role_id=33a8e87420ed423f9cb29e0084eab5d2)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:21.742000 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc082409-3f47-4b1a-9f23-19df92278fc0 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:21.742166 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdab95b-903e-4891-947a-3686880eb8c6 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:21.765178 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1035/2067] 10.222.0.117 () {60 vars in 1487 bytes} [Tue Jan 25 02:36:21 2022] PUT /identity/v3/projects/fba913a167544c5289051e9d0dc233e0/users/7469e0f9408f400296d4e53b20480aa9/roles/33a8e87420ed423f9cb29e0084eab5d2 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:36:21.778862 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4565261d-3a3c-4c18-b602-7c973bc94a46 None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:21.779080 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4565261d-3a3c-4c18-b602-7c973bc94a46 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:21.779362 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4565261d-3a3c-4c18-b602-7c973bc94a46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:21.780167 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1033/2068] 10.222.0.117 () {60 vars in 1487 bytes} [Tue Jan 25 02:36:21 2022] PUT /identity/v3/projects/da836b133a65491faf5f7cb6f86fe28b/users/4c273d970a8e4dafbc657b4e00212717/roles/d8dbc6d83d9d41d28c3feb8b3485b291 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:36:21.791898 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b686fbc-ae8c-463e-b769-8f84f01e766c None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:21.792424 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b686fbc-ae8c-463e-b769-8f84f01e766c None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:21.792850 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b686fbc-ae8c-463e-b769-8f84f01e766c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:21.829606 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-4565261d-3a3c-4c18-b602-7c973bc94a46 None None] MFA Rules not processed for user `7469e0f9408f400296d4e53b20480aa9`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:36:21.829859 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-3b686fbc-ae8c-463e-b769-8f84f01e766c None None] MFA Rules not processed for user `4c273d970a8e4dafbc657b4e00212717`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:36:21.831107 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-3b686fbc-ae8c-463e-b769-8f84f01e766c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:36:21.831996 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-4565261d-3a3c-4c18-b602-7c973bc94a46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:36:21.925934 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1034/2069] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:36:21 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 25 02:36:21.936369 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b686fbc-ae8c-463e-b769-8f84f01e766c None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:21.938775 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-3b686fbc-ae8c-463e-b769-8f84f01e766c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:36:21.939149 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1036/2070] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:36:21 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 25 02:36:21.956196 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4565261d-3a3c-4c18-b602-7c973bc94a46 None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:21.961281 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-4565261d-3a3c-4c18-b602-7c973bc94a46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:36:22.054534 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4565261d-3a3c-4c18-b602-7c973bc94a46 None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:22.059754 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3f8831-8bc4-434c-a438-8baf8f3d7f94 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db3663416137459d9da4a71032505b0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:22.060533 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3f8831-8bc4-434c-a438-8baf8f3d7f94 service glance] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:22.061334 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3f8831-8bc4-434c-a438-8baf8f3d7f94 service glance] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:22.061648 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3f8831-8bc4-434c-a438-8baf8f3d7f94 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:22.076990 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3f8831-8bc4-434c-a438-8baf8f3d7f94 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:22.076990 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3f8831-8bc4-434c-a438-8baf8f3d7f94 service glance] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:22.099156 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1037/2071] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:36:21 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:36:22.104429 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b686fbc-ae8c-463e-b769-8f84f01e766c None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:22.131788 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e16a79-063c-49d7-bccd-720b196d3a5c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cc5249aea09430080e232cf17757f86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:22.132421 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e16a79-063c-49d7-bccd-720b196d3a5c service cinder] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:22.132907 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e16a79-063c-49d7-bccd-720b196d3a5c service cinder] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:22.132907 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e16a79-063c-49d7-bccd-720b196d3a5c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:22.155428 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e16a79-063c-49d7-bccd-720b196d3a5c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:22.157003 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e16a79-063c-49d7-bccd-720b196d3a5c service cinder] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:22.170086 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1035/2072] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:36:21 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:36:22.372482 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3f8831-8bc4-434c-a438-8baf8f3d7f94 service glance] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:22.489187 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3f8831-8bc4-434c-a438-8baf8f3d7f94 service glance] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:22.504142 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559bd4a7-b606-40fb-a775-6c1c7502a075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:22.505046 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559bd4a7-b606-40fb-a775-6c1c7502a075 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:22.505889 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559bd4a7-b606-40fb-a775-6c1c7502a075 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:22.506318 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559bd4a7-b606-40fb-a775-6c1c7502a075 admin admin] PATH_INFO: `/v3/users/cb05f82caecc436cb3dce351523bcc9d` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:22.508847 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559bd4a7-b606-40fb-a775-6c1c7502a075 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb05f82caecc436cb3dce351523bcc9d)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:22.511926 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559bd4a7-b606-40fb-a775-6c1c7502a075 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:22.611095 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-559bd4a7-b606-40fb-a775-6c1c7502a075 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb05f82caecc436cb3dce351523bcc9d'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:22.612190 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-559bd4a7-b606-40fb-a775-6c1c7502a075 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb05f82caecc436cb3dce351523bcc9d'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:22.629830 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-559bd4a7-b606-40fb-a775-6c1c7502a075 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb05f82caecc436cb3dce351523bcc9d'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:22.631904 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-559bd4a7-b606-40fb-a775-6c1c7502a075 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb05f82caecc436cb3dce351523bcc9d'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:22.643480 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-559bd4a7-b606-40fb-a775-6c1c7502a075 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb05f82caecc436cb3dce351523bcc9d'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:22.682373 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18feab8a-07a6-43ad-830f-50a1a65baaba None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:22.682373 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18feab8a-07a6-43ad-830f-50a1a65baaba None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:22.682373 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18feab8a-07a6-43ad-830f-50a1a65baaba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:22.684468 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1038/2073] 10.222.0.117 () {58 vars in 1228 bytes} [Tue Jan 25 02:36:22 2022] DELETE /identity/v3/users/cb05f82caecc436cb3dce351523bcc9d => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:36:22.748649 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-18feab8a-07a6-43ad-830f-50a1a65baaba None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:36:22.748649 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-18feab8a-07a6-43ad-830f-50a1a65baaba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:36:22.883090 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1036/2074] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:36:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:36:22.892724 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559bd4a7-b606-40fb-a775-6c1c7502a075 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:22.894594 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-559bd4a7-b606-40fb-a775-6c1c7502a075 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:36:22.990729 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559bd4a7-b606-40fb-a775-6c1c7502a075 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:22.995633 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1833d15-13dd-4f90-b42c-bed91c8e43d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca4071c5f8f4a31b5edb81fa66a43a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:22.996343 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1833d15-13dd-4f90-b42c-bed91c8e43d1 service neutron] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:22.996686 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1833d15-13dd-4f90-b42c-bed91c8e43d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:22.996971 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1833d15-13dd-4f90-b42c-bed91c8e43d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:23.017528 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1833d15-13dd-4f90-b42c-bed91c8e43d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:23.020120 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1833d15-13dd-4f90-b42c-bed91c8e43d1 service neutron] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:23.034208 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1039/2075] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:36:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 25 02:36:23.284102 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27624398-26cb-4dab-b09c-2f5549e22ec9 None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:23.284581 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27624398-26cb-4dab-b09c-2f5549e22ec9 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:23.284659 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27624398-26cb-4dab-b09c-2f5549e22ec9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:23.330212 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-27624398-26cb-4dab-b09c-2f5549e22ec9 None None] MFA Rules not processed for user `4cd46fc7a1d84effa41ba0f8935fcf68`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:36:23.331545 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-27624398-26cb-4dab-b09c-2f5549e22ec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:36:23.438670 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1037/2076] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:36:23 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:36:23.443047 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1833d15-13dd-4f90-b42c-bed91c8e43d1 service neutron] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:23.444618 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-e1833d15-13dd-4f90-b42c-bed91c8e43d1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:36:23.460782 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1833d15-13dd-4f90-b42c-bed91c8e43d1 service neutron] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:23.465938 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c508cd-4f95-451d-9370-8a24923e8081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:23.466617 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c508cd-4f95-451d-9370-8a24923e8081 admin admin] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:23.467046 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c508cd-4f95-451d-9370-8a24923e8081 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:23.467333 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c508cd-4f95-451d-9370-8a24923e8081 admin admin] PATH_INFO: `/v3/projects` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:23.468100 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c508cd-4f95-451d-9370-8a24923e8081 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:23.470083 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c508cd-4f95-451d-9370-8a24923e8081 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:23.510771 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27624398-26cb-4dab-b09c-2f5549e22ec9 None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:23.512400 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-27624398-26cb-4dab-b09c-2f5549e22ec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:36:23.513230 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1040/2077] 10.222.0.117 () {60 vars in 1157 bytes} [Tue Jan 25 02:36:23 2022] POST /identity/v3/projects => generated 386 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 02:36:23.514789 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c508cd-4f95-451d-9370-8a24923e8081 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:23.539528 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27624398-26cb-4dab-b09c-2f5549e22ec9 None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:23.701179 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a09039-060c-45af-9be7-179e1011fec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:23.702658 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a09039-060c-45af-9be7-179e1011fec8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:23.703080 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a09039-060c-45af-9be7-179e1011fec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:23.703355 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a09039-060c-45af-9be7-179e1011fec8 admin admin] PATH_INFO: `/v3/projects/e9ce293c57cf4af6b990811fd5e9401b` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:23.705125 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a09039-060c-45af-9be7-179e1011fec8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9ce293c57cf4af6b990811fd5e9401b)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:23.707084 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a09039-060c-45af-9be7-179e1011fec8 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:23.717877 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c508cd-4f95-451d-9370-8a24923e8081 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:23.723430 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90624ca0-14a6-4bdc-877a-bf1e55e9630f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:23.725554 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90624ca0-14a6-4bdc-877a-bf1e55e9630f admin admin] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:23.726123 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90624ca0-14a6-4bdc-877a-bf1e55e9630f admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:23.726738 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90624ca0-14a6-4bdc-877a-bf1e55e9630f admin admin] PATH_INFO: `/v3/users` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:23.728473 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90624ca0-14a6-4bdc-877a-bf1e55e9630f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:23.730495 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90624ca0-14a6-4bdc-877a-bf1e55e9630f admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:23.754729 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1041/2078] 10.222.0.117 () {60 vars in 1148 bytes} [Tue Jan 25 02:36:23 2022] POST /identity/v3/users => generated 300 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 02:36:23.760478 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90624ca0-14a6-4bdc-877a-bf1e55e9630f admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:23.778127 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90624ca0-14a6-4bdc-877a-bf1e55e9630f admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:23.784195 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2090516-bc20-4f75-ad66-2be60b04bea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:23.784722 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2090516-bc20-4f75-ad66-2be60b04bea3 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:23.785015 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2090516-bc20-4f75-ad66-2be60b04bea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:23.785297 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2090516-bc20-4f75-ad66-2be60b04bea3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:23.786060 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2090516-bc20-4f75-ad66-2be60b04bea3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:23.789038 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2090516-bc20-4f75-ad66-2be60b04bea3 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:23.801312 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-43a09039-060c-45af-9be7-179e1011fec8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9ce293c57cf4af6b990811fd5e9401b', 'request_id': 'req-43a09039-060c-45af-9be7-179e1011fec8'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:23.803570 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1042/2079] 10.222.0.117 () {58 vars in 1126 bytes} [Tue Jan 25 02:36:23 2022] GET /identity/v3/roles => generated 1427 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 25 02:36:23.809151 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2090516-bc20-4f75-ad66-2be60b04bea3 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:23.809782 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-43a09039-060c-45af-9be7-179e1011fec8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9ce293c57cf4af6b990811fd5e9401b', 'request_id': 'req-43a09039-060c-45af-9be7-179e1011fec8'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:23.822048 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2090516-bc20-4f75-ad66-2be60b04bea3 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:23.825682 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-43a09039-060c-45af-9be7-179e1011fec8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9ce293c57cf4af6b990811fd5e9401b', 'request_id': 'req-43a09039-060c-45af-9be7-179e1011fec8'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:23.847965 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-43a09039-060c-45af-9be7-179e1011fec8 admin admin] The token cache is being invalidate because project e9ce293c57cf4af6b990811fd5e9401b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79120) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 25 02:36:23.848604 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-43a09039-060c-45af-9be7-179e1011fec8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:23.851508 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-43a09039-060c-45af-9be7-179e1011fec8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:23.853871 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1038/2080] 10.222.0.117 () {58 vars in 1237 bytes} [Tue Jan 25 02:36:23 2022] DELETE /identity/v3/projects/e9ce293c57cf4af6b990811fd5e9401b => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:36:23.858576 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a09039-060c-45af-9be7-179e1011fec8 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:23.860755 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-43a09039-060c-45af-9be7-179e1011fec8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:36:23.938592 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6fea37-bc07-4afb-998b-68b5539e4b10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:23.938592 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6fea37-bc07-4afb-998b-68b5539e4b10 admin admin] REQUEST_METHOD: `PUT` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:23.939007 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6fea37-bc07-4afb-998b-68b5539e4b10 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:23.939007 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6fea37-bc07-4afb-998b-68b5539e4b10 admin admin] PATH_INFO: `/v3/projects/0d879aff8bc64332896a3089c20f4a76/users/5bbaf52f604a4b6789ebd5830597704c/roles/d8dbc6d83d9d41d28c3feb8b3485b291` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:23.967044 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6fea37-bc07-4afb-998b-68b5539e4b10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d879aff8bc64332896a3089c20f4a76, user_id=5bbaf52f604a4b6789ebd5830597704c, role_id=d8dbc6d83d9d41d28c3feb8b3485b291)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:23.970322 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6fea37-bc07-4afb-998b-68b5539e4b10 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:23.986543 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a09039-060c-45af-9be7-179e1011fec8 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:23.991531 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1043/2081] 10.222.0.117 () {60 vars in 1487 bytes} [Tue Jan 25 02:36:23 2022] PUT /identity/v3/projects/0d879aff8bc64332896a3089c20f4a76/users/5bbaf52f604a4b6789ebd5830597704c/roles/d8dbc6d83d9d41d28c3feb8b3485b291 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:36:24.001472 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6fea37-bc07-4afb-998b-68b5539e4b10 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:24.004185 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-5a6fea37-bc07-4afb-998b-68b5539e4b10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:36:24.050922 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b043b5a0-b532-4dc2-b353-f9752d23aa4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:24.051911 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b043b5a0-b532-4dc2-b353-f9752d23aa4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:24.053009 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b043b5a0-b532-4dc2-b353-f9752d23aa4c admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:24.053307 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b043b5a0-b532-4dc2-b353-f9752d23aa4c admin admin] PATH_INFO: `/v3/users/4c273d970a8e4dafbc657b4e00212717` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:24.054687 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b043b5a0-b532-4dc2-b353-f9752d23aa4c admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c273d970a8e4dafbc657b4e00212717)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:24.057409 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b043b5a0-b532-4dc2-b353-f9752d23aa4c admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:24.072178 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6fea37-bc07-4afb-998b-68b5539e4b10 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:24.077498 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350f54db-2edf-49b8-9e5a-c57a16d460a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:24.077979 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350f54db-2edf-49b8-9e5a-c57a16d460a7 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:24.078267 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350f54db-2edf-49b8-9e5a-c57a16d460a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:24.078549 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350f54db-2edf-49b8-9e5a-c57a16d460a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:24.079321 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350f54db-2edf-49b8-9e5a-c57a16d460a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:24.082441 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350f54db-2edf-49b8-9e5a-c57a16d460a7 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:24.100575 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1044/2082] 10.222.0.117 () {58 vars in 1126 bytes} [Tue Jan 25 02:36:23 2022] GET /identity/v3/roles => generated 1427 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 02:36:24.101981 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350f54db-2edf-49b8-9e5a-c57a16d460a7 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:24.112865 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350f54db-2edf-49b8-9e5a-c57a16d460a7 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:24.118229 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-b043b5a0-b532-4dc2-b353-f9752d23aa4c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c273d970a8e4dafbc657b4e00212717'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:24.119645 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948c42fa-6311-401d-be85-67f54f4df686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:24.120629 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948c42fa-6311-401d-be85-67f54f4df686 admin admin] REQUEST_METHOD: `PUT` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:24.120911 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948c42fa-6311-401d-be85-67f54f4df686 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:24.121189 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948c42fa-6311-401d-be85-67f54f4df686 admin admin] PATH_INFO: `/v3/projects/0d879aff8bc64332896a3089c20f4a76/users/5bbaf52f604a4b6789ebd5830597704c/roles/d8dbc6d83d9d41d28c3feb8b3485b291` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:24.124037 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948c42fa-6311-401d-be85-67f54f4df686 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d879aff8bc64332896a3089c20f4a76, user_id=5bbaf52f604a4b6789ebd5830597704c, role_id=d8dbc6d83d9d41d28c3feb8b3485b291)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:24.127138 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948c42fa-6311-401d-be85-67f54f4df686 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:24.127553 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-b043b5a0-b532-4dc2-b353-f9752d23aa4c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c273d970a8e4dafbc657b4e00212717'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:24.128284 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-b043b5a0-b532-4dc2-b353-f9752d23aa4c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c273d970a8e4dafbc657b4e00212717'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:24.128948 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-b043b5a0-b532-4dc2-b353-f9752d23aa4c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c273d970a8e4dafbc657b4e00212717'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:24.141094 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1045/2083] 10.222.0.117 () {60 vars in 1487 bytes} [Tue Jan 25 02:36:24 2022] PUT /identity/v3/projects/0d879aff8bc64332896a3089c20f4a76/users/5bbaf52f604a4b6789ebd5830597704c/roles/d8dbc6d83d9d41d28c3feb8b3485b291 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:36:24.150197 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-b043b5a0-b532-4dc2-b353-f9752d23aa4c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c273d970a8e4dafbc657b4e00212717'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:24.170415 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1039/2084] 10.222.0.117 () {58 vars in 1228 bytes} [Tue Jan 25 02:36:23 2022] DELETE /identity/v3/users/4c273d970a8e4dafbc657b4e00212717 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:36:24.501740 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948c42fa-6311-401d-be85-67f54f4df686 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:24.507542 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-948c42fa-6311-401d-be85-67f54f4df686 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:36:24.605730 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948c42fa-6311-401d-be85-67f54f4df686 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:24.689798 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e732337a-ef63-4eb9-b8f0-ce3de65616a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:24.690839 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e732337a-ef63-4eb9-b8f0-ce3de65616a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:24.691160 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e732337a-ef63-4eb9-b8f0-ce3de65616a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:24.691541 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e732337a-ef63-4eb9-b8f0-ce3de65616a7 admin admin] PATH_INFO: `/v3/projects/da836b133a65491faf5f7cb6f86fe28b` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:24.693802 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e732337a-ef63-4eb9-b8f0-ce3de65616a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da836b133a65491faf5f7cb6f86fe28b)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:24.714616 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e732337a-ef63-4eb9-b8f0-ce3de65616a7 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:24.804824 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-e732337a-ef63-4eb9-b8f0-ce3de65616a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da836b133a65491faf5f7cb6f86fe28b', 'request_id': 'req-e732337a-ef63-4eb9-b8f0-ce3de65616a7'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:24.811534 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-e732337a-ef63-4eb9-b8f0-ce3de65616a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da836b133a65491faf5f7cb6f86fe28b', 'request_id': 'req-e732337a-ef63-4eb9-b8f0-ce3de65616a7'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:24.827938 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-e732337a-ef63-4eb9-b8f0-ce3de65616a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da836b133a65491faf5f7cb6f86fe28b', 'request_id': 'req-e732337a-ef63-4eb9-b8f0-ce3de65616a7'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:24.836994 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa31e7cd-4222-412a-991f-91102578684c None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:24.837950 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-e732337a-ef63-4eb9-b8f0-ce3de65616a7 admin admin] The token cache is being invalidate because project da836b133a65491faf5f7cb6f86fe28b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79121) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 25 02:36:24.838252 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-e732337a-ef63-4eb9-b8f0-ce3de65616a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:24.839099 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-e732337a-ef63-4eb9-b8f0-ce3de65616a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:24.841058 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1046/2085] 10.222.0.117 () {58 vars in 1237 bytes} [Tue Jan 25 02:36:24 2022] DELETE /identity/v3/projects/da836b133a65491faf5f7cb6f86fe28b => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:36:24.841545 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa31e7cd-4222-412a-991f-91102578684c None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:24.842028 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa31e7cd-4222-412a-991f-91102578684c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:24.849023 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004a8e48-c366-466f-8cfe-d839a70516ab None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:24.849411 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004a8e48-c366-466f-8cfe-d839a70516ab None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:24.849858 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004a8e48-c366-466f-8cfe-d839a70516ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:24.866282 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-fa31e7cd-4222-412a-991f-91102578684c None None] MFA Rules not processed for user `63855c1cdc7b46548312f2e14d99cfe1`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:36:24.867876 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-fa31e7cd-4222-412a-991f-91102578684c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:36:24.877571 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-004a8e48-c366-466f-8cfe-d839a70516ab None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:36:24.879174 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-004a8e48-c366-466f-8cfe-d839a70516ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:36:24.973335 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1040/2086] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:36:24 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 25 02:36:25.033962 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1047/2087] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:36:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:36:25.042376 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7728e60f-a8de-46ca-b1ff-a3a6891bca19 None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:25.042736 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7728e60f-a8de-46ca-b1ff-a3a6891bca19 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:25.043181 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7728e60f-a8de-46ca-b1ff-a3a6891bca19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:25.072392 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-7728e60f-a8de-46ca-b1ff-a3a6891bca19 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:36:25.074627 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-7728e60f-a8de-46ca-b1ff-a3a6891bca19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:36:25.096105 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1041/2088] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:36:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:36:25.099898 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004a8e48-c366-466f-8cfe-d839a70516ab None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:25.116831 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004a8e48-c366-466f-8cfe-d839a70516ab None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:25.130321 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d9362f-a6b1-404f-9d02-5b172f7d127f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:25.131139 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d9362f-a6b1-404f-9d02-5b172f7d127f admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:25.132626 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d9362f-a6b1-404f-9d02-5b172f7d127f admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:25.132910 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d9362f-a6b1-404f-9d02-5b172f7d127f admin admin] PATH_INFO: `/v3/domains` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:25.133673 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d9362f-a6b1-404f-9d02-5b172f7d127f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:36:25.133981 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d9362f-a6b1-404f-9d02-5b172f7d127f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:25.136725 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d9362f-a6b1-404f-9d02-5b172f7d127f admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:25.152602 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1048/2089] 10.222.0.117 () {58 vars in 1157 bytes} [Tue Jan 25 02:36:25 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:36:25.157066 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7728e60f-a8de-46ca-b1ff-a3a6891bca19 None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:25.168008 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7728e60f-a8de-46ca-b1ff-a3a6891bca19 None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:25.174507 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909b6714-a532-4c91-9d79-8a0da87d2995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:25.175397 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909b6714-a532-4c91-9d79-8a0da87d2995 admin admin] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:25.176085 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909b6714-a532-4c91-9d79-8a0da87d2995 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:25.176515 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909b6714-a532-4c91-9d79-8a0da87d2995 admin admin] PATH_INFO: `/v3/projects` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:25.192995 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909b6714-a532-4c91-9d79-8a0da87d2995 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:25.202516 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909b6714-a532-4c91-9d79-8a0da87d2995 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:25.239067 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1042/2090] 10.222.0.117 () {60 vars in 1157 bytes} [Tue Jan 25 02:36:25 2022] POST /identity/v3/projects => generated 372 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 25 02:36:25.242979 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d9362f-a6b1-404f-9d02-5b172f7d127f admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:25.257331 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d9362f-a6b1-404f-9d02-5b172f7d127f admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:25.357290 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9376c612-ef08-4eaa-a2c9-4d210fbeb0d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:25.357982 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9376c612-ef08-4eaa-a2c9-4d210fbeb0d2 admin admin] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:25.358560 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9376c612-ef08-4eaa-a2c9-4d210fbeb0d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:25.359008 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9376c612-ef08-4eaa-a2c9-4d210fbeb0d2 admin admin] PATH_INFO: `/v3/users` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:25.360130 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9376c612-ef08-4eaa-a2c9-4d210fbeb0d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:25.363451 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9376c612-ef08-4eaa-a2c9-4d210fbeb0d2 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:25.390573 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1049/2091] 10.222.0.117 () {60 vars in 1148 bytes} [Tue Jan 25 02:36:25 2022] POST /identity/v3/users => generated 287 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 02:36:25.394385 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909b6714-a532-4c91-9d79-8a0da87d2995 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:25.404775 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909b6714-a532-4c91-9d79-8a0da87d2995 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:25.409650 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18eaf8f8-e816-4d3f-8915-a2da6dfa8a40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:25.410318 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eaf8f8-e816-4d3f-8915-a2da6dfa8a40 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:25.410605 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eaf8f8-e816-4d3f-8915-a2da6dfa8a40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:25.410882 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eaf8f8-e816-4d3f-8915-a2da6dfa8a40 admin admin] PATH_INFO: `/v3/roles` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:25.412306 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18eaf8f8-e816-4d3f-8915-a2da6dfa8a40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:25.413798 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18eaf8f8-e816-4d3f-8915-a2da6dfa8a40 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:25.424589 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1043/2092] 10.222.0.117 () {58 vars in 1126 bytes} [Tue Jan 25 02:36:25 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 02:36:25.429210 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9376c612-ef08-4eaa-a2c9-4d210fbeb0d2 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:25.443441 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9376c612-ef08-4eaa-a2c9-4d210fbeb0d2 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:25.449063 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8e3c0b-6bb2-4824-839b-41e15324c101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:25.449789 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8e3c0b-6bb2-4824-839b-41e15324c101 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:25.450081 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8e3c0b-6bb2-4824-839b-41e15324c101 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:25.450508 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8e3c0b-6bb2-4824-839b-41e15324c101 admin admin] PATH_INFO: `/v3/roles` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:25.451300 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8e3c0b-6bb2-4824-839b-41e15324c101 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:25.453096 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8e3c0b-6bb2-4824-839b-41e15324c101 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:25.467411 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1050/2093] 10.222.0.117 () {58 vars in 1126 bytes} [Tue Jan 25 02:36:25 2022] GET /identity/v3/roles => generated 1427 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 02:36:25.468806 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18eaf8f8-e816-4d3f-8915-a2da6dfa8a40 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:25.479793 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18eaf8f8-e816-4d3f-8915-a2da6dfa8a40 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:25.486866 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6286aa-3eeb-4fc3-a9d0-67415d5b313a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:25.487952 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6286aa-3eeb-4fc3-a9d0-67415d5b313a admin admin] REQUEST_METHOD: `PUT` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:25.488300 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6286aa-3eeb-4fc3-a9d0-67415d5b313a admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:25.494256 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6286aa-3eeb-4fc3-a9d0-67415d5b313a admin admin] PATH_INFO: `/v3/projects/9c071f35692f4f8b965b5fee58c964f2/users/4e538778db5e4f9d8f778ba73d138863/roles/33a8e87420ed423f9cb29e0084eab5d2` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:25.523051 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6286aa-3eeb-4fc3-a9d0-67415d5b313a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c071f35692f4f8b965b5fee58c964f2, user_id=4e538778db5e4f9d8f778ba73d138863, role_id=33a8e87420ed423f9cb29e0084eab5d2)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:25.528566 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6286aa-3eeb-4fc3-a9d0-67415d5b313a admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:25.555331 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1044/2094] 10.222.0.117 () {60 vars in 1487 bytes} [Tue Jan 25 02:36:25 2022] PUT /identity/v3/projects/9c071f35692f4f8b965b5fee58c964f2/users/4e538778db5e4f9d8f778ba73d138863/roles/33a8e87420ed423f9cb29e0084eab5d2 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:36:25.568785 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf00b36c-29a5-42f8-8ae5-ae8fc4ebc52a None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:25.569486 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf00b36c-29a5-42f8-8ae5-ae8fc4ebc52a None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:25.569707 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf00b36c-29a5-42f8-8ae5-ae8fc4ebc52a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:25.603912 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-cf00b36c-29a5-42f8-8ae5-ae8fc4ebc52a None None] MFA Rules not processed for user `4e538778db5e4f9d8f778ba73d138863`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:36:25.605337 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-cf00b36c-29a5-42f8-8ae5-ae8fc4ebc52a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:36:25.698258 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1051/2095] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:36:25 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:36:25.716248 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6286aa-3eeb-4fc3-a9d0-67415d5b313a admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:25.719195 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-ac6286aa-3eeb-4fc3-a9d0-67415d5b313a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:36:25.780781 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6286aa-3eeb-4fc3-a9d0-67415d5b313a admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:25.784629 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177e520d-cc84-470c-b95d-a24b1c26d840 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cc5249aea09430080e232cf17757f86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:25.785428 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177e520d-cc84-470c-b95d-a24b1c26d840 service cinder] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:25.785723 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177e520d-cc84-470c-b95d-a24b1c26d840 service cinder] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:25.786005 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177e520d-cc84-470c-b95d-a24b1c26d840 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:25.795952 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177e520d-cc84-470c-b95d-a24b1c26d840 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:25.797502 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177e520d-cc84-470c-b95d-a24b1c26d840 service cinder] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:25.807608 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1045/2096] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:36:25 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:36:25.837165 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf00b36c-29a5-42f8-8ae5-ae8fc4ebc52a None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:25.909875 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf00b36c-29a5-42f8-8ae5-ae8fc4ebc52a None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:25.916449 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3e2731-d531-45aa-82d4-568323c8e056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:25.917582 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3e2731-d531-45aa-82d4-568323c8e056 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:25.917999 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3e2731-d531-45aa-82d4-568323c8e056 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:25.918287 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3e2731-d531-45aa-82d4-568323c8e056 admin admin] PATH_INFO: `/v3/users/4e538778db5e4f9d8f778ba73d138863` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:25.919578 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3e2731-d531-45aa-82d4-568323c8e056 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e538778db5e4f9d8f778ba73d138863)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:25.921741 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3e2731-d531-45aa-82d4-568323c8e056 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:25.989142 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-2c3e2731-d531-45aa-82d4-568323c8e056 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e538778db5e4f9d8f778ba73d138863'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:25.989943 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-2c3e2731-d531-45aa-82d4-568323c8e056 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e538778db5e4f9d8f778ba73d138863'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:25.997529 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-2c3e2731-d531-45aa-82d4-568323c8e056 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e538778db5e4f9d8f778ba73d138863'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:25.998254 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-2c3e2731-d531-45aa-82d4-568323c8e056 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e538778db5e4f9d8f778ba73d138863'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:26.010052 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-2c3e2731-d531-45aa-82d4-568323c8e056 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e538778db5e4f9d8f778ba73d138863'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:26.038701 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1052/2097] 10.222.0.117 () {58 vars in 1228 bytes} [Tue Jan 25 02:36:25 2022] DELETE /identity/v3/users/4e538778db5e4f9d8f778ba73d138863 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:36:26.044150 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40069376-d1ce-4172-9ee8-064874c07087 None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:26.045398 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40069376-d1ce-4172-9ee8-064874c07087 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:26.045927 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40069376-d1ce-4172-9ee8-064874c07087 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:26.086071 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-40069376-d1ce-4172-9ee8-064874c07087 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:36:26.087673 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-40069376-d1ce-4172-9ee8-064874c07087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:36:26.181668 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1046/2098] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:36:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:36:26.193131 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3e2731-d531-45aa-82d4-568323c8e056 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:26.194910 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-2c3e2731-d531-45aa-82d4-568323c8e056 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:36:26.266798 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3e2731-d531-45aa-82d4-568323c8e056 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:26.271943 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02140be-ad25-4f0b-a07a-b19175fdd484 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca4071c5f8f4a31b5edb81fa66a43a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:26.272659 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02140be-ad25-4f0b-a07a-b19175fdd484 service neutron] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:26.272946 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02140be-ad25-4f0b-a07a-b19175fdd484 service neutron] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:26.273227 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02140be-ad25-4f0b-a07a-b19175fdd484 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:26.283418 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02140be-ad25-4f0b-a07a-b19175fdd484 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:26.285070 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02140be-ad25-4f0b-a07a-b19175fdd484 service neutron] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:26.297809 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1053/2099] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:36:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:36:27.202414 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40069376-d1ce-4172-9ee8-064874c07087 None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:27.207406 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-40069376-d1ce-4172-9ee8-064874c07087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:36:27.242471 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40069376-d1ce-4172-9ee8-064874c07087 None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:27.269412 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca983a1-cd49-428e-b313-3776f2f13189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:27.277647 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca983a1-cd49-428e-b313-3776f2f13189 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:27.278393 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca983a1-cd49-428e-b313-3776f2f13189 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:27.278704 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca983a1-cd49-428e-b313-3776f2f13189 admin admin] PATH_INFO: `/v3/projects/9c071f35692f4f8b965b5fee58c964f2` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:27.284629 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca983a1-cd49-428e-b313-3776f2f13189 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c071f35692f4f8b965b5fee58c964f2)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:27.287336 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca983a1-cd49-428e-b313-3776f2f13189 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:27.407046 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-7ca983a1-cd49-428e-b313-3776f2f13189 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c071f35692f4f8b965b5fee58c964f2', 'request_id': 'req-7ca983a1-cd49-428e-b313-3776f2f13189'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:27.418062 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-7ca983a1-cd49-428e-b313-3776f2f13189 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c071f35692f4f8b965b5fee58c964f2', 'request_id': 'req-7ca983a1-cd49-428e-b313-3776f2f13189'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:27.434729 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-7ca983a1-cd49-428e-b313-3776f2f13189 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c071f35692f4f8b965b5fee58c964f2', 'request_id': 'req-7ca983a1-cd49-428e-b313-3776f2f13189'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:27.464247 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-7ca983a1-cd49-428e-b313-3776f2f13189 admin admin] The token cache is being invalidate because project 9c071f35692f4f8b965b5fee58c964f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79120) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 25 02:36:27.464247 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-7ca983a1-cd49-428e-b313-3776f2f13189 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:27.466100 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-7ca983a1-cd49-428e-b313-3776f2f13189 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:27.475339 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1047/2100] 10.222.0.117 () {58 vars in 1237 bytes} [Tue Jan 25 02:36:27 2022] DELETE /identity/v3/projects/9c071f35692f4f8b965b5fee58c964f2 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:36:27.484579 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c58399-a8de-4fc4-bcc5-6d587aff8724 None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:27.484579 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c58399-a8de-4fc4-bcc5-6d587aff8724 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:27.484579 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c58399-a8de-4fc4-bcc5-6d587aff8724 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:27.519899 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-40c58399-a8de-4fc4-bcc5-6d587aff8724 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:36:27.521856 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-40c58399-a8de-4fc4-bcc5-6d587aff8724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:36:27.664331 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1054/2101] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:36:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 25 02:36:27.678989 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cfd24b-5f72-42ec-b173-a82d39171f0e None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:27.678989 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cfd24b-5f72-42ec-b173-a82d39171f0e None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:27.678989 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cfd24b-5f72-42ec-b173-a82d39171f0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:27.694161 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-c5cfd24b-5f72-42ec-b173-a82d39171f0e None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:36:27.695741 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-c5cfd24b-5f72-42ec-b173-a82d39171f0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:36:27.711190 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1048/2102] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:36:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:36:27.712648 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c58399-a8de-4fc4-bcc5-6d587aff8724 None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:27.730785 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c58399-a8de-4fc4-bcc5-6d587aff8724 None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:27.744400 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa62fa28-61e7-4474-92e8-3ec048afaa42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:27.746427 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa62fa28-61e7-4474-92e8-3ec048afaa42 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:27.746877 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa62fa28-61e7-4474-92e8-3ec048afaa42 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:27.753297 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa62fa28-61e7-4474-92e8-3ec048afaa42 admin admin] PATH_INFO: `/v3/domains` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:27.754651 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa62fa28-61e7-4474-92e8-3ec048afaa42 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:36:27.755158 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa62fa28-61e7-4474-92e8-3ec048afaa42 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:27.757423 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa62fa28-61e7-4474-92e8-3ec048afaa42 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:27.784945 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1055/2103] 10.222.0.117 () {58 vars in 1157 bytes} [Tue Jan 25 02:36:27 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:36:27.790046 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cfd24b-5f72-42ec-b173-a82d39171f0e None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:27.802926 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cfd24b-5f72-42ec-b173-a82d39171f0e None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:27.819841 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd96e9b-8b43-4d6b-a14c-1aa61708af43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:27.820849 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd96e9b-8b43-4d6b-a14c-1aa61708af43 admin admin] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:27.821235 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd96e9b-8b43-4d6b-a14c-1aa61708af43 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:27.822256 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd96e9b-8b43-4d6b-a14c-1aa61708af43 admin admin] PATH_INFO: `/v3/projects` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:27.823088 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd96e9b-8b43-4d6b-a14c-1aa61708af43 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:27.825154 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd96e9b-8b43-4d6b-a14c-1aa61708af43 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:27.908125 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1049/2104] 10.222.0.117 () {60 vars in 1157 bytes} [Tue Jan 25 02:36:27 2022] POST /identity/v3/projects => generated 382 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 02:36:27.910528 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa62fa28-61e7-4474-92e8-3ec048afaa42 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:27.932438 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa62fa28-61e7-4474-92e8-3ec048afaa42 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:28.070837 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8141ec-6ed5-4444-919a-4d1053b22947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:28.071961 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8141ec-6ed5-4444-919a-4d1053b22947 admin admin] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:28.072398 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8141ec-6ed5-4444-919a-4d1053b22947 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:28.072923 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8141ec-6ed5-4444-919a-4d1053b22947 admin admin] PATH_INFO: `/v3/users` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:28.073901 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8141ec-6ed5-4444-919a-4d1053b22947 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:28.078085 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8141ec-6ed5-4444-919a-4d1053b22947 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:28.148308 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd96e9b-8b43-4d6b-a14c-1aa61708af43 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:28.150867 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1056/2105] 10.222.0.117 () {60 vars in 1148 bytes} [Tue Jan 25 02:36:27 2022] POST /identity/v3/users => generated 292 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 02:36:28.166298 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd96e9b-8b43-4d6b-a14c-1aa61708af43 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:28.176707 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd4b6dc-8bff-4d3f-b68b-9fbdcd8ca60e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:28.177759 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd4b6dc-8bff-4d3f-b68b-9fbdcd8ca60e admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:28.178199 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd4b6dc-8bff-4d3f-b68b-9fbdcd8ca60e admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:28.178659 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd4b6dc-8bff-4d3f-b68b-9fbdcd8ca60e admin admin] PATH_INFO: `/v3/roles` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:28.179523 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd4b6dc-8bff-4d3f-b68b-9fbdcd8ca60e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:28.181381 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd4b6dc-8bff-4d3f-b68b-9fbdcd8ca60e admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:28.206494 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1050/2106] 10.222.0.117 () {58 vars in 1126 bytes} [Tue Jan 25 02:36:28 2022] GET /identity/v3/roles => generated 1427 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 02:36:28.210464 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8141ec-6ed5-4444-919a-4d1053b22947 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:28.233206 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8141ec-6ed5-4444-919a-4d1053b22947 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:28.247495 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3629c1a3-dd38-4217-acaa-fe4d420b4880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:28.249511 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3629c1a3-dd38-4217-acaa-fe4d420b4880 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:28.250500 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3629c1a3-dd38-4217-acaa-fe4d420b4880 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:28.252319 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3629c1a3-dd38-4217-acaa-fe4d420b4880 admin admin] PATH_INFO: `/v3/roles` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:28.253915 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3629c1a3-dd38-4217-acaa-fe4d420b4880 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:28.258573 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3629c1a3-dd38-4217-acaa-fe4d420b4880 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:28.333072 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd4b6dc-8bff-4d3f-b68b-9fbdcd8ca60e admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:28.336111 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1057/2107] 10.222.0.117 () {58 vars in 1126 bytes} [Tue Jan 25 02:36:28 2022] GET /identity/v3/roles => generated 1427 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 02:36:28.349449 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd4b6dc-8bff-4d3f-b68b-9fbdcd8ca60e admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:28.366072 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e42574-6a69-42e3-8419-2a9396f127bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:28.367199 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e42574-6a69-42e3-8419-2a9396f127bd admin admin] REQUEST_METHOD: `PUT` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:28.367444 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e42574-6a69-42e3-8419-2a9396f127bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:28.367746 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e42574-6a69-42e3-8419-2a9396f127bd admin admin] PATH_INFO: `/v3/projects/fc3c884ae9454402aaf311364ba80624/users/d661807e31624b81a38d1ffdaef41507/roles/33a8e87420ed423f9cb29e0084eab5d2` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:28.405572 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e42574-6a69-42e3-8419-2a9396f127bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc3c884ae9454402aaf311364ba80624, user_id=d661807e31624b81a38d1ffdaef41507, role_id=33a8e87420ed423f9cb29e0084eab5d2)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:28.408332 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e42574-6a69-42e3-8419-2a9396f127bd admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:28.448932 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1051/2108] 10.222.0.117 () {60 vars in 1487 bytes} [Tue Jan 25 02:36:28 2022] PUT /identity/v3/projects/fc3c884ae9454402aaf311364ba80624/users/d661807e31624b81a38d1ffdaef41507/roles/33a8e87420ed423f9cb29e0084eab5d2 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 25 02:36:28.452700 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0d97d9-be15-4d1e-82fa-42b534d26f8f None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:28.452991 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0d97d9-be15-4d1e-82fa-42b534d26f8f None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:28.453274 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0d97d9-be15-4d1e-82fa-42b534d26f8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:28.522832 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-9d0d97d9-be15-4d1e-82fa-42b534d26f8f None None] MFA Rules not processed for user `d661807e31624b81a38d1ffdaef41507`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:36:28.525465 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-9d0d97d9-be15-4d1e-82fa-42b534d26f8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:36:28.702953 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1058/2109] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:36:28 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:36:28.713754 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e42574-6a69-42e3-8419-2a9396f127bd admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:28.715742 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-95e42574-6a69-42e3-8419-2a9396f127bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:36:28.869590 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e42574-6a69-42e3-8419-2a9396f127bd admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:28.879559 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2abf8f-d6bb-44b6-9f84-ea6180a95105 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cc5249aea09430080e232cf17757f86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:28.881017 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2abf8f-d6bb-44b6-9f84-ea6180a95105 service cinder] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:28.882128 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2abf8f-d6bb-44b6-9f84-ea6180a95105 service cinder] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:28.882515 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2abf8f-d6bb-44b6-9f84-ea6180a95105 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:28.903608 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2abf8f-d6bb-44b6-9f84-ea6180a95105 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:28.905108 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2abf8f-d6bb-44b6-9f84-ea6180a95105 service cinder] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:28.921304 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1052/2110] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:36:28 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:36:30.914185 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69809ce4-28f4-4341-b547-9d26e5e308e5 None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:30.914702 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69809ce4-28f4-4341-b547-9d26e5e308e5 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:30.915008 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69809ce4-28f4-4341-b547-9d26e5e308e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:30.948044 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-69809ce4-28f4-4341-b547-9d26e5e308e5 None None] MFA Rules not processed for user `5bbaf52f604a4b6789ebd5830597704c`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:36:30.949431 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-69809ce4-28f4-4341-b547-9d26e5e308e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:36:31.024242 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1059/2111] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:36:30 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:36:31.037599 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2abf8f-d6bb-44b6-9f84-ea6180a95105 service cinder] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:31.039149 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-1c2abf8f-d6bb-44b6-9f84-ea6180a95105 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:36:31.110163 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2abf8f-d6bb-44b6-9f84-ea6180a95105 service cinder] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:31.116274 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2da92f8-0c40-4c99-b9f0-cc5dbe1eba3d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db3663416137459d9da4a71032505b0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:31.116946 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2da92f8-0c40-4c99-b9f0-cc5dbe1eba3d service glance] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:31.117254 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2da92f8-0c40-4c99-b9f0-cc5dbe1eba3d service glance] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:31.117537 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2da92f8-0c40-4c99-b9f0-cc5dbe1eba3d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:31.119521 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-b2da92f8-0c40-4c99-b9f0-cc5dbe1eba3d service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:36:31.201169 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2da92f8-0c40-4c99-b9f0-cc5dbe1eba3d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:31.202988 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2da92f8-0c40-4c99-b9f0-cc5dbe1eba3d service glance] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:31.215231 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1053/2112] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:36:31 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:36:31.385535 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44685267-df44-4c35-a40e-008a5477d6c8 None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:31.386066 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44685267-df44-4c35-a40e-008a5477d6c8 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:31.386542 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44685267-df44-4c35-a40e-008a5477d6c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:31.413651 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-44685267-df44-4c35-a40e-008a5477d6c8 None None] MFA Rules not processed for user `5924414ee6e948a680b8b75c8797b466`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:36:31.414934 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-44685267-df44-4c35-a40e-008a5477d6c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:36:31.491365 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1060/2113] 10.222.0.117 () {58 vars in 1014 bytes} [Tue Jan 25 02:36:31 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:36:31.504037 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2da92f8-0c40-4c99-b9f0-cc5dbe1eba3d service glance] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:31.506087 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-b2da92f8-0c40-4c99-b9f0-cc5dbe1eba3d service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:36:31.613684 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2da92f8-0c40-4c99-b9f0-cc5dbe1eba3d service glance] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:31.619325 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31051959-3337-4e9e-bb8d-18d3f89dce41 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100f12ee56754f1c859106bf3e473df6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:31.620121 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31051959-3337-4e9e-bb8d-18d3f89dce41 service swift] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:31.620407 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31051959-3337-4e9e-bb8d-18d3f89dce41 service swift] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:31.620679 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31051959-3337-4e9e-bb8d-18d3f89dce41 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:31.628987 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31051959-3337-4e9e-bb8d-18d3f89dce41 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:31.631284 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31051959-3337-4e9e-bb8d-18d3f89dce41 service swift] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:31.640096 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1054/2114] 10.222.0.117 () {60 vars in 1389 bytes} [Tue Jan 25 02:36:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 25 02:36:42.730097 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7de23b5-8de7-49bb-97a0-747bcc635532 None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:42.730658 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7de23b5-8de7-49bb-97a0-747bcc635532 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:42.730658 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7de23b5-8de7-49bb-97a0-747bcc635532 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:42.749217 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-f7de23b5-8de7-49bb-97a0-747bcc635532 None None] MFA Rules not processed for user `4cd46fc7a1d84effa41ba0f8935fcf68`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:36:42.750419 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-f7de23b5-8de7-49bb-97a0-747bcc635532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:36:42.758034 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1061/2115] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:36:42 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:36:43.989938 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31051959-3337-4e9e-bb8d-18d3f89dce41 service swift] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:44.065171 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31051959-3337-4e9e-bb8d-18d3f89dce41 service swift] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:44.072266 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233098fb-73bf-4b28-9885-d65f272af059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:44.073724 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233098fb-73bf-4b28-9885-d65f272af059 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:44.074209 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233098fb-73bf-4b28-9885-d65f272af059 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:44.074667 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233098fb-73bf-4b28-9885-d65f272af059 admin admin] PATH_INFO: `/v3/users/d661807e31624b81a38d1ffdaef41507` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:44.076775 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233098fb-73bf-4b28-9885-d65f272af059 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d661807e31624b81a38d1ffdaef41507)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:44.079189 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233098fb-73bf-4b28-9885-d65f272af059 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:44.137831 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-233098fb-73bf-4b28-9885-d65f272af059 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd661807e31624b81a38d1ffdaef41507'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:44.149750 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-233098fb-73bf-4b28-9885-d65f272af059 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd661807e31624b81a38d1ffdaef41507'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:44.150590 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-233098fb-73bf-4b28-9885-d65f272af059 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd661807e31624b81a38d1ffdaef41507'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:44.151212 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-233098fb-73bf-4b28-9885-d65f272af059 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd661807e31624b81a38d1ffdaef41507'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:44.164221 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-233098fb-73bf-4b28-9885-d65f272af059 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd661807e31624b81a38d1ffdaef41507'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:44.179734 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1055/2116] 10.222.0.117 () {58 vars in 1228 bytes} [Tue Jan 25 02:36:43 2022] DELETE /identity/v3/users/d661807e31624b81a38d1ffdaef41507 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:36:44.184186 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a68f94-12fe-402c-9b89-57a362fb6c41 None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:44.184665 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a68f94-12fe-402c-9b89-57a362fb6c41 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:44.184771 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a68f94-12fe-402c-9b89-57a362fb6c41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:44.202651 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-01a68f94-12fe-402c-9b89-57a362fb6c41 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:36:44.203891 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-01a68f94-12fe-402c-9b89-57a362fb6c41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:36:44.265950 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1062/2117] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:36:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:36:44.276986 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233098fb-73bf-4b28-9885-d65f272af059 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:44.278491 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-233098fb-73bf-4b28-9885-d65f272af059 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:36:44.338377 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233098fb-73bf-4b28-9885-d65f272af059 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:44.342075 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ede7f4b-4d39-459f-a20f-961415b99e6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca4071c5f8f4a31b5edb81fa66a43a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:44.342744 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ede7f4b-4d39-459f-a20f-961415b99e6b service neutron] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:44.343027 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ede7f4b-4d39-459f-a20f-961415b99e6b service neutron] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:44.343299 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ede7f4b-4d39-459f-a20f-961415b99e6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:44.353529 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ede7f4b-4d39-459f-a20f-961415b99e6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:44.355001 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ede7f4b-4d39-459f-a20f-961415b99e6b service neutron] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:44.365344 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1056/2118] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:36:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:36:44.741790 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a68f94-12fe-402c-9b89-57a362fb6c41 None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:44.744083 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-01a68f94-12fe-402c-9b89-57a362fb6c41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:36:44.760439 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a68f94-12fe-402c-9b89-57a362fb6c41 None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:44.765389 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e20247-d019-4165-94be-862d2ac9249d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:44.766479 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e20247-d019-4165-94be-862d2ac9249d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:44.766930 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e20247-d019-4165-94be-862d2ac9249d admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:44.767262 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e20247-d019-4165-94be-862d2ac9249d admin admin] PATH_INFO: `/v3/projects/fc3c884ae9454402aaf311364ba80624` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:44.768785 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e20247-d019-4165-94be-862d2ac9249d admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc3c884ae9454402aaf311364ba80624)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:44.775466 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e20247-d019-4165-94be-862d2ac9249d admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:44.832153 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-d8e20247-d019-4165-94be-862d2ac9249d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc3c884ae9454402aaf311364ba80624', 'request_id': 'req-d8e20247-d019-4165-94be-862d2ac9249d'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:44.838004 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-d8e20247-d019-4165-94be-862d2ac9249d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc3c884ae9454402aaf311364ba80624', 'request_id': 'req-d8e20247-d019-4165-94be-862d2ac9249d'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:44.851240 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-d8e20247-d019-4165-94be-862d2ac9249d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc3c884ae9454402aaf311364ba80624', 'request_id': 'req-d8e20247-d019-4165-94be-862d2ac9249d'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:44.874708 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-d8e20247-d019-4165-94be-862d2ac9249d admin admin] The token cache is being invalidate because project fc3c884ae9454402aaf311364ba80624 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79121) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 25 02:36:44.874708 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-d8e20247-d019-4165-94be-862d2ac9249d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:44.874708 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-d8e20247-d019-4165-94be-862d2ac9249d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:44.881381 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1063/2119] 10.222.0.117 () {58 vars in 1237 bytes} [Tue Jan 25 02:36:44 2022] DELETE /identity/v3/projects/fc3c884ae9454402aaf311364ba80624 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:36:44.888004 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e86613-01b8-4f89-9c50-e7ff4e9fc26d None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:44.888296 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e86613-01b8-4f89-9c50-e7ff4e9fc26d None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:44.888577 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e86613-01b8-4f89-9c50-e7ff4e9fc26d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:44.908881 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-03e86613-01b8-4f89-9c50-e7ff4e9fc26d None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:36:44.910192 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-03e86613-01b8-4f89-9c50-e7ff4e9fc26d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:36:45.002232 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1057/2120] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:36:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:36:45.012606 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5b686a-66b2-4ea8-99bf-4b6a69a7ad49 None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:45.012923 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5b686a-66b2-4ea8-99bf-4b6a69a7ad49 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:45.013205 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5b686a-66b2-4ea8-99bf-4b6a69a7ad49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:45.034028 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-2f5b686a-66b2-4ea8-99bf-4b6a69a7ad49 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:36:45.035610 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-2f5b686a-66b2-4ea8-99bf-4b6a69a7ad49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:36:45.046861 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1064/2121] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:36:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:36:45.052097 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e86613-01b8-4f89-9c50-e7ff4e9fc26d None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:45.063711 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e86613-01b8-4f89-9c50-e7ff4e9fc26d None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:45.069376 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ffe19a-6b0a-4a95-9ff7-a591eed0f37e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:45.070046 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ffe19a-6b0a-4a95-9ff7-a591eed0f37e admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:45.070328 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ffe19a-6b0a-4a95-9ff7-a591eed0f37e admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:45.070598 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ffe19a-6b0a-4a95-9ff7-a591eed0f37e admin admin] PATH_INFO: `/v3/domains` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:45.071353 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ffe19a-6b0a-4a95-9ff7-a591eed0f37e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:36:45.071652 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ffe19a-6b0a-4a95-9ff7-a591eed0f37e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:45.073298 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ffe19a-6b0a-4a95-9ff7-a591eed0f37e admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:45.087448 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1058/2122] 10.222.0.117 () {58 vars in 1157 bytes} [Tue Jan 25 02:36:45 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:36:45.092818 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5b686a-66b2-4ea8-99bf-4b6a69a7ad49 None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:45.104149 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5b686a-66b2-4ea8-99bf-4b6a69a7ad49 None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:45.110328 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5cf6c5-b495-4b01-bfd0-e6d83b67caee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:45.111857 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5cf6c5-b495-4b01-bfd0-e6d83b67caee admin admin] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:45.112371 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5cf6c5-b495-4b01-bfd0-e6d83b67caee admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:45.112848 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5cf6c5-b495-4b01-bfd0-e6d83b67caee admin admin] PATH_INFO: `/v3/projects` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:45.115095 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5cf6c5-b495-4b01-bfd0-e6d83b67caee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:45.117398 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5cf6c5-b495-4b01-bfd0-e6d83b67caee admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:45.149650 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1065/2123] 10.222.0.117 () {60 vars in 1157 bytes} [Tue Jan 25 02:36:45 2022] POST /identity/v3/projects => generated 372 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 02:36:45.154110 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ffe19a-6b0a-4a95-9ff7-a591eed0f37e admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:45.165446 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ffe19a-6b0a-4a95-9ff7-a591eed0f37e admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:45.267351 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7b1660-bd5c-4301-ba8a-930b8337cdbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:45.268078 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7b1660-bd5c-4301-ba8a-930b8337cdbc admin admin] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:45.268347 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7b1660-bd5c-4301-ba8a-930b8337cdbc admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:45.268624 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7b1660-bd5c-4301-ba8a-930b8337cdbc admin admin] PATH_INFO: `/v3/users` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:45.269342 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7b1660-bd5c-4301-ba8a-930b8337cdbc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:45.271993 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7b1660-bd5c-4301-ba8a-930b8337cdbc admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:45.298536 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1059/2124] 10.222.0.117 () {60 vars in 1148 bytes} [Tue Jan 25 02:36:45 2022] POST /identity/v3/users => generated 287 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 02:36:45.300893 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5cf6c5-b495-4b01-bfd0-e6d83b67caee admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:45.316146 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5cf6c5-b495-4b01-bfd0-e6d83b67caee admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:45.323384 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9605a8-3794-4abc-ad12-766c780045a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:45.324265 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9605a8-3794-4abc-ad12-766c780045a1 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:45.324699 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9605a8-3794-4abc-ad12-766c780045a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:45.325598 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9605a8-3794-4abc-ad12-766c780045a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:45.325825 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9605a8-3794-4abc-ad12-766c780045a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:45.328509 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9605a8-3794-4abc-ad12-766c780045a1 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:45.341179 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1066/2125] 10.222.0.117 () {58 vars in 1126 bytes} [Tue Jan 25 02:36:45 2022] GET /identity/v3/roles => generated 1427 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 02:36:45.345918 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7b1660-bd5c-4301-ba8a-930b8337cdbc admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:45.361331 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7b1660-bd5c-4301-ba8a-930b8337cdbc admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:45.369256 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53272e3a-a010-46a8-bf1a-bcf17425e883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:45.370432 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53272e3a-a010-46a8-bf1a-bcf17425e883 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:45.370555 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53272e3a-a010-46a8-bf1a-bcf17425e883 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:45.370770 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53272e3a-a010-46a8-bf1a-bcf17425e883 admin admin] PATH_INFO: `/v3/roles` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:45.371915 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53272e3a-a010-46a8-bf1a-bcf17425e883 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:45.375828 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53272e3a-a010-46a8-bf1a-bcf17425e883 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:45.395908 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1060/2126] 10.222.0.117 () {58 vars in 1126 bytes} [Tue Jan 25 02:36:45 2022] GET /identity/v3/roles => generated 1427 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 25 02:36:45.399485 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9605a8-3794-4abc-ad12-766c780045a1 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:45.413921 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9605a8-3794-4abc-ad12-766c780045a1 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:45.420357 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58661cb4-958e-4b10-87c6-df51a73937bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:45.421639 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58661cb4-958e-4b10-87c6-df51a73937bb admin admin] REQUEST_METHOD: `PUT` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:45.421957 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58661cb4-958e-4b10-87c6-df51a73937bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:45.422293 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58661cb4-958e-4b10-87c6-df51a73937bb admin admin] PATH_INFO: `/v3/projects/18d6138733cc4dd9a2af54fecae74805/users/a3a11152b2324f51b9120ec8fc90e227/roles/33a8e87420ed423f9cb29e0084eab5d2` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:45.444325 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58661cb4-958e-4b10-87c6-df51a73937bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=18d6138733cc4dd9a2af54fecae74805, user_id=a3a11152b2324f51b9120ec8fc90e227, role_id=33a8e87420ed423f9cb29e0084eab5d2)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:45.447013 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58661cb4-958e-4b10-87c6-df51a73937bb admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:45.468155 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1067/2127] 10.222.0.117 () {60 vars in 1487 bytes} [Tue Jan 25 02:36:45 2022] PUT /identity/v3/projects/18d6138733cc4dd9a2af54fecae74805/users/a3a11152b2324f51b9120ec8fc90e227/roles/33a8e87420ed423f9cb29e0084eab5d2 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:36:45.470471 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c956be-5e5d-424c-98ab-eb1c0588fb2c None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:45.470833 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c956be-5e5d-424c-98ab-eb1c0588fb2c None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:45.471190 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c956be-5e5d-424c-98ab-eb1c0588fb2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:45.498311 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-39c956be-5e5d-424c-98ab-eb1c0588fb2c None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:36:45.499721 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-39c956be-5e5d-424c-98ab-eb1c0588fb2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:36:45.584865 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1061/2128] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:36:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:36:45.603408 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58661cb4-958e-4b10-87c6-df51a73937bb admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:45.605908 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-58661cb4-958e-4b10-87c6-df51a73937bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:36:45.625824 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d525e721-8ac5-4915-a723-3c06b53250c5 None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:45.626095 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d525e721-8ac5-4915-a723-3c06b53250c5 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:45.626378 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d525e721-8ac5-4915-a723-3c06b53250c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:45.654706 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-d525e721-8ac5-4915-a723-3c06b53250c5 None None] MFA Rules not processed for user `5924414ee6e948a680b8b75c8797b466`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:36:45.656069 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-d525e721-8ac5-4915-a723-3c06b53250c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:36:45.714852 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58661cb4-958e-4b10-87c6-df51a73937bb admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:45.721115 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b240256f-f26b-4c8a-a20c-57109259ff8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca4071c5f8f4a31b5edb81fa66a43a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:45.721784 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b240256f-f26b-4c8a-a20c-57109259ff8c service neutron] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:45.722070 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b240256f-f26b-4c8a-a20c-57109259ff8c service neutron] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:45.722346 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b240256f-f26b-4c8a-a20c-57109259ff8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:45.735042 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b240256f-f26b-4c8a-a20c-57109259ff8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:45.736584 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b240256f-f26b-4c8a-a20c-57109259ff8c service neutron] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:45.743598 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1062/2129] 10.222.0.117 () {58 vars in 1014 bytes} [Tue Jan 25 02:36:45 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:36:45.747749 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1068/2130] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:36:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:36:45.757713 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d525e721-8ac5-4915-a723-3c06b53250c5 None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:45.759223 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-d525e721-8ac5-4915-a723-3c06b53250c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:36:45.870586 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d525e721-8ac5-4915-a723-3c06b53250c5 None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:45.891191 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed415633-193d-432b-8054-f3710638d7cc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100f12ee56754f1c859106bf3e473df6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:45.892141 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed415633-193d-432b-8054-f3710638d7cc service swift] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:45.892540 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed415633-193d-432b-8054-f3710638d7cc service swift] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:45.892828 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed415633-193d-432b-8054-f3710638d7cc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:45.904494 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed415633-193d-432b-8054-f3710638d7cc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:45.906133 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed415633-193d-432b-8054-f3710638d7cc service swift] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:45.918176 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1063/2131] 10.222.0.117 () {60 vars in 1389 bytes} [Tue Jan 25 02:36:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 25 02:36:46.929471 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431d03bc-1560-4d3b-bdb0-0857c242a534 None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:46.930037 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431d03bc-1560-4d3b-bdb0-0857c242a534 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:46.930305 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431d03bc-1560-4d3b-bdb0-0857c242a534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:46.965531 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-431d03bc-1560-4d3b-bdb0-0857c242a534 None None] MFA Rules not processed for user `a3a11152b2324f51b9120ec8fc90e227`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:36:46.967437 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-431d03bc-1560-4d3b-bdb0-0857c242a534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:36:47.148087 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1069/2132] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:36:46 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 25 02:36:47.160448 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed415633-193d-432b-8054-f3710638d7cc service swift] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:47.163208 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-ed415633-193d-432b-8054-f3710638d7cc service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:36:47.263617 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed415633-193d-432b-8054-f3710638d7cc service swift] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:47.270246 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cb6dc2-7815-4883-adb4-0cd40e4df237 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cc5249aea09430080e232cf17757f86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:47.271082 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cb6dc2-7815-4883-adb4-0cd40e4df237 service cinder] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:47.271372 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cb6dc2-7815-4883-adb4-0cd40e4df237 service cinder] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:47.271654 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cb6dc2-7815-4883-adb4-0cd40e4df237 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:47.280551 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cb6dc2-7815-4883-adb4-0cd40e4df237 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:47.281998 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cb6dc2-7815-4883-adb4-0cd40e4df237 service cinder] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:47.292193 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1064/2133] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:36:47 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:36:48.424726 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431d03bc-1560-4d3b-bdb0-0857c242a534 None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:48.427753 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-431d03bc-1560-4d3b-bdb0-0857c242a534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:36:48.464046 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431d03bc-1560-4d3b-bdb0-0857c242a534 None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:48.470241 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf22922-26c9-400b-ae58-5c5eb1405500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:48.472066 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf22922-26c9-400b-ae58-5c5eb1405500 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:48.472514 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf22922-26c9-400b-ae58-5c5eb1405500 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:48.477799 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf22922-26c9-400b-ae58-5c5eb1405500 admin admin] PATH_INFO: `/v3/users/6ae7d43612964e46947d52e67a4725ff` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:48.479454 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf22922-26c9-400b-ae58-5c5eb1405500 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ae7d43612964e46947d52e67a4725ff)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:48.482781 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf22922-26c9-400b-ae58-5c5eb1405500 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:48.542531 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-fbf22922-26c9-400b-ae58-5c5eb1405500 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ae7d43612964e46947d52e67a4725ff'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:48.543687 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-fbf22922-26c9-400b-ae58-5c5eb1405500 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ae7d43612964e46947d52e67a4725ff'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:48.550811 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-fbf22922-26c9-400b-ae58-5c5eb1405500 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ae7d43612964e46947d52e67a4725ff'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:48.551537 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-fbf22922-26c9-400b-ae58-5c5eb1405500 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ae7d43612964e46947d52e67a4725ff'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:48.568809 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-fbf22922-26c9-400b-ae58-5c5eb1405500 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ae7d43612964e46947d52e67a4725ff'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:48.607739 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1070/2134] 10.222.0.117 () {58 vars in 1228 bytes} [Tue Jan 25 02:36:48 2022] DELETE /identity/v3/users/6ae7d43612964e46947d52e67a4725ff => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:36:48.859080 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cb6dc2-7815-4883-adb4-0cd40e4df237 service cinder] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:48.886355 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cb6dc2-7815-4883-adb4-0cd40e4df237 service cinder] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:48.983929 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5798157b-1c91-4f97-b121-bb17ef61fd80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:48.985033 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5798157b-1c91-4f97-b121-bb17ef61fd80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:48.985297 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5798157b-1c91-4f97-b121-bb17ef61fd80 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:48.985694 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5798157b-1c91-4f97-b121-bb17ef61fd80 admin admin] PATH_INFO: `/v3/projects/cc7d18886cee4c49abf6786916eff689` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:48.987100 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5798157b-1c91-4f97-b121-bb17ef61fd80 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc7d18886cee4c49abf6786916eff689)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:48.989460 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5798157b-1c91-4f97-b121-bb17ef61fd80 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:49.041417 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-5798157b-1c91-4f97-b121-bb17ef61fd80 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc7d18886cee4c49abf6786916eff689', 'request_id': 'req-5798157b-1c91-4f97-b121-bb17ef61fd80'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:49.053250 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-5798157b-1c91-4f97-b121-bb17ef61fd80 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc7d18886cee4c49abf6786916eff689', 'request_id': 'req-5798157b-1c91-4f97-b121-bb17ef61fd80'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:49.060069 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-5798157b-1c91-4f97-b121-bb17ef61fd80 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc7d18886cee4c49abf6786916eff689', 'request_id': 'req-5798157b-1c91-4f97-b121-bb17ef61fd80'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:49.073118 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-5798157b-1c91-4f97-b121-bb17ef61fd80 admin admin] The token cache is being invalidate because project cc7d18886cee4c49abf6786916eff689 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79120) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 25 02:36:49.073678 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-5798157b-1c91-4f97-b121-bb17ef61fd80 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:49.074325 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-5798157b-1c91-4f97-b121-bb17ef61fd80 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:36:49.076217 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1065/2135] 10.222.0.117 () {58 vars in 1237 bytes} [Tue Jan 25 02:36:48 2022] DELETE /identity/v3/projects/cc7d18886cee4c49abf6786916eff689 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:36:49.081706 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8787e90-050c-4654-872a-a2550d281a92 None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:49.082103 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8787e90-050c-4654-872a-a2550d281a92 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:49.082390 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8787e90-050c-4654-872a-a2550d281a92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:49.103165 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-c8787e90-050c-4654-872a-a2550d281a92 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:36:49.104430 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-c8787e90-050c-4654-872a-a2550d281a92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:36:49.174092 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1071/2136] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:36:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:36:49.182902 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0024ad90-39db-4636-b102-005835a07820 None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:49.183215 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0024ad90-39db-4636-b102-005835a07820 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:49.183463 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0024ad90-39db-4636-b102-005835a07820 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:49.202819 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-0024ad90-39db-4636-b102-005835a07820 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:36:49.204918 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-0024ad90-39db-4636-b102-005835a07820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:36:49.220166 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1066/2137] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:36:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:36:49.227382 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8787e90-050c-4654-872a-a2550d281a92 None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:49.238643 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8787e90-050c-4654-872a-a2550d281a92 None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:49.252844 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28c6ff2-90fb-4a56-8f47-3d6264f73a51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:49.253765 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28c6ff2-90fb-4a56-8f47-3d6264f73a51 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:49.254060 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28c6ff2-90fb-4a56-8f47-3d6264f73a51 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:49.254876 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28c6ff2-90fb-4a56-8f47-3d6264f73a51 admin admin] PATH_INFO: `/v3/domains` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:49.256160 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28c6ff2-90fb-4a56-8f47-3d6264f73a51 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:36:49.256468 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28c6ff2-90fb-4a56-8f47-3d6264f73a51 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:49.268882 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28c6ff2-90fb-4a56-8f47-3d6264f73a51 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:49.287170 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1072/2138] 10.222.0.117 () {58 vars in 1157 bytes} [Tue Jan 25 02:36:49 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:36:49.292308 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0024ad90-39db-4636-b102-005835a07820 None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:49.304358 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0024ad90-39db-4636-b102-005835a07820 None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:49.309744 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f027f091-5827-4b82-9ad5-6d8e574a2cb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:49.310805 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f027f091-5827-4b82-9ad5-6d8e574a2cb6 admin admin] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:49.310805 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f027f091-5827-4b82-9ad5-6d8e574a2cb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:49.311033 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f027f091-5827-4b82-9ad5-6d8e574a2cb6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:49.311655 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f027f091-5827-4b82-9ad5-6d8e574a2cb6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:49.313600 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f027f091-5827-4b82-9ad5-6d8e574a2cb6 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:49.351985 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1067/2139] 10.222.0.117 () {60 vars in 1157 bytes} [Tue Jan 25 02:36:49 2022] POST /identity/v3/projects => generated 364 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 02:36:49.352086 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28c6ff2-90fb-4a56-8f47-3d6264f73a51 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:49.363882 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28c6ff2-90fb-4a56-8f47-3d6264f73a51 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:49.436456 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc95b4b-8096-4186-b4c5-809dcee01faf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:49.437778 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc95b4b-8096-4186-b4c5-809dcee01faf admin admin] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:49.438074 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc95b4b-8096-4186-b4c5-809dcee01faf admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:49.438354 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc95b4b-8096-4186-b4c5-809dcee01faf admin admin] PATH_INFO: `/v3/users` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:49.439071 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc95b4b-8096-4186-b4c5-809dcee01faf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:49.441069 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc95b4b-8096-4186-b4c5-809dcee01faf admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:49.464656 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1073/2140] 10.222.0.117 () {60 vars in 1148 bytes} [Tue Jan 25 02:36:49 2022] POST /identity/v3/users => generated 283 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 02:36:49.468619 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f027f091-5827-4b82-9ad5-6d8e574a2cb6 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:49.480835 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f027f091-5827-4b82-9ad5-6d8e574a2cb6 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:49.486153 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b73082c-cf07-488e-8ebd-3bd64de9edc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:49.487090 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b73082c-cf07-488e-8ebd-3bd64de9edc0 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:49.487467 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b73082c-cf07-488e-8ebd-3bd64de9edc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:49.487903 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b73082c-cf07-488e-8ebd-3bd64de9edc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:49.488851 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b73082c-cf07-488e-8ebd-3bd64de9edc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:49.491193 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b73082c-cf07-488e-8ebd-3bd64de9edc0 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:49.502705 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1068/2141] 10.222.0.117 () {58 vars in 1126 bytes} [Tue Jan 25 02:36:49 2022] GET /identity/v3/roles => generated 1427 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 25 02:36:49.508016 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc95b4b-8096-4186-b4c5-809dcee01faf admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:49.518935 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc95b4b-8096-4186-b4c5-809dcee01faf admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:49.525889 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567fbca4-2953-4ceb-aa89-536644d2e10b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:49.527963 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567fbca4-2953-4ceb-aa89-536644d2e10b admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:49.532311 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567fbca4-2953-4ceb-aa89-536644d2e10b admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:49.532857 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567fbca4-2953-4ceb-aa89-536644d2e10b admin admin] PATH_INFO: `/v3/roles` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:49.533834 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567fbca4-2953-4ceb-aa89-536644d2e10b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:49.536441 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567fbca4-2953-4ceb-aa89-536644d2e10b admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:49.550984 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1074/2142] 10.222.0.117 () {58 vars in 1126 bytes} [Tue Jan 25 02:36:49 2022] GET /identity/v3/roles => generated 1427 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 02:36:49.555866 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b73082c-cf07-488e-8ebd-3bd64de9edc0 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:49.567382 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b73082c-cf07-488e-8ebd-3bd64de9edc0 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:49.580233 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f9dc1b-1331-4b62-8c22-0ae62106463d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:49.581390 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f9dc1b-1331-4b62-8c22-0ae62106463d admin admin] REQUEST_METHOD: `PUT` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:49.581997 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f9dc1b-1331-4b62-8c22-0ae62106463d admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:49.582407 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f9dc1b-1331-4b62-8c22-0ae62106463d admin admin] PATH_INFO: `/v3/projects/21aad0792bdc48aaaa2d3866be30d289/users/465b566d4f274c12b31eb58528797109/roles/33a8e87420ed423f9cb29e0084eab5d2` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:49.606963 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f9dc1b-1331-4b62-8c22-0ae62106463d admin admin] RBAC: Authorizing `identity:create_grant(project_id=21aad0792bdc48aaaa2d3866be30d289, user_id=465b566d4f274c12b31eb58528797109, role_id=33a8e87420ed423f9cb29e0084eab5d2)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:49.610300 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f9dc1b-1331-4b62-8c22-0ae62106463d admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:49.627789 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1069/2143] 10.222.0.117 () {60 vars in 1487 bytes} [Tue Jan 25 02:36:49 2022] PUT /identity/v3/projects/21aad0792bdc48aaaa2d3866be30d289/users/465b566d4f274c12b31eb58528797109/roles/33a8e87420ed423f9cb29e0084eab5d2 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:36:49.637211 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfa1af9-b072-47b1-bb5c-2528869f0840 None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:49.637569 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfa1af9-b072-47b1-bb5c-2528869f0840 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:49.637763 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfa1af9-b072-47b1-bb5c-2528869f0840 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:49.683128 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-dbfa1af9-b072-47b1-bb5c-2528869f0840 None None] MFA Rules not processed for user `465b566d4f274c12b31eb58528797109`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:36:49.684557 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-dbfa1af9-b072-47b1-bb5c-2528869f0840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:36:49.778800 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d3ae94-3ec2-4ff0-8aaa-6ab21c6bca6c None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:49.779153 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d3ae94-3ec2-4ff0-8aaa-6ab21c6bca6c None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:49.779397 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d3ae94-3ec2-4ff0-8aaa-6ab21c6bca6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:49.786503 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1075/2144] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:36:49 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:36:49.791022 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfa1af9-b072-47b1-bb5c-2528869f0840 None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:49.805328 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-c0d3ae94-3ec2-4ff0-8aaa-6ab21c6bca6c None None] MFA Rules not processed for user `a3a11152b2324f51b9120ec8fc90e227`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:36:49.811164 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-c0d3ae94-3ec2-4ff0-8aaa-6ab21c6bca6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:36:49.872961 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1070/2145] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:36:49 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 25 02:36:49.880433 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfa1af9-b072-47b1-bb5c-2528869f0840 None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:49.885913 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7b26ac-b400-4c2a-be76-d4034ec39cd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:49.886651 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7b26ac-b400-4c2a-be76-d4034ec39cd7 admin admin] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:49.887003 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7b26ac-b400-4c2a-be76-d4034ec39cd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:49.887281 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7b26ac-b400-4c2a-be76-d4034ec39cd7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:49.888172 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7b26ac-b400-4c2a-be76-d4034ec39cd7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:49.890623 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7b26ac-b400-4c2a-be76-d4034ec39cd7 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:49.944184 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1076/2146] 10.222.0.117 () {60 vars in 1157 bytes} [Tue Jan 25 02:36:49 2022] POST /identity/v3/projects => generated 364 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 25 02:36:49.948399 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d3ae94-3ec2-4ff0-8aaa-6ab21c6bca6c None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:49.964536 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d3ae94-3ec2-4ff0-8aaa-6ab21c6bca6c None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:50.034758 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd60167-0c87-4c25-a97f-3d2d3fecbca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:50.035505 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd60167-0c87-4c25-a97f-3d2d3fecbca1 admin admin] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:50.036552 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd60167-0c87-4c25-a97f-3d2d3fecbca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:50.036947 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd60167-0c87-4c25-a97f-3d2d3fecbca1 admin admin] PATH_INFO: `/v3/users` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:50.037676 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd60167-0c87-4c25-a97f-3d2d3fecbca1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:50.039813 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd60167-0c87-4c25-a97f-3d2d3fecbca1 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:50.065921 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1071/2147] 10.222.0.117 () {60 vars in 1148 bytes} [Tue Jan 25 02:36:49 2022] POST /identity/v3/users => generated 289 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 02:36:50.070263 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7b26ac-b400-4c2a-be76-d4034ec39cd7 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:50.080246 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7b26ac-b400-4c2a-be76-d4034ec39cd7 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:50.085440 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb62cb91-80c2-4b23-af7b-5cc9fa2e60ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:50.086105 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb62cb91-80c2-4b23-af7b-5cc9fa2e60ef admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:50.086574 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb62cb91-80c2-4b23-af7b-5cc9fa2e60ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:50.086574 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb62cb91-80c2-4b23-af7b-5cc9fa2e60ef admin admin] PATH_INFO: `/v3/roles` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:50.088838 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb62cb91-80c2-4b23-af7b-5cc9fa2e60ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:50.090483 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb62cb91-80c2-4b23-af7b-5cc9fa2e60ef admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:50.105637 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1077/2148] 10.222.0.117 () {58 vars in 1126 bytes} [Tue Jan 25 02:36:50 2022] GET /identity/v3/roles => generated 1427 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 02:36:50.109236 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd60167-0c87-4c25-a97f-3d2d3fecbca1 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:50.120209 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd60167-0c87-4c25-a97f-3d2d3fecbca1 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:50.125286 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e586648-0218-47b7-b040-17ea44598622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:50.126477 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e586648-0218-47b7-b040-17ea44598622 admin admin] REQUEST_METHOD: `PUT` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:50.126820 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e586648-0218-47b7-b040-17ea44598622 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:50.127172 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e586648-0218-47b7-b040-17ea44598622 admin admin] PATH_INFO: `/v3/projects/5201c6082cc14ae6864b939d01c0e716/users/f7238422b342445d8484a10eb9fa6072/roles/d8dbc6d83d9d41d28c3feb8b3485b291` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:50.148815 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e586648-0218-47b7-b040-17ea44598622 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5201c6082cc14ae6864b939d01c0e716, user_id=f7238422b342445d8484a10eb9fa6072, role_id=d8dbc6d83d9d41d28c3feb8b3485b291)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:50.151986 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e586648-0218-47b7-b040-17ea44598622 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:50.167987 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1072/2149] 10.222.0.117 () {60 vars in 1487 bytes} [Tue Jan 25 02:36:50 2022] PUT /identity/v3/projects/5201c6082cc14ae6864b939d01c0e716/users/f7238422b342445d8484a10eb9fa6072/roles/d8dbc6d83d9d41d28c3feb8b3485b291 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:36:50.172126 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb62cb91-80c2-4b23-af7b-5cc9fa2e60ef admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:50.194765 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb62cb91-80c2-4b23-af7b-5cc9fa2e60ef admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:50.264495 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc611647-4665-4c3e-90d6-69dadfc3a4f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:50.265506 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc611647-4665-4c3e-90d6-69dadfc3a4f0 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:50.266486 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc611647-4665-4c3e-90d6-69dadfc3a4f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:50.267073 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc611647-4665-4c3e-90d6-69dadfc3a4f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:50.268154 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc611647-4665-4c3e-90d6-69dadfc3a4f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:50.270060 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc611647-4665-4c3e-90d6-69dadfc3a4f0 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:50.285446 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1078/2150] 10.222.0.117 () {58 vars in 1126 bytes} [Tue Jan 25 02:36:50 2022] GET /identity/v3/roles => generated 1427 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 02:36:50.291052 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e586648-0218-47b7-b040-17ea44598622 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:50.302159 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e586648-0218-47b7-b040-17ea44598622 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:50.308217 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3718d91-f037-4ce3-a45a-7e66afc48a45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:50.309436 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3718d91-f037-4ce3-a45a-7e66afc48a45 admin admin] REQUEST_METHOD: `PUT` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:50.309857 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3718d91-f037-4ce3-a45a-7e66afc48a45 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:50.310260 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3718d91-f037-4ce3-a45a-7e66afc48a45 admin admin] PATH_INFO: `/v3/projects/5201c6082cc14ae6864b939d01c0e716/users/f7238422b342445d8484a10eb9fa6072/roles/d8dbc6d83d9d41d28c3feb8b3485b291` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:50.312665 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3718d91-f037-4ce3-a45a-7e66afc48a45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5201c6082cc14ae6864b939d01c0e716, user_id=f7238422b342445d8484a10eb9fa6072, role_id=d8dbc6d83d9d41d28c3feb8b3485b291)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:50.315541 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3718d91-f037-4ce3-a45a-7e66afc48a45 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:50.351169 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1073/2151] 10.222.0.117 () {60 vars in 1487 bytes} [Tue Jan 25 02:36:50 2022] PUT /identity/v3/projects/5201c6082cc14ae6864b939d01c0e716/users/f7238422b342445d8484a10eb9fa6072/roles/d8dbc6d83d9d41d28c3feb8b3485b291 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 25 02:36:50.353734 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cdbd77-1411-4ddb-a3f9-114d57433c5e None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:50.354104 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cdbd77-1411-4ddb-a3f9-114d57433c5e None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:50.354385 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cdbd77-1411-4ddb-a3f9-114d57433c5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:50.390082 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-96cdbd77-1411-4ddb-a3f9-114d57433c5e None None] MFA Rules not processed for user `f7238422b342445d8484a10eb9fa6072`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:36:50.391623 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-96cdbd77-1411-4ddb-a3f9-114d57433c5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:36:50.466988 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1079/2152] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:36:50 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:36:50.478091 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3718d91-f037-4ce3-a45a-7e66afc48a45 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:50.479984 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-c3718d91-f037-4ce3-a45a-7e66afc48a45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:36:50.549104 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3718d91-f037-4ce3-a45a-7e66afc48a45 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:50.554222 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5869a6-5553-4b7e-805c-13455c904b67 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cc5249aea09430080e232cf17757f86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:50.554982 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5869a6-5553-4b7e-805c-13455c904b67 service cinder] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:50.555326 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5869a6-5553-4b7e-805c-13455c904b67 service cinder] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:50.555659 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5869a6-5553-4b7e-805c-13455c904b67 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:50.566301 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5869a6-5553-4b7e-805c-13455c904b67 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:50.568751 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5869a6-5553-4b7e-805c-13455c904b67 service cinder] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:50.581549 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1074/2153] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:36:50 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:36:50.734905 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cdbd77-1411-4ddb-a3f9-114d57433c5e None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:36:50.748219 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cdbd77-1411-4ddb-a3f9-114d57433c5e None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:36:50.752661 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53f98aa-0caa-4717-b111-a1e16356b4ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cc5249aea09430080e232cf17757f86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:36:50.753905 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53f98aa-0caa-4717-b111-a1e16356b4ca service cinder] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:36:50.758517 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53f98aa-0caa-4717-b111-a1e16356b4ca service cinder] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:36:50.758819 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53f98aa-0caa-4717-b111-a1e16356b4ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:36:50.841641 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53f98aa-0caa-4717-b111-a1e16356b4ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:36:50.843009 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53f98aa-0caa-4717-b111-a1e16356b4ca service cinder] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:36:50.862481 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1080/2154] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:36:50 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:37:06.744796 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5869a6-5553-4b7e-805c-13455c904b67 service cinder] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:37:06.819047 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5869a6-5553-4b7e-805c-13455c904b67 service cinder] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:37:06.823926 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3feef2e8-439c-4f05-9ccb-0021e9406cbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:37:06.824827 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feef2e8-439c-4f05-9ccb-0021e9406cbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:37:06.825100 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feef2e8-439c-4f05-9ccb-0021e9406cbc admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:37:06.825379 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feef2e8-439c-4f05-9ccb-0021e9406cbc admin admin] PATH_INFO: `/v3/users/465b566d4f274c12b31eb58528797109` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:37:06.826602 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3feef2e8-439c-4f05-9ccb-0021e9406cbc admin admin] RBAC: Authorizing `identity:delete_user(user_id=465b566d4f274c12b31eb58528797109)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:37:06.828613 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3feef2e8-439c-4f05-9ccb-0021e9406cbc admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:37:06.888503 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-3feef2e8-439c-4f05-9ccb-0021e9406cbc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '465b566d4f274c12b31eb58528797109'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:37:06.902817 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-3feef2e8-439c-4f05-9ccb-0021e9406cbc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '465b566d4f274c12b31eb58528797109'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:37:06.903949 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-3feef2e8-439c-4f05-9ccb-0021e9406cbc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '465b566d4f274c12b31eb58528797109'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:37:06.904758 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-3feef2e8-439c-4f05-9ccb-0021e9406cbc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '465b566d4f274c12b31eb58528797109'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:37:06.921914 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-3feef2e8-439c-4f05-9ccb-0021e9406cbc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '465b566d4f274c12b31eb58528797109'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:37:06.934475 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1075/2155] 10.222.0.117 () {58 vars in 1228 bytes} [Tue Jan 25 02:37:06 2022] DELETE /identity/v3/users/465b566d4f274c12b31eb58528797109 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:37:06.939052 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed555ec-81ab-47b9-b6ec-98c68d179bf8 None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:37:06.939563 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed555ec-81ab-47b9-b6ec-98c68d179bf8 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:37:06.939644 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed555ec-81ab-47b9-b6ec-98c68d179bf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:37:06.956867 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-7ed555ec-81ab-47b9-b6ec-98c68d179bf8 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:37:06.958971 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-7ed555ec-81ab-47b9-b6ec-98c68d179bf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:37:07.021924 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1081/2156] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:37:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:37:07.031814 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3feef2e8-439c-4f05-9ccb-0021e9406cbc admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:37:07.033300 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-3feef2e8-439c-4f05-9ccb-0021e9406cbc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:37:07.090356 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3feef2e8-439c-4f05-9ccb-0021e9406cbc admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:37:07.093972 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c073db2f-2599-4e00-804a-d8cc18094cf0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca4071c5f8f4a31b5edb81fa66a43a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:37:07.094613 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c073db2f-2599-4e00-804a-d8cc18094cf0 service neutron] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:37:07.094906 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c073db2f-2599-4e00-804a-d8cc18094cf0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:37:07.095171 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c073db2f-2599-4e00-804a-d8cc18094cf0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:37:07.104563 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c073db2f-2599-4e00-804a-d8cc18094cf0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:37:07.106001 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c073db2f-2599-4e00-804a-d8cc18094cf0 service neutron] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:37:07.115242 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1076/2157] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:37:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:37:07.451178 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed555ec-81ab-47b9-b6ec-98c68d179bf8 None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:37:07.452610 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-7ed555ec-81ab-47b9-b6ec-98c68d179bf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:37:07.466801 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed555ec-81ab-47b9-b6ec-98c68d179bf8 None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:37:07.471552 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca43f56-8958-446c-8705-01f8b2c160ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:37:07.473147 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca43f56-8958-446c-8705-01f8b2c160ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:37:07.473377 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca43f56-8958-446c-8705-01f8b2c160ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:37:07.473592 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca43f56-8958-446c-8705-01f8b2c160ab admin admin] PATH_INFO: `/v3/projects/21aad0792bdc48aaaa2d3866be30d289` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:37:07.474847 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca43f56-8958-446c-8705-01f8b2c160ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=21aad0792bdc48aaaa2d3866be30d289)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:37:07.476763 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca43f56-8958-446c-8705-01f8b2c160ab admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:37:07.528560 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-6ca43f56-8958-446c-8705-01f8b2c160ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21aad0792bdc48aaaa2d3866be30d289', 'request_id': 'req-6ca43f56-8958-446c-8705-01f8b2c160ab'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:37:07.535996 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-6ca43f56-8958-446c-8705-01f8b2c160ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21aad0792bdc48aaaa2d3866be30d289', 'request_id': 'req-6ca43f56-8958-446c-8705-01f8b2c160ab'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:37:07.545865 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-6ca43f56-8958-446c-8705-01f8b2c160ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21aad0792bdc48aaaa2d3866be30d289', 'request_id': 'req-6ca43f56-8958-446c-8705-01f8b2c160ab'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:37:07.557484 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-6ca43f56-8958-446c-8705-01f8b2c160ab admin admin] The token cache is being invalidate because project 21aad0792bdc48aaaa2d3866be30d289 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79121) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 25 02:37:07.557769 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-6ca43f56-8958-446c-8705-01f8b2c160ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:37:07.558441 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-6ca43f56-8958-446c-8705-01f8b2c160ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:37:07.560065 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1082/2158] 10.222.0.117 () {58 vars in 1237 bytes} [Tue Jan 25 02:37:07 2022] DELETE /identity/v3/projects/21aad0792bdc48aaaa2d3866be30d289 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:37:07.564024 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c073db2f-2599-4e00-804a-d8cc18094cf0 service neutron] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:37:07.573828 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c073db2f-2599-4e00-804a-d8cc18094cf0 service neutron] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:37:07.630732 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fff7cf0-9a01-431b-b263-9a54b88b0ba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:37:07.631599 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fff7cf0-9a01-431b-b263-9a54b88b0ba5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:37:07.631915 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fff7cf0-9a01-431b-b263-9a54b88b0ba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:37:07.632194 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fff7cf0-9a01-431b-b263-9a54b88b0ba5 admin admin] PATH_INFO: `/v3/users/f7238422b342445d8484a10eb9fa6072` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:37:07.633399 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fff7cf0-9a01-431b-b263-9a54b88b0ba5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7238422b342445d8484a10eb9fa6072)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:37:07.635369 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fff7cf0-9a01-431b-b263-9a54b88b0ba5 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:37:07.680726 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-4fff7cf0-9a01-431b-b263-9a54b88b0ba5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7238422b342445d8484a10eb9fa6072'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:37:07.687612 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-4fff7cf0-9a01-431b-b263-9a54b88b0ba5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7238422b342445d8484a10eb9fa6072'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:37:07.688267 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-4fff7cf0-9a01-431b-b263-9a54b88b0ba5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7238422b342445d8484a10eb9fa6072'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:37:07.688882 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-4fff7cf0-9a01-431b-b263-9a54b88b0ba5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7238422b342445d8484a10eb9fa6072'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:37:07.700449 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-4fff7cf0-9a01-431b-b263-9a54b88b0ba5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7238422b342445d8484a10eb9fa6072'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:37:07.712982 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1077/2159] 10.222.0.117 () {58 vars in 1228 bytes} [Tue Jan 25 02:37:07 2022] DELETE /identity/v3/users/f7238422b342445d8484a10eb9fa6072 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 25 02:37:08.025995 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca43f56-8958-446c-8705-01f8b2c160ab admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:37:08.027522 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-6ca43f56-8958-446c-8705-01f8b2c160ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:37:08.041328 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca43f56-8958-446c-8705-01f8b2c160ab admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:37:08.114306 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052f8de7-c637-4fa3-a7d0-b5da1dc4bea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:37:08.115323 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052f8de7-c637-4fa3-a7d0-b5da1dc4bea6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:37:08.115810 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052f8de7-c637-4fa3-a7d0-b5da1dc4bea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:37:08.116249 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052f8de7-c637-4fa3-a7d0-b5da1dc4bea6 admin admin] PATH_INFO: `/v3/projects/5201c6082cc14ae6864b939d01c0e716` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:37:08.117472 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052f8de7-c637-4fa3-a7d0-b5da1dc4bea6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5201c6082cc14ae6864b939d01c0e716)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:37:08.119473 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052f8de7-c637-4fa3-a7d0-b5da1dc4bea6 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:37:08.171057 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-052f8de7-c637-4fa3-a7d0-b5da1dc4bea6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5201c6082cc14ae6864b939d01c0e716', 'request_id': 'req-052f8de7-c637-4fa3-a7d0-b5da1dc4bea6'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:37:08.177238 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-052f8de7-c637-4fa3-a7d0-b5da1dc4bea6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5201c6082cc14ae6864b939d01c0e716', 'request_id': 'req-052f8de7-c637-4fa3-a7d0-b5da1dc4bea6'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:37:08.185716 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-052f8de7-c637-4fa3-a7d0-b5da1dc4bea6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5201c6082cc14ae6864b939d01c0e716', 'request_id': 'req-052f8de7-c637-4fa3-a7d0-b5da1dc4bea6'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:37:08.198284 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-052f8de7-c637-4fa3-a7d0-b5da1dc4bea6 admin admin] The token cache is being invalidate because project 5201c6082cc14ae6864b939d01c0e716 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79121) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 25 02:37:08.198576 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-052f8de7-c637-4fa3-a7d0-b5da1dc4bea6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:37:08.199219 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-052f8de7-c637-4fa3-a7d0-b5da1dc4bea6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:37:08.200795 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1083/2160] 10.222.0.117 () {58 vars in 1237 bytes} [Tue Jan 25 02:37:08 2022] DELETE /identity/v3/projects/5201c6082cc14ae6864b939d01c0e716 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:37:08.206918 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd4f56c-c449-41d2-904e-8b4475eadc38 None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:37:08.208429 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd4f56c-c449-41d2-904e-8b4475eadc38 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:37:08.208429 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd4f56c-c449-41d2-904e-8b4475eadc38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:37:08.225693 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-4dd4f56c-c449-41d2-904e-8b4475eadc38 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:37:08.226912 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-4dd4f56c-c449-41d2-904e-8b4475eadc38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:37:08.287485 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1078/2161] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:37:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 25 02:37:08.294956 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd653b8-4064-4ae7-a580-9ea918c5d07c None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:37:08.295251 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd653b8-4064-4ae7-a580-9ea918c5d07c None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:37:08.295532 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd653b8-4064-4ae7-a580-9ea918c5d07c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:37:08.313958 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-6bd653b8-4064-4ae7-a580-9ea918c5d07c None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:37:08.315107 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-6bd653b8-4064-4ae7-a580-9ea918c5d07c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:37:08.323606 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1084/2162] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:37:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:37:08.327677 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd4f56c-c449-41d2-904e-8b4475eadc38 None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:37:08.338132 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd4f56c-c449-41d2-904e-8b4475eadc38 None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:37:08.342650 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997bb42e-9c0f-418b-a6c1-53ff0a1f15be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:37:08.343290 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997bb42e-9c0f-418b-a6c1-53ff0a1f15be admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:37:08.343570 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997bb42e-9c0f-418b-a6c1-53ff0a1f15be admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:37:08.343877 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997bb42e-9c0f-418b-a6c1-53ff0a1f15be admin admin] PATH_INFO: `/v3/domains` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:37:08.344609 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997bb42e-9c0f-418b-a6c1-53ff0a1f15be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:37:08.344909 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997bb42e-9c0f-418b-a6c1-53ff0a1f15be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:37:08.346488 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997bb42e-9c0f-418b-a6c1-53ff0a1f15be admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:37:08.357831 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1079/2163] 10.222.0.117 () {58 vars in 1157 bytes} [Tue Jan 25 02:37:08 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:37:08.361990 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd653b8-4064-4ae7-a580-9ea918c5d07c None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:37:08.371761 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd653b8-4064-4ae7-a580-9ea918c5d07c None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:37:08.376438 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a199b045-dd3d-4878-953f-64ae84ebabeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:37:08.377076 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a199b045-dd3d-4878-953f-64ae84ebabeb admin admin] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:37:08.377358 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a199b045-dd3d-4878-953f-64ae84ebabeb admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:37:08.377632 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a199b045-dd3d-4878-953f-64ae84ebabeb admin admin] PATH_INFO: `/v3/projects` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:37:08.378322 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a199b045-dd3d-4878-953f-64ae84ebabeb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:37:08.380875 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a199b045-dd3d-4878-953f-64ae84ebabeb admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:37:08.411055 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1085/2164] 10.222.0.117 () {60 vars in 1157 bytes} [Tue Jan 25 02:37:08 2022] POST /identity/v3/projects => generated 388 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 02:37:08.412273 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997bb42e-9c0f-418b-a6c1-53ff0a1f15be admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:37:08.422059 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997bb42e-9c0f-418b-a6c1-53ff0a1f15be admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:37:08.485716 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d428a4-6862-43da-878f-f79c52902734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:37:08.486414 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d428a4-6862-43da-878f-f79c52902734 admin admin] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:37:08.486696 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d428a4-6862-43da-878f-f79c52902734 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:37:08.486969 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d428a4-6862-43da-878f-f79c52902734 admin admin] PATH_INFO: `/v3/users` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:37:08.487664 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d428a4-6862-43da-878f-f79c52902734 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:37:08.490023 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d428a4-6862-43da-878f-f79c52902734 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:37:08.510917 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1080/2165] 10.222.0.117 () {60 vars in 1148 bytes} [Tue Jan 25 02:37:08 2022] POST /identity/v3/users => generated 295 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 02:37:08.514994 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a199b045-dd3d-4878-953f-64ae84ebabeb admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:37:08.525745 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a199b045-dd3d-4878-953f-64ae84ebabeb admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:37:08.530650 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910d018d-91db-445b-ac51-53b409b3266e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:37:08.531214 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910d018d-91db-445b-ac51-53b409b3266e admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:37:08.531503 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910d018d-91db-445b-ac51-53b409b3266e admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:37:08.531812 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910d018d-91db-445b-ac51-53b409b3266e admin admin] PATH_INFO: `/v3/roles` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:37:08.532595 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910d018d-91db-445b-ac51-53b409b3266e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:37:08.534195 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910d018d-91db-445b-ac51-53b409b3266e admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:37:08.551861 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1086/2166] 10.222.0.117 () {58 vars in 1126 bytes} [Tue Jan 25 02:37:08 2022] GET /identity/v3/roles => generated 1427 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 25 02:37:08.553886 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d428a4-6862-43da-878f-f79c52902734 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:37:08.567917 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d428a4-6862-43da-878f-f79c52902734 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:37:08.573094 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573b0274-90a2-44a1-8c4f-260f809015ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:37:08.573870 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573b0274-90a2-44a1-8c4f-260f809015ad admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:37:08.574258 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573b0274-90a2-44a1-8c4f-260f809015ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:37:08.574760 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573b0274-90a2-44a1-8c4f-260f809015ad admin admin] PATH_INFO: `/v3/roles` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:37:08.575711 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573b0274-90a2-44a1-8c4f-260f809015ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:37:08.577593 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573b0274-90a2-44a1-8c4f-260f809015ad admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:37:08.591741 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1081/2167] 10.222.0.117 () {58 vars in 1126 bytes} [Tue Jan 25 02:37:08 2022] GET /identity/v3/roles => generated 1427 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 02:37:08.593983 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910d018d-91db-445b-ac51-53b409b3266e admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:37:08.617720 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910d018d-91db-445b-ac51-53b409b3266e admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:37:08.623161 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0326ccbc-1f8f-48e2-a767-8d71bdf5f6b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:37:08.624115 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0326ccbc-1f8f-48e2-a767-8d71bdf5f6b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:37:08.624398 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0326ccbc-1f8f-48e2-a767-8d71bdf5f6b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:37:08.624675 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0326ccbc-1f8f-48e2-a767-8d71bdf5f6b5 admin admin] PATH_INFO: `/v3/projects/4b3368580ae741428b25dfa0ff68cc28/users/32ac1a33c3f940bdbb7f3947c7291800/roles/33a8e87420ed423f9cb29e0084eab5d2` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:37:08.639602 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0326ccbc-1f8f-48e2-a767-8d71bdf5f6b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b3368580ae741428b25dfa0ff68cc28, user_id=32ac1a33c3f940bdbb7f3947c7291800, role_id=33a8e87420ed423f9cb29e0084eab5d2)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:37:08.642303 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0326ccbc-1f8f-48e2-a767-8d71bdf5f6b5 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:37:08.656377 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1087/2168] 10.222.0.117 () {60 vars in 1487 bytes} [Tue Jan 25 02:37:08 2022] PUT /identity/v3/projects/4b3368580ae741428b25dfa0ff68cc28/users/32ac1a33c3f940bdbb7f3947c7291800/roles/33a8e87420ed423f9cb29e0084eab5d2 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:37:08.666998 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74503e59-96ac-43ec-895e-6521ace51743 None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:37:08.667369 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74503e59-96ac-43ec-895e-6521ace51743 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:37:08.667647 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74503e59-96ac-43ec-895e-6521ace51743 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:37:08.696031 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-74503e59-96ac-43ec-895e-6521ace51743 None None] MFA Rules not processed for user `32ac1a33c3f940bdbb7f3947c7291800`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:37:08.697229 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-74503e59-96ac-43ec-895e-6521ace51743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:37:08.778039 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1082/2169] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:37:08 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 25 02:37:08.782484 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0326ccbc-1f8f-48e2-a767-8d71bdf5f6b5 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:37:08.842543 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0326ccbc-1f8f-48e2-a767-8d71bdf5f6b5 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:37:08.847080 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00161a7e-2e13-4da4-9c23-50a1f1b05d9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:37:08.848820 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00161a7e-2e13-4da4-9c23-50a1f1b05d9a admin admin] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:37:08.849103 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00161a7e-2e13-4da4-9c23-50a1f1b05d9a admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:37:08.849379 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00161a7e-2e13-4da4-9c23-50a1f1b05d9a admin admin] PATH_INFO: `/v3/projects` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:37:08.850072 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00161a7e-2e13-4da4-9c23-50a1f1b05d9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:37:08.852005 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00161a7e-2e13-4da4-9c23-50a1f1b05d9a admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:37:08.876917 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1088/2170] 10.222.0.117 () {60 vars in 1157 bytes} [Tue Jan 25 02:37:08 2022] POST /identity/v3/projects => generated 388 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 02:37:08.881869 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74503e59-96ac-43ec-895e-6521ace51743 None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:37:08.892438 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74503e59-96ac-43ec-895e-6521ace51743 None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:37:08.946999 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb38ca7-6351-48ce-bd4c-4c6b04d319a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:37:08.947737 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb38ca7-6351-48ce-bd4c-4c6b04d319a8 admin admin] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:37:08.948029 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb38ca7-6351-48ce-bd4c-4c6b04d319a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:37:08.948307 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb38ca7-6351-48ce-bd4c-4c6b04d319a8 admin admin] PATH_INFO: `/v3/users` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:37:08.949031 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb38ca7-6351-48ce-bd4c-4c6b04d319a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:37:08.950980 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb38ca7-6351-48ce-bd4c-4c6b04d319a8 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:37:08.971313 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1083/2171] 10.222.0.117 () {60 vars in 1148 bytes} [Tue Jan 25 02:37:08 2022] POST /identity/v3/users => generated 301 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 25 02:37:08.975956 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00161a7e-2e13-4da4-9c23-50a1f1b05d9a admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:37:08.986175 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00161a7e-2e13-4da4-9c23-50a1f1b05d9a admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:37:08.991685 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4e8d48-5924-49e6-b802-9b9e86504856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:37:08.992419 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4e8d48-5924-49e6-b802-9b9e86504856 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:37:08.992721 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4e8d48-5924-49e6-b802-9b9e86504856 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:37:08.992976 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4e8d48-5924-49e6-b802-9b9e86504856 admin admin] PATH_INFO: `/v3/roles` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:37:08.993736 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4e8d48-5924-49e6-b802-9b9e86504856 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:37:08.995392 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4e8d48-5924-49e6-b802-9b9e86504856 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:37:09.006646 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1089/2172] 10.222.0.117 () {58 vars in 1126 bytes} [Tue Jan 25 02:37:08 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 02:37:09.010797 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb38ca7-6351-48ce-bd4c-4c6b04d319a8 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:37:09.021709 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb38ca7-6351-48ce-bd4c-4c6b04d319a8 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:37:09.026445 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ff6cb0-df8b-4a7e-bc15-d9a306a05664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:37:09.027353 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ff6cb0-df8b-4a7e-bc15-d9a306a05664 admin admin] REQUEST_METHOD: `PUT` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:37:09.027634 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ff6cb0-df8b-4a7e-bc15-d9a306a05664 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:37:09.027936 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ff6cb0-df8b-4a7e-bc15-d9a306a05664 admin admin] PATH_INFO: `/v3/projects/87ad14ff3e5e45f28d062a1b249c3c6e/users/57011b30d7be4db1882960e8e10b1c41/roles/d8dbc6d83d9d41d28c3feb8b3485b291` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:37:09.042491 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ff6cb0-df8b-4a7e-bc15-d9a306a05664 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87ad14ff3e5e45f28d062a1b249c3c6e, user_id=57011b30d7be4db1882960e8e10b1c41, role_id=d8dbc6d83d9d41d28c3feb8b3485b291)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:37:09.045266 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ff6cb0-df8b-4a7e-bc15-d9a306a05664 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:37:09.063617 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1084/2173] 10.222.0.117 () {60 vars in 1487 bytes} [Tue Jan 25 02:37:09 2022] PUT /identity/v3/projects/87ad14ff3e5e45f28d062a1b249c3c6e/users/57011b30d7be4db1882960e8e10b1c41/roles/d8dbc6d83d9d41d28c3feb8b3485b291 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:37:09.068467 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4e8d48-5924-49e6-b802-9b9e86504856 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:37:09.083085 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4e8d48-5924-49e6-b802-9b9e86504856 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:37:09.144714 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187a3050-c4d3-429d-ad9d-74ef938328ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:37:09.145544 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187a3050-c4d3-429d-ad9d-74ef938328ed admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:37:09.145886 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187a3050-c4d3-429d-ad9d-74ef938328ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:37:09.146199 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187a3050-c4d3-429d-ad9d-74ef938328ed admin admin] PATH_INFO: `/v3/roles` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:37:09.146950 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187a3050-c4d3-429d-ad9d-74ef938328ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:37:09.148598 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187a3050-c4d3-429d-ad9d-74ef938328ed admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:37:09.158915 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1090/2174] 10.222.0.117 () {58 vars in 1126 bytes} [Tue Jan 25 02:37:09 2022] GET /identity/v3/roles => generated 1427 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 25 02:37:09.163003 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ff6cb0-df8b-4a7e-bc15-d9a306a05664 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:37:09.173129 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ff6cb0-df8b-4a7e-bc15-d9a306a05664 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:37:09.178477 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b2c47f-64d1-41dd-be2c-2f618577b5df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:37:09.179346 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b2c47f-64d1-41dd-be2c-2f618577b5df admin admin] REQUEST_METHOD: `PUT` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:37:09.179884 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b2c47f-64d1-41dd-be2c-2f618577b5df admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:37:09.180162 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b2c47f-64d1-41dd-be2c-2f618577b5df admin admin] PATH_INFO: `/v3/projects/87ad14ff3e5e45f28d062a1b249c3c6e/users/57011b30d7be4db1882960e8e10b1c41/roles/d8dbc6d83d9d41d28c3feb8b3485b291` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:37:09.182266 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b2c47f-64d1-41dd-be2c-2f618577b5df admin admin] RBAC: Authorizing `identity:create_grant(project_id=87ad14ff3e5e45f28d062a1b249c3c6e, user_id=57011b30d7be4db1882960e8e10b1c41, role_id=d8dbc6d83d9d41d28c3feb8b3485b291)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:37:09.185001 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b2c47f-64d1-41dd-be2c-2f618577b5df admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:37:09.196283 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1085/2175] 10.222.0.117 () {60 vars in 1487 bytes} [Tue Jan 25 02:37:09 2022] PUT /identity/v3/projects/87ad14ff3e5e45f28d062a1b249c3c6e/users/57011b30d7be4db1882960e8e10b1c41/roles/d8dbc6d83d9d41d28c3feb8b3485b291 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 25 02:37:09.208108 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830379a0-3698-4419-8a9d-8b792e3933ca None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:37:09.208394 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830379a0-3698-4419-8a9d-8b792e3933ca None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:37:09.208674 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830379a0-3698-4419-8a9d-8b792e3933ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:37:09.234840 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-830379a0-3698-4419-8a9d-8b792e3933ca None None] MFA Rules not processed for user `57011b30d7be4db1882960e8e10b1c41`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:37:09.236086 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-830379a0-3698-4419-8a9d-8b792e3933ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:37:09.306060 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1091/2176] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:37:09 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:37:09.315971 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b2c47f-64d1-41dd-be2c-2f618577b5df admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:37:09.318364 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-45b2c47f-64d1-41dd-be2c-2f618577b5df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:37:09.374748 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b2c47f-64d1-41dd-be2c-2f618577b5df admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:37:09.378447 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e018a2a7-318e-4bbc-bcd2-ed75542c4780 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cc5249aea09430080e232cf17757f86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:37:09.379153 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e018a2a7-318e-4bbc-bcd2-ed75542c4780 service cinder] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:37:09.379460 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e018a2a7-318e-4bbc-bcd2-ed75542c4780 service cinder] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:37:09.379664 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e018a2a7-318e-4bbc-bcd2-ed75542c4780 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:37:09.389439 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e018a2a7-318e-4bbc-bcd2-ed75542c4780 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:37:09.390934 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e018a2a7-318e-4bbc-bcd2-ed75542c4780 service cinder] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:37:09.401514 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1086/2177] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:37:09 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:37:09.471634 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830379a0-3698-4419-8a9d-8b792e3933ca None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:37:09.538252 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830379a0-3698-4419-8a9d-8b792e3933ca None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:37:09.542958 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148f856e-2d37-4b83-b357-9cb2fa95b294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:37:09.543860 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148f856e-2d37-4b83-b357-9cb2fa95b294 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:37:09.544150 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148f856e-2d37-4b83-b357-9cb2fa95b294 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:37:09.544428 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148f856e-2d37-4b83-b357-9cb2fa95b294 admin admin] PATH_INFO: `/v3/users/32ac1a33c3f940bdbb7f3947c7291800` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:37:09.545640 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148f856e-2d37-4b83-b357-9cb2fa95b294 admin admin] RBAC: Authorizing `identity:delete_user(user_id=32ac1a33c3f940bdbb7f3947c7291800)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:37:09.547574 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148f856e-2d37-4b83-b357-9cb2fa95b294 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:37:09.599793 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-148f856e-2d37-4b83-b357-9cb2fa95b294 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32ac1a33c3f940bdbb7f3947c7291800'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:37:09.600495 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-148f856e-2d37-4b83-b357-9cb2fa95b294 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32ac1a33c3f940bdbb7f3947c7291800'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:37:09.607373 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-148f856e-2d37-4b83-b357-9cb2fa95b294 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32ac1a33c3f940bdbb7f3947c7291800'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:37:09.608106 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-148f856e-2d37-4b83-b357-9cb2fa95b294 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32ac1a33c3f940bdbb7f3947c7291800'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:37:09.617759 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-148f856e-2d37-4b83-b357-9cb2fa95b294 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32ac1a33c3f940bdbb7f3947c7291800'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:37:09.639818 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1092/2178] 10.222.0.117 () {58 vars in 1228 bytes} [Tue Jan 25 02:37:09 2022] DELETE /identity/v3/users/32ac1a33c3f940bdbb7f3947c7291800 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:37:09.641740 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cd3d99-3b09-4989-add8-9ef9c3f0b10d None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:37:09.642035 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cd3d99-3b09-4989-add8-9ef9c3f0b10d None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:37:09.642392 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cd3d99-3b09-4989-add8-9ef9c3f0b10d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:37:09.661450 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-46cd3d99-3b09-4989-add8-9ef9c3f0b10d None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:37:09.662650 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-46cd3d99-3b09-4989-add8-9ef9c3f0b10d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:37:09.721099 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1087/2179] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:37:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:37:09.731829 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148f856e-2d37-4b83-b357-9cb2fa95b294 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:37:09.733305 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-148f856e-2d37-4b83-b357-9cb2fa95b294 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:37:09.791011 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148f856e-2d37-4b83-b357-9cb2fa95b294 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:37:09.794638 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123b4b8d-c8ed-4ba0-b167-0768e9a0fc85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca4071c5f8f4a31b5edb81fa66a43a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:37:09.795288 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123b4b8d-c8ed-4ba0-b167-0768e9a0fc85 service neutron] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:37:09.795571 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123b4b8d-c8ed-4ba0-b167-0768e9a0fc85 service neutron] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:37:09.795880 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123b4b8d-c8ed-4ba0-b167-0768e9a0fc85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:37:09.805635 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123b4b8d-c8ed-4ba0-b167-0768e9a0fc85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:37:09.807094 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123b4b8d-c8ed-4ba0-b167-0768e9a0fc85 service neutron] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:37:09.817101 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1093/2180] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:37:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:37:10.111319 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cd3d99-3b09-4989-add8-9ef9c3f0b10d None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:37:10.112798 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-46cd3d99-3b09-4989-add8-9ef9c3f0b10d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:37:10.125635 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cd3d99-3b09-4989-add8-9ef9c3f0b10d None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:37:10.130547 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe25ba5f-035a-4e7a-abde-5d71a5962c5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:37:10.131415 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe25ba5f-035a-4e7a-abde-5d71a5962c5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:37:10.131781 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe25ba5f-035a-4e7a-abde-5d71a5962c5d admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:37:10.132016 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe25ba5f-035a-4e7a-abde-5d71a5962c5d admin admin] PATH_INFO: `/v3/projects/4b3368580ae741428b25dfa0ff68cc28` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:37:10.133347 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe25ba5f-035a-4e7a-abde-5d71a5962c5d admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b3368580ae741428b25dfa0ff68cc28)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:37:10.135282 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe25ba5f-035a-4e7a-abde-5d71a5962c5d admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:37:10.181664 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-fe25ba5f-035a-4e7a-abde-5d71a5962c5d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b3368580ae741428b25dfa0ff68cc28', 'request_id': 'req-fe25ba5f-035a-4e7a-abde-5d71a5962c5d'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:37:10.186814 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-fe25ba5f-035a-4e7a-abde-5d71a5962c5d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b3368580ae741428b25dfa0ff68cc28', 'request_id': 'req-fe25ba5f-035a-4e7a-abde-5d71a5962c5d'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:37:10.192826 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-fe25ba5f-035a-4e7a-abde-5d71a5962c5d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b3368580ae741428b25dfa0ff68cc28', 'request_id': 'req-fe25ba5f-035a-4e7a-abde-5d71a5962c5d'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:37:10.204723 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-fe25ba5f-035a-4e7a-abde-5d71a5962c5d admin admin] The token cache is being invalidate because project 4b3368580ae741428b25dfa0ff68cc28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79120) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 25 02:37:10.205010 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-fe25ba5f-035a-4e7a-abde-5d71a5962c5d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:37:10.205629 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-fe25ba5f-035a-4e7a-abde-5d71a5962c5d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:37:10.207979 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1088/2181] 10.222.0.117 () {58 vars in 1237 bytes} [Tue Jan 25 02:37:10 2022] DELETE /identity/v3/projects/4b3368580ae741428b25dfa0ff68cc28 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:37:10.212101 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123b4b8d-c8ed-4ba0-b167-0768e9a0fc85 service neutron] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:37:10.221639 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123b4b8d-c8ed-4ba0-b167-0768e9a0fc85 service neutron] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:37:10.278832 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e560d0-7784-4f60-8f1a-e2b61b2ac95d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:37:10.279832 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e560d0-7784-4f60-8f1a-e2b61b2ac95d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:37:10.280204 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e560d0-7784-4f60-8f1a-e2b61b2ac95d admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:37:10.280369 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e560d0-7784-4f60-8f1a-e2b61b2ac95d admin admin] PATH_INFO: `/v3/users/57011b30d7be4db1882960e8e10b1c41` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:37:10.281567 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e560d0-7784-4f60-8f1a-e2b61b2ac95d admin admin] RBAC: Authorizing `identity:delete_user(user_id=57011b30d7be4db1882960e8e10b1c41)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:37:10.283479 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e560d0-7784-4f60-8f1a-e2b61b2ac95d admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:37:10.330762 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-d9e560d0-7784-4f60-8f1a-e2b61b2ac95d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57011b30d7be4db1882960e8e10b1c41'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:37:10.331410 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-d9e560d0-7784-4f60-8f1a-e2b61b2ac95d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57011b30d7be4db1882960e8e10b1c41'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:37:10.339049 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-d9e560d0-7784-4f60-8f1a-e2b61b2ac95d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57011b30d7be4db1882960e8e10b1c41'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:37:10.339716 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-d9e560d0-7784-4f60-8f1a-e2b61b2ac95d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57011b30d7be4db1882960e8e10b1c41'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:37:10.348191 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-d9e560d0-7784-4f60-8f1a-e2b61b2ac95d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57011b30d7be4db1882960e8e10b1c41'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:37:10.365532 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1094/2182] 10.222.0.117 () {58 vars in 1228 bytes} [Tue Jan 25 02:37:10 2022] DELETE /identity/v3/users/57011b30d7be4db1882960e8e10b1c41 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:37:10.838217 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe25ba5f-035a-4e7a-abde-5d71a5962c5d admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:37:10.839774 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-fe25ba5f-035a-4e7a-abde-5d71a5962c5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:37:10.854949 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe25ba5f-035a-4e7a-abde-5d71a5962c5d admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:37:10.917877 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4480479c-bcfc-41ea-bde0-39279235fc16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:37:10.918742 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4480479c-bcfc-41ea-bde0-39279235fc16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:37:10.919023 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4480479c-bcfc-41ea-bde0-39279235fc16 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:37:10.919295 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4480479c-bcfc-41ea-bde0-39279235fc16 admin admin] PATH_INFO: `/v3/projects/87ad14ff3e5e45f28d062a1b249c3c6e` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:37:10.920578 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4480479c-bcfc-41ea-bde0-39279235fc16 admin admin] RBAC: Authorizing `identity:delete_project(project_id=87ad14ff3e5e45f28d062a1b249c3c6e)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:37:10.922490 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4480479c-bcfc-41ea-bde0-39279235fc16 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:37:10.969046 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-4480479c-bcfc-41ea-bde0-39279235fc16 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87ad14ff3e5e45f28d062a1b249c3c6e', 'request_id': 'req-4480479c-bcfc-41ea-bde0-39279235fc16'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:37:10.975591 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-4480479c-bcfc-41ea-bde0-39279235fc16 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87ad14ff3e5e45f28d062a1b249c3c6e', 'request_id': 'req-4480479c-bcfc-41ea-bde0-39279235fc16'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:37:10.981959 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-4480479c-bcfc-41ea-bde0-39279235fc16 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87ad14ff3e5e45f28d062a1b249c3c6e', 'request_id': 'req-4480479c-bcfc-41ea-bde0-39279235fc16'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:37:11.010044 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-4480479c-bcfc-41ea-bde0-39279235fc16 admin admin] The token cache is being invalidate because project 87ad14ff3e5e45f28d062a1b249c3c6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79120) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 25 02:37:11.010473 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-4480479c-bcfc-41ea-bde0-39279235fc16 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:37:11.011140 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-4480479c-bcfc-41ea-bde0-39279235fc16 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:37:11.012877 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1089/2183] 10.222.0.117 () {58 vars in 1237 bytes} [Tue Jan 25 02:37:10 2022] DELETE /identity/v3/projects/87ad14ff3e5e45f28d062a1b249c3c6e => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:37:11.018632 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f34329-7678-4ce3-a48d-bae6080b4bd8 None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:37:11.019003 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f34329-7678-4ce3-a48d-bae6080b4bd8 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:37:11.019383 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f34329-7678-4ce3-a48d-bae6080b4bd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:37:11.038451 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-14f34329-7678-4ce3-a48d-bae6080b4bd8 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:37:11.039659 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-14f34329-7678-4ce3-a48d-bae6080b4bd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:37:11.106562 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1095/2184] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:37:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 25 02:37:11.108319 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021d6c24-361b-4deb-bf55-615d88f0c177 None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:37:11.108605 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021d6c24-361b-4deb-bf55-615d88f0c177 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:37:11.108879 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021d6c24-361b-4deb-bf55-615d88f0c177 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:37:11.130013 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-021d6c24-361b-4deb-bf55-615d88f0c177 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:37:11.130880 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-021d6c24-361b-4deb-bf55-615d88f0c177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:37:11.153239 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1090/2185] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:37:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 25 02:37:11.154971 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f34329-7678-4ce3-a48d-bae6080b4bd8 None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:37:11.165370 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f34329-7678-4ce3-a48d-bae6080b4bd8 None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:37:11.170658 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6444143b-ea5c-489a-9896-aed835bc4bdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:37:11.171385 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6444143b-ea5c-489a-9896-aed835bc4bdc admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:37:11.171671 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6444143b-ea5c-489a-9896-aed835bc4bdc admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:37:11.172123 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6444143b-ea5c-489a-9896-aed835bc4bdc admin admin] PATH_INFO: `/v3/domains` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:37:11.172860 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6444143b-ea5c-489a-9896-aed835bc4bdc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:37:11.173169 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6444143b-ea5c-489a-9896-aed835bc4bdc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:37:11.174792 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6444143b-ea5c-489a-9896-aed835bc4bdc admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:37:11.187612 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1096/2186] 10.222.0.117 () {58 vars in 1157 bytes} [Tue Jan 25 02:37:11 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 02:37:11.193878 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021d6c24-361b-4deb-bf55-615d88f0c177 None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:37:11.203515 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021d6c24-361b-4deb-bf55-615d88f0c177 None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:37:11.209598 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b35a7e8-38e7-4071-8555-ae2e49b17271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:37:11.210340 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b35a7e8-38e7-4071-8555-ae2e49b17271 admin admin] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:37:11.210703 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b35a7e8-38e7-4071-8555-ae2e49b17271 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:37:11.210978 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b35a7e8-38e7-4071-8555-ae2e49b17271 admin admin] PATH_INFO: `/v3/projects` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:37:11.211912 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b35a7e8-38e7-4071-8555-ae2e49b17271 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:37:11.213832 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b35a7e8-38e7-4071-8555-ae2e49b17271 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:37:11.246884 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1091/2187] 10.222.0.117 () {60 vars in 1157 bytes} [Tue Jan 25 02:37:11 2022] POST /identity/v3/projects => generated 386 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 25 02:37:11.253468 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6444143b-ea5c-489a-9896-aed835bc4bdc admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:37:11.265536 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6444143b-ea5c-489a-9896-aed835bc4bdc admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:37:11.326010 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c4d707-0156-4014-be40-ac492a06780c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:37:11.326680 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c4d707-0156-4014-be40-ac492a06780c admin admin] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:37:11.326967 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c4d707-0156-4014-be40-ac492a06780c admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:37:11.327244 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c4d707-0156-4014-be40-ac492a06780c admin admin] PATH_INFO: `/v3/users` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:37:11.327984 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c4d707-0156-4014-be40-ac492a06780c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:37:11.329919 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c4d707-0156-4014-be40-ac492a06780c admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:37:11.350580 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1097/2188] 10.222.0.117 () {60 vars in 1148 bytes} [Tue Jan 25 02:37:11 2022] POST /identity/v3/users => generated 294 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 25 02:37:11.354914 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b35a7e8-38e7-4071-8555-ae2e49b17271 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:37:11.367060 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b35a7e8-38e7-4071-8555-ae2e49b17271 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:37:11.372012 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc43278-9039-4229-b96c-eecbfb402594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:37:11.372671 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc43278-9039-4229-b96c-eecbfb402594 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:37:11.372963 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc43278-9039-4229-b96c-eecbfb402594 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:37:11.373244 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc43278-9039-4229-b96c-eecbfb402594 admin admin] PATH_INFO: `/v3/roles` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:37:11.373990 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc43278-9039-4229-b96c-eecbfb402594 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:37:11.375662 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc43278-9039-4229-b96c-eecbfb402594 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:37:11.386842 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1092/2189] 10.222.0.117 () {58 vars in 1126 bytes} [Tue Jan 25 02:37:11 2022] GET /identity/v3/roles => generated 1427 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 02:37:11.390905 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c4d707-0156-4014-be40-ac492a06780c admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:37:11.401502 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c4d707-0156-4014-be40-ac492a06780c admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:37:11.406176 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44808937-fda5-4bbc-b1ba-a908bba936a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:37:11.406817 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44808937-fda5-4bbc-b1ba-a908bba936a5 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:37:11.407103 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44808937-fda5-4bbc-b1ba-a908bba936a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:37:11.407383 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44808937-fda5-4bbc-b1ba-a908bba936a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:37:11.408177 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44808937-fda5-4bbc-b1ba-a908bba936a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:37:11.409784 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44808937-fda5-4bbc-b1ba-a908bba936a5 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:37:11.420220 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1098/2190] 10.222.0.117 () {58 vars in 1126 bytes} [Tue Jan 25 02:37:11 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 02:37:11.424440 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc43278-9039-4229-b96c-eecbfb402594 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:37:11.434399 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc43278-9039-4229-b96c-eecbfb402594 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:37:11.439098 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb4b662-6dda-4752-9287-e4ce4980699f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:37:11.440688 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb4b662-6dda-4752-9287-e4ce4980699f admin admin] REQUEST_METHOD: `PUT` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:37:11.441213 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb4b662-6dda-4752-9287-e4ce4980699f admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:37:11.441493 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb4b662-6dda-4752-9287-e4ce4980699f admin admin] PATH_INFO: `/v3/projects/d370a525a73b403d91c188fed02e9e71/users/45e06e0cbc1748848b7ae3d89254a382/roles/33a8e87420ed423f9cb29e0084eab5d2` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:37:11.459010 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb4b662-6dda-4752-9287-e4ce4980699f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d370a525a73b403d91c188fed02e9e71, user_id=45e06e0cbc1748848b7ae3d89254a382, role_id=33a8e87420ed423f9cb29e0084eab5d2)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:37:11.459010 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb4b662-6dda-4752-9287-e4ce4980699f admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:37:11.503685 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1093/2191] 10.222.0.117 () {60 vars in 1487 bytes} [Tue Jan 25 02:37:11 2022] PUT /identity/v3/projects/d370a525a73b403d91c188fed02e9e71/users/45e06e0cbc1748848b7ae3d89254a382/roles/33a8e87420ed423f9cb29e0084eab5d2 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 25 02:37:11.508314 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67af92b7-9c3e-4d09-8e0b-db7baf055886 None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:37:11.508765 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67af92b7-9c3e-4d09-8e0b-db7baf055886 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:37:11.509229 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67af92b7-9c3e-4d09-8e0b-db7baf055886 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:37:11.552611 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-67af92b7-9c3e-4d09-8e0b-db7baf055886 None None] MFA Rules not processed for user `45e06e0cbc1748848b7ae3d89254a382`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:37:11.553880 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-67af92b7-9c3e-4d09-8e0b-db7baf055886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:37:11.623105 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1099/2192] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:37:11 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:37:11.627554 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb4b662-6dda-4752-9287-e4ce4980699f admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:37:11.689373 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb4b662-6dda-4752-9287-e4ce4980699f admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:37:11.694700 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a53c0d-bc88-4592-a4ac-e8f2dce5c31b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:37:11.695360 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a53c0d-bc88-4592-a4ac-e8f2dce5c31b admin admin] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:37:11.695647 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a53c0d-bc88-4592-a4ac-e8f2dce5c31b admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:37:11.695955 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a53c0d-bc88-4592-a4ac-e8f2dce5c31b admin admin] PATH_INFO: `/v3/projects` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:37:11.696661 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a53c0d-bc88-4592-a4ac-e8f2dce5c31b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:37:11.698567 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a53c0d-bc88-4592-a4ac-e8f2dce5c31b admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:37:11.733417 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1094/2193] 10.222.0.117 () {60 vars in 1157 bytes} [Tue Jan 25 02:37:11 2022] POST /identity/v3/projects => generated 388 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 02:37:11.734629 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67af92b7-9c3e-4d09-8e0b-db7baf055886 None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:37:11.747462 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67af92b7-9c3e-4d09-8e0b-db7baf055886 None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:37:11.805244 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c962bbde-705f-4a65-ac9f-3354e0fb0696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:37:11.805919 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c962bbde-705f-4a65-ac9f-3354e0fb0696 admin admin] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:37:11.806202 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c962bbde-705f-4a65-ac9f-3354e0fb0696 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:37:11.806474 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c962bbde-705f-4a65-ac9f-3354e0fb0696 admin admin] PATH_INFO: `/v3/users` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:37:11.807177 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c962bbde-705f-4a65-ac9f-3354e0fb0696 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:37:11.809138 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c962bbde-705f-4a65-ac9f-3354e0fb0696 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:37:11.830080 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1100/2194] 10.222.0.117 () {60 vars in 1148 bytes} [Tue Jan 25 02:37:11 2022] POST /identity/v3/users => generated 295 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 02:37:11.834751 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a53c0d-bc88-4592-a4ac-e8f2dce5c31b admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:37:11.845020 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a53c0d-bc88-4592-a4ac-e8f2dce5c31b admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:37:11.850254 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5348e3-ed5a-4467-ac59-e15d01723003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:37:11.850956 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5348e3-ed5a-4467-ac59-e15d01723003 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:37:11.855657 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5348e3-ed5a-4467-ac59-e15d01723003 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:37:11.856070 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5348e3-ed5a-4467-ac59-e15d01723003 admin admin] PATH_INFO: `/v3/roles` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:37:11.856913 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5348e3-ed5a-4467-ac59-e15d01723003 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:37:11.858560 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5348e3-ed5a-4467-ac59-e15d01723003 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:37:11.870511 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1095/2195] 10.222.0.117 () {58 vars in 1126 bytes} [Tue Jan 25 02:37:11 2022] GET /identity/v3/roles => generated 1427 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 02:37:11.874558 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c962bbde-705f-4a65-ac9f-3354e0fb0696 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:37:11.884986 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c962bbde-705f-4a65-ac9f-3354e0fb0696 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:37:11.889640 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613ee0c7-5591-416c-8fc6-1d9ca378ece7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:37:11.890293 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613ee0c7-5591-416c-8fc6-1d9ca378ece7 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:37:11.890580 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613ee0c7-5591-416c-8fc6-1d9ca378ece7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:37:11.890867 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613ee0c7-5591-416c-8fc6-1d9ca378ece7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:37:11.891611 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613ee0c7-5591-416c-8fc6-1d9ca378ece7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:37:11.893254 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613ee0c7-5591-416c-8fc6-1d9ca378ece7 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:37:11.903499 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1101/2196] 10.222.0.117 () {58 vars in 1126 bytes} [Tue Jan 25 02:37:11 2022] GET /identity/v3/roles => generated 1427 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 02:37:11.907618 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5348e3-ed5a-4467-ac59-e15d01723003 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:37:11.919950 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5348e3-ed5a-4467-ac59-e15d01723003 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:37:11.924625 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2c5286-3fe4-4b79-a35e-526db615bec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:37:11.926303 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2c5286-3fe4-4b79-a35e-526db615bec4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:37:11.926756 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2c5286-3fe4-4b79-a35e-526db615bec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:37:11.927247 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2c5286-3fe4-4b79-a35e-526db615bec4 admin admin] PATH_INFO: `/v3/projects/b5ba90a934ea46528b1ffdedfaef2313/users/7f06bd942cc147ee829abeb3b9609095/roles/33a8e87420ed423f9cb29e0084eab5d2` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:37:11.944290 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2c5286-3fe4-4b79-a35e-526db615bec4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5ba90a934ea46528b1ffdedfaef2313, user_id=7f06bd942cc147ee829abeb3b9609095, role_id=33a8e87420ed423f9cb29e0084eab5d2)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:37:11.946839 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2c5286-3fe4-4b79-a35e-526db615bec4 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:37:11.961327 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1096/2197] 10.222.0.117 () {60 vars in 1487 bytes} [Tue Jan 25 02:37:11 2022] PUT /identity/v3/projects/b5ba90a934ea46528b1ffdedfaef2313/users/7f06bd942cc147ee829abeb3b9609095/roles/33a8e87420ed423f9cb29e0084eab5d2 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:37:11.973090 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e81c57-aec7-4bd6-9579-ac4bac5d1ae2 None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:37:11.973463 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e81c57-aec7-4bd6-9579-ac4bac5d1ae2 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:37:11.973747 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e81c57-aec7-4bd6-9579-ac4bac5d1ae2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:37:12.003313 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-c0e81c57-aec7-4bd6-9579-ac4bac5d1ae2 None None] MFA Rules not processed for user `7f06bd942cc147ee829abeb3b9609095`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:37:12.005214 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-c0e81c57-aec7-4bd6-9579-ac4bac5d1ae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:37:12.072662 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1102/2198] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:37:11 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:37:12.076951 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2c5286-3fe4-4b79-a35e-526db615bec4 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:37:12.144196 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2c5286-3fe4-4b79-a35e-526db615bec4 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:37:12.149532 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b07d835-33c6-4e48-a060-bb360a925bd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:37:12.150208 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b07d835-33c6-4e48-a060-bb360a925bd8 admin admin] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:37:12.150627 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b07d835-33c6-4e48-a060-bb360a925bd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:37:12.150744 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b07d835-33c6-4e48-a060-bb360a925bd8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:37:12.151467 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b07d835-33c6-4e48-a060-bb360a925bd8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:37:12.153418 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b07d835-33c6-4e48-a060-bb360a925bd8 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:37:12.193756 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1097/2199] 10.222.0.117 () {60 vars in 1157 bytes} [Tue Jan 25 02:37:12 2022] POST /identity/v3/projects => generated 388 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 25 02:37:12.197860 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e81c57-aec7-4bd6-9579-ac4bac5d1ae2 None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:37:12.209736 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e81c57-aec7-4bd6-9579-ac4bac5d1ae2 None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:37:12.279230 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da84d79-3fe8-4b06-b37d-34aa2bed9542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:37:12.279952 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da84d79-3fe8-4b06-b37d-34aa2bed9542 admin admin] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:37:12.280241 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da84d79-3fe8-4b06-b37d-34aa2bed9542 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:37:12.280753 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da84d79-3fe8-4b06-b37d-34aa2bed9542 admin admin] PATH_INFO: `/v3/users` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:37:12.281358 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da84d79-3fe8-4b06-b37d-34aa2bed9542 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:37:12.284049 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da84d79-3fe8-4b06-b37d-34aa2bed9542 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:37:12.309288 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1103/2200] 10.222.0.117 () {60 vars in 1148 bytes} [Tue Jan 25 02:37:12 2022] POST /identity/v3/users => generated 301 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 25 02:37:12.315190 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b07d835-33c6-4e48-a060-bb360a925bd8 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:37:12.325649 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b07d835-33c6-4e48-a060-bb360a925bd8 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:37:12.331152 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36737d5-3473-4262-bfd1-a98656b8dc56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:37:12.333461 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36737d5-3473-4262-bfd1-a98656b8dc56 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:37:12.333988 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36737d5-3473-4262-bfd1-a98656b8dc56 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:37:12.334497 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36737d5-3473-4262-bfd1-a98656b8dc56 admin admin] PATH_INFO: `/v3/roles` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:37:12.335371 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36737d5-3473-4262-bfd1-a98656b8dc56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:37:12.336894 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36737d5-3473-4262-bfd1-a98656b8dc56 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:37:12.348841 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1098/2201] 10.222.0.117 () {58 vars in 1126 bytes} [Tue Jan 25 02:37:12 2022] GET /identity/v3/roles => generated 1427 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 02:37:12.353421 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da84d79-3fe8-4b06-b37d-34aa2bed9542 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:37:12.365046 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da84d79-3fe8-4b06-b37d-34aa2bed9542 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:37:12.372786 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b7f1cb-c1c8-47cf-a9ae-2cd4e9548fcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:37:12.373680 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b7f1cb-c1c8-47cf-a9ae-2cd4e9548fcf admin admin] REQUEST_METHOD: `PUT` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:37:12.373961 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b7f1cb-c1c8-47cf-a9ae-2cd4e9548fcf admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:37:12.374234 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b7f1cb-c1c8-47cf-a9ae-2cd4e9548fcf admin admin] PATH_INFO: `/v3/projects/1921322f7cdf437ead1d5605a7c501ab/users/4d0e602a1ec34c0ea33aab6c675b6bdf/roles/d8dbc6d83d9d41d28c3feb8b3485b291` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:37:12.393607 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b7f1cb-c1c8-47cf-a9ae-2cd4e9548fcf admin admin] RBAC: Authorizing `identity:create_grant(project_id=1921322f7cdf437ead1d5605a7c501ab, user_id=4d0e602a1ec34c0ea33aab6c675b6bdf, role_id=d8dbc6d83d9d41d28c3feb8b3485b291)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:37:12.396976 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b7f1cb-c1c8-47cf-a9ae-2cd4e9548fcf admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:37:12.412253 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1104/2202] 10.222.0.117 () {60 vars in 1487 bytes} [Tue Jan 25 02:37:12 2022] PUT /identity/v3/projects/1921322f7cdf437ead1d5605a7c501ab/users/4d0e602a1ec34c0ea33aab6c675b6bdf/roles/d8dbc6d83d9d41d28c3feb8b3485b291 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:37:12.416065 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36737d5-3473-4262-bfd1-a98656b8dc56 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:37:12.429171 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36737d5-3473-4262-bfd1-a98656b8dc56 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:37:12.504217 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fdbe1e-dd32-4d54-b998-22558f25e3f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:37:12.504951 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fdbe1e-dd32-4d54-b998-22558f25e3f4 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:37:12.505242 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fdbe1e-dd32-4d54-b998-22558f25e3f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:37:12.505517 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fdbe1e-dd32-4d54-b998-22558f25e3f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:37:12.506390 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fdbe1e-dd32-4d54-b998-22558f25e3f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:37:12.508021 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fdbe1e-dd32-4d54-b998-22558f25e3f4 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:37:12.519049 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1099/2203] 10.222.0.117 () {58 vars in 1126 bytes} [Tue Jan 25 02:37:12 2022] GET /identity/v3/roles => generated 1427 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 02:37:12.524517 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b7f1cb-c1c8-47cf-a9ae-2cd4e9548fcf admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:37:12.536209 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b7f1cb-c1c8-47cf-a9ae-2cd4e9548fcf admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:37:12.541505 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb1d311-27f5-4961-8714-564747078c7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:37:12.542392 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb1d311-27f5-4961-8714-564747078c7d admin admin] REQUEST_METHOD: `PUT` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:37:12.542679 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb1d311-27f5-4961-8714-564747078c7d admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:37:12.542974 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb1d311-27f5-4961-8714-564747078c7d admin admin] PATH_INFO: `/v3/projects/1921322f7cdf437ead1d5605a7c501ab/users/4d0e602a1ec34c0ea33aab6c675b6bdf/roles/d8dbc6d83d9d41d28c3feb8b3485b291` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:37:12.544987 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb1d311-27f5-4961-8714-564747078c7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1921322f7cdf437ead1d5605a7c501ab, user_id=4d0e602a1ec34c0ea33aab6c675b6bdf, role_id=d8dbc6d83d9d41d28c3feb8b3485b291)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:37:12.547673 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb1d311-27f5-4961-8714-564747078c7d admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:37:12.558619 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1105/2204] 10.222.0.117 () {60 vars in 1487 bytes} [Tue Jan 25 02:37:12 2022] PUT /identity/v3/projects/1921322f7cdf437ead1d5605a7c501ab/users/4d0e602a1ec34c0ea33aab6c675b6bdf/roles/d8dbc6d83d9d41d28c3feb8b3485b291 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:37:12.569517 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7e0687-c3e2-44b4-a106-547ae6a51de0 None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:37:12.569817 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7e0687-c3e2-44b4-a106-547ae6a51de0 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:37:12.570106 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7e0687-c3e2-44b4-a106-547ae6a51de0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:37:12.597040 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-dc7e0687-c3e2-44b4-a106-547ae6a51de0 None None] MFA Rules not processed for user `4d0e602a1ec34c0ea33aab6c675b6bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:37:12.598956 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-dc7e0687-c3e2-44b4-a106-547ae6a51de0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:37:12.669352 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1100/2205] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:37:12 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:37:12.679732 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb1d311-27f5-4961-8714-564747078c7d admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:37:12.681460 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-deb1d311-27f5-4961-8714-564747078c7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:37:12.739098 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb1d311-27f5-4961-8714-564747078c7d admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:37:12.742976 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a614ec-caec-476a-ab05-38a3d7edfa07 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cc5249aea09430080e232cf17757f86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:37:12.743796 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a614ec-caec-476a-ab05-38a3d7edfa07 service cinder] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:37:12.744081 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a614ec-caec-476a-ab05-38a3d7edfa07 service cinder] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:37:12.744355 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a614ec-caec-476a-ab05-38a3d7edfa07 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:37:12.754303 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a614ec-caec-476a-ab05-38a3d7edfa07 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:37:12.755825 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a614ec-caec-476a-ab05-38a3d7edfa07 service cinder] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:37:12.766654 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1106/2206] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:37:12 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:37:13.296061 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7e0687-c3e2-44b4-a106-547ae6a51de0 None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:37:13.306378 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7e0687-c3e2-44b4-a106-547ae6a51de0 None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:37:13.310154 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f8e592-bef3-4ce5-b3a0-8a94f2a74c81 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cc5249aea09430080e232cf17757f86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:37:13.310802 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f8e592-bef3-4ce5-b3a0-8a94f2a74c81 service cinder] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:37:13.311084 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f8e592-bef3-4ce5-b3a0-8a94f2a74c81 service cinder] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:37:13.311358 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f8e592-bef3-4ce5-b3a0-8a94f2a74c81 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:37:13.368519 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f8e592-bef3-4ce5-b3a0-8a94f2a74c81 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:37:13.370002 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f8e592-bef3-4ce5-b3a0-8a94f2a74c81 service cinder] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:37:13.379095 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1101/2207] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:37:13 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:37:18.666893 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc66a8fd-86d5-4b90-b7e3-c6d23c818df4 None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:37:18.667388 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc66a8fd-86d5-4b90-b7e3-c6d23c818df4 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:37:18.667480 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc66a8fd-86d5-4b90-b7e3-c6d23c818df4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:37:18.690279 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-dc66a8fd-86d5-4b90-b7e3-c6d23c818df4 None None] MFA Rules not processed for user `63855c1cdc7b46548312f2e14d99cfe1`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:37:18.692143 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-dc66a8fd-86d5-4b90-b7e3-c6d23c818df4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:37:18.750396 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1107/2208] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:37:18 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:37:18.830988 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f8e592-bef3-4ce5-b3a0-8a94f2a74c81 service cinder] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:37:18.833748 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-66f8e592-bef3-4ce5-b3a0-8a94f2a74c81 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:37:18.899436 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f8e592-bef3-4ce5-b3a0-8a94f2a74c81 service cinder] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:37:18.904155 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4907dac8-7410-4d71-aeff-42e09cee6499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:37:18.905025 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4907dac8-7410-4d71-aeff-42e09cee6499 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:37:18.905310 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4907dac8-7410-4d71-aeff-42e09cee6499 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:37:18.905670 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4907dac8-7410-4d71-aeff-42e09cee6499 admin admin] PATH_INFO: `/v3/users/7469e0f9408f400296d4e53b20480aa9` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:37:18.906917 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4907dac8-7410-4d71-aeff-42e09cee6499 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7469e0f9408f400296d4e53b20480aa9)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:37:18.909555 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4907dac8-7410-4d71-aeff-42e09cee6499 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:37:18.965722 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-4907dac8-7410-4d71-aeff-42e09cee6499 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7469e0f9408f400296d4e53b20480aa9'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:37:18.974709 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-4907dac8-7410-4d71-aeff-42e09cee6499 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7469e0f9408f400296d4e53b20480aa9'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:37:18.975876 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-4907dac8-7410-4d71-aeff-42e09cee6499 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7469e0f9408f400296d4e53b20480aa9'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:37:18.976928 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-4907dac8-7410-4d71-aeff-42e09cee6499 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7469e0f9408f400296d4e53b20480aa9'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:37:18.994970 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-4907dac8-7410-4d71-aeff-42e09cee6499 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7469e0f9408f400296d4e53b20480aa9'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:37:19.010861 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1102/2209] 10.222.0.117 () {58 vars in 1228 bytes} [Tue Jan 25 02:37:18 2022] DELETE /identity/v3/users/7469e0f9408f400296d4e53b20480aa9 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:37:19.015558 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29507ca0-f228-488e-afcf-3204f100dd1f None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:37:19.016064 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29507ca0-f228-488e-afcf-3204f100dd1f None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:37:19.016500 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29507ca0-f228-488e-afcf-3204f100dd1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:37:19.037266 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-29507ca0-f228-488e-afcf-3204f100dd1f None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:37:19.039058 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-29507ca0-f228-488e-afcf-3204f100dd1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:37:19.149616 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1108/2210] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:37:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 25 02:37:19.156644 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4907dac8-7410-4d71-aeff-42e09cee6499 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:37:19.160491 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-4907dac8-7410-4d71-aeff-42e09cee6499 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:37:19.273234 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4907dac8-7410-4d71-aeff-42e09cee6499 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:37:19.277663 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b5bce7-459b-4edf-8d2e-bb57333d51f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca4071c5f8f4a31b5edb81fa66a43a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:37:19.278507 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b5bce7-459b-4edf-8d2e-bb57333d51f2 service neutron] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:37:19.278942 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b5bce7-459b-4edf-8d2e-bb57333d51f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:37:19.279300 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b5bce7-459b-4edf-8d2e-bb57333d51f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:37:19.293387 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b5bce7-459b-4edf-8d2e-bb57333d51f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:37:19.297196 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b5bce7-459b-4edf-8d2e-bb57333d51f2 service neutron] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:37:19.310457 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1103/2211] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:37:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:37:19.816812 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29507ca0-f228-488e-afcf-3204f100dd1f None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:37:19.818738 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-29507ca0-f228-488e-afcf-3204f100dd1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:37:19.834980 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29507ca0-f228-488e-afcf-3204f100dd1f None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:37:19.843237 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea600ee-6842-4ecd-ac72-aaa8290b8eac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:37:19.845220 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea600ee-6842-4ecd-ac72-aaa8290b8eac admin admin] REQUEST_METHOD: `DELETE` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:37:19.845966 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea600ee-6842-4ecd-ac72-aaa8290b8eac admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:37:19.846721 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea600ee-6842-4ecd-ac72-aaa8290b8eac admin admin] PATH_INFO: `/v3/projects/fba913a167544c5289051e9d0dc233e0` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:37:19.848537 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea600ee-6842-4ecd-ac72-aaa8290b8eac admin admin] RBAC: Authorizing `identity:delete_project(project_id=fba913a167544c5289051e9d0dc233e0)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:37:19.850847 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea600ee-6842-4ecd-ac72-aaa8290b8eac admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:37:19.920378 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-8ea600ee-6842-4ecd-ac72-aaa8290b8eac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fba913a167544c5289051e9d0dc233e0', 'request_id': 'req-8ea600ee-6842-4ecd-ac72-aaa8290b8eac'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:37:19.928939 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-8ea600ee-6842-4ecd-ac72-aaa8290b8eac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fba913a167544c5289051e9d0dc233e0', 'request_id': 'req-8ea600ee-6842-4ecd-ac72-aaa8290b8eac'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:37:19.939250 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-8ea600ee-6842-4ecd-ac72-aaa8290b8eac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fba913a167544c5289051e9d0dc233e0', 'request_id': 'req-8ea600ee-6842-4ecd-ac72-aaa8290b8eac'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:37:19.952365 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-8ea600ee-6842-4ecd-ac72-aaa8290b8eac admin admin] The token cache is being invalidate because project fba913a167544c5289051e9d0dc233e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79121) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 25 02:37:19.952756 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-8ea600ee-6842-4ecd-ac72-aaa8290b8eac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:37:19.953771 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-8ea600ee-6842-4ecd-ac72-aaa8290b8eac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:37:19.956119 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1109/2212] 10.222.0.117 () {58 vars in 1237 bytes} [Tue Jan 25 02:37:19 2022] DELETE /identity/v3/projects/fba913a167544c5289051e9d0dc233e0 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:37:19.962509 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e54b576-a672-4527-94a1-8e59a53cb0af None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:37:19.963108 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e54b576-a672-4527-94a1-8e59a53cb0af None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:37:19.963212 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e54b576-a672-4527-94a1-8e59a53cb0af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:37:19.982554 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-0e54b576-a672-4527-94a1-8e59a53cb0af None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:37:19.983907 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-0e54b576-a672-4527-94a1-8e59a53cb0af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:37:20.050428 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1104/2213] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:37:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:37:20.058842 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d87742d-dff7-437d-9956-4b61c47df96b None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:37:20.059129 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d87742d-dff7-437d-9956-4b61c47df96b None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:37:20.059434 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d87742d-dff7-437d-9956-4b61c47df96b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:37:20.081289 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-4d87742d-dff7-437d-9956-4b61c47df96b None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:37:20.083973 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-4d87742d-dff7-437d-9956-4b61c47df96b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:37:20.093167 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1110/2214] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:37:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:37:20.097408 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e54b576-a672-4527-94a1-8e59a53cb0af None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:37:20.108929 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e54b576-a672-4527-94a1-8e59a53cb0af None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:37:20.113711 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4cb4ca-7893-4ca9-8b13-de6deb013d24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:37:20.114383 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4cb4ca-7893-4ca9-8b13-de6deb013d24 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:37:20.114673 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4cb4ca-7893-4ca9-8b13-de6deb013d24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:37:20.114952 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4cb4ca-7893-4ca9-8b13-de6deb013d24 admin admin] PATH_INFO: `/v3/domains` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:37:20.115922 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4cb4ca-7893-4ca9-8b13-de6deb013d24 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:37:20.116231 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4cb4ca-7893-4ca9-8b13-de6deb013d24 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:37:20.117870 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4cb4ca-7893-4ca9-8b13-de6deb013d24 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:37:20.133971 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1105/2215] 10.222.0.117 () {58 vars in 1157 bytes} [Tue Jan 25 02:37:20 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 02:37:20.135092 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d87742d-dff7-437d-9956-4b61c47df96b None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:37:20.144867 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d87742d-dff7-437d-9956-4b61c47df96b None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:37:20.149716 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fa27d7-640c-4db0-8bef-8e24c695d767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:37:20.150363 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fa27d7-640c-4db0-8bef-8e24c695d767 admin admin] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:37:20.150649 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fa27d7-640c-4db0-8bef-8e24c695d767 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:37:20.150926 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fa27d7-640c-4db0-8bef-8e24c695d767 admin admin] PATH_INFO: `/v3/projects` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:37:20.151624 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fa27d7-640c-4db0-8bef-8e24c695d767 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:37:20.153581 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fa27d7-640c-4db0-8bef-8e24c695d767 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:37:20.188109 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1111/2216] 10.222.0.117 () {60 vars in 1157 bytes} [Tue Jan 25 02:37:20 2022] POST /identity/v3/projects => generated 372 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 02:37:20.188988 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4cb4ca-7893-4ca9-8b13-de6deb013d24 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:37:20.201459 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4cb4ca-7893-4ca9-8b13-de6deb013d24 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:37:20.277197 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85603a30-200c-4365-9c85-f538072ef718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:37:20.277971 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85603a30-200c-4365-9c85-f538072ef718 admin admin] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:37:20.278495 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85603a30-200c-4365-9c85-f538072ef718 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:37:20.278886 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85603a30-200c-4365-9c85-f538072ef718 admin admin] PATH_INFO: `/v3/users` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:37:20.279724 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85603a30-200c-4365-9c85-f538072ef718 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:37:20.281739 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85603a30-200c-4365-9c85-f538072ef718 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:37:20.307034 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1106/2217] 10.222.0.117 () {60 vars in 1148 bytes} [Tue Jan 25 02:37:20 2022] POST /identity/v3/users => generated 287 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 25 02:37:20.308615 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fa27d7-640c-4db0-8bef-8e24c695d767 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:37:20.322312 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fa27d7-640c-4db0-8bef-8e24c695d767 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:37:20.327740 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70f3a3b-df3c-4501-a303-400133c3f52e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:37:20.328663 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70f3a3b-df3c-4501-a303-400133c3f52e admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:37:20.328956 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70f3a3b-df3c-4501-a303-400133c3f52e admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:37:20.329237 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70f3a3b-df3c-4501-a303-400133c3f52e admin admin] PATH_INFO: `/v3/roles` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:37:20.329996 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70f3a3b-df3c-4501-a303-400133c3f52e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:37:20.332547 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70f3a3b-df3c-4501-a303-400133c3f52e admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:37:20.343414 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1112/2218] 10.222.0.117 () {58 vars in 1126 bytes} [Tue Jan 25 02:37:20 2022] GET /identity/v3/roles => generated 1427 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 02:37:20.348417 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85603a30-200c-4365-9c85-f538072ef718 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:37:20.358311 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85603a30-200c-4365-9c85-f538072ef718 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:37:20.365114 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadb1a5c-e8f1-4fe6-95cf-04142791a0e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:37:20.366026 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadb1a5c-e8f1-4fe6-95cf-04142791a0e9 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:37:20.366026 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadb1a5c-e8f1-4fe6-95cf-04142791a0e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:37:20.366342 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadb1a5c-e8f1-4fe6-95cf-04142791a0e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:37:20.367168 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadb1a5c-e8f1-4fe6-95cf-04142791a0e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:37:20.369013 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadb1a5c-e8f1-4fe6-95cf-04142791a0e9 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:37:20.381042 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1107/2219] 10.222.0.117 () {58 vars in 1126 bytes} [Tue Jan 25 02:37:20 2022] GET /identity/v3/roles => generated 1427 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 25 02:37:20.385309 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70f3a3b-df3c-4501-a303-400133c3f52e admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:37:20.410327 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70f3a3b-df3c-4501-a303-400133c3f52e admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:37:20.416865 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcecb61-05a3-4176-93ce-d9b0eb2a15fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:37:20.418072 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcecb61-05a3-4176-93ce-d9b0eb2a15fb admin admin] REQUEST_METHOD: `PUT` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:37:20.418850 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcecb61-05a3-4176-93ce-d9b0eb2a15fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:37:20.419307 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcecb61-05a3-4176-93ce-d9b0eb2a15fb admin admin] PATH_INFO: `/v3/projects/ca89fe619a044ee683b1b81b0d90e2ac/users/1ed7af8fdcc24a288a38beebd541744e/roles/33a8e87420ed423f9cb29e0084eab5d2` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:37:20.443773 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcecb61-05a3-4176-93ce-d9b0eb2a15fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca89fe619a044ee683b1b81b0d90e2ac, user_id=1ed7af8fdcc24a288a38beebd541744e, role_id=33a8e87420ed423f9cb29e0084eab5d2)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:37:20.448025 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcecb61-05a3-4176-93ce-d9b0eb2a15fb admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:37:20.482294 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1113/2220] 10.222.0.117 () {60 vars in 1487 bytes} [Tue Jan 25 02:37:20 2022] PUT /identity/v3/projects/ca89fe619a044ee683b1b81b0d90e2ac/users/1ed7af8fdcc24a288a38beebd541744e/roles/33a8e87420ed423f9cb29e0084eab5d2 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:37:20.483376 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2796385-069d-4ee7-b76f-7ff8329e7c5a None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:37:20.483799 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2796385-069d-4ee7-b76f-7ff8329e7c5a None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:37:20.484286 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2796385-069d-4ee7-b76f-7ff8329e7c5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:37:20.517535 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-a2796385-069d-4ee7-b76f-7ff8329e7c5a None None] MFA Rules not processed for user `1ed7af8fdcc24a288a38beebd541744e`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:37:20.518855 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-a2796385-069d-4ee7-b76f-7ff8329e7c5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:37:20.615457 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1108/2221] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:37:20 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:37:20.692522 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcecb61-05a3-4176-93ce-d9b0eb2a15fb admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:37:20.694966 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-dfcecb61-05a3-4176-93ce-d9b0eb2a15fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:37:20.787115 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcecb61-05a3-4176-93ce-d9b0eb2a15fb admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:37:20.792020 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d029be-c000-4573-bf8a-c76fb5ccf36e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cc5249aea09430080e232cf17757f86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:37:20.793116 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d029be-c000-4573-bf8a-c76fb5ccf36e service cinder] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:37:20.793404 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d029be-c000-4573-bf8a-c76fb5ccf36e service cinder] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:37:20.793676 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d029be-c000-4573-bf8a-c76fb5ccf36e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:37:20.804496 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d029be-c000-4573-bf8a-c76fb5ccf36e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:37:20.806022 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d029be-c000-4573-bf8a-c76fb5ccf36e service cinder] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:37:20.817917 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1114/2222] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:37:20 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:37:20.954027 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2796385-069d-4ee7-b76f-7ff8329e7c5a None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:37:20.955957 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-a2796385-069d-4ee7-b76f-7ff8329e7c5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:37:20.986011 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2796385-069d-4ee7-b76f-7ff8329e7c5a None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:37:20.991933 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6db4de-458c-44a9-9665-3735e5b44f95 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cc5249aea09430080e232cf17757f86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:37:20.992906 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6db4de-458c-44a9-9665-3735e5b44f95 service cinder] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:37:20.993447 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6db4de-458c-44a9-9665-3735e5b44f95 service cinder] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:37:20.994064 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6db4de-458c-44a9-9665-3735e5b44f95 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:37:20.998814 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-6f6db4de-458c-44a9-9665-3735e5b44f95 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:37:21.124741 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6db4de-458c-44a9-9665-3735e5b44f95 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:37:21.126381 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6db4de-458c-44a9-9665-3735e5b44f95 service cinder] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:37:21.148260 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1109/2223] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:37:20 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:37:28.624459 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9597053d-8f04-459f-af07-61b15675bc79 None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:37:28.625049 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9597053d-8f04-459f-af07-61b15675bc79 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:37:28.625049 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9597053d-8f04-459f-af07-61b15675bc79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:37:28.642091 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-9597053d-8f04-459f-af07-61b15675bc79 None None] MFA Rules not processed for user `1ed7af8fdcc24a288a38beebd541744e`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:37:28.643382 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-9597053d-8f04-459f-af07-61b15675bc79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:37:28.651051 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1115/2224] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:37:28 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 25 02:37:29.983014 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6db4de-458c-44a9-9665-3735e5b44f95 service cinder] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:37:29.984620 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-6f6db4de-458c-44a9-9665-3735e5b44f95 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:37:30.052476 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6db4de-458c-44a9-9665-3735e5b44f95 service cinder] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:37:30.056904 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaa5912-e129-497f-b654-81f3b470a338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:37:30.057771 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaa5912-e129-497f-b654-81f3b470a338 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:37:30.058051 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaa5912-e129-497f-b654-81f3b470a338 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:37:30.058321 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaa5912-e129-497f-b654-81f3b470a338 admin admin] PATH_INFO: `/v3/users/45e06e0cbc1748848b7ae3d89254a382` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:37:30.059524 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbaa5912-e129-497f-b654-81f3b470a338 admin admin] RBAC: Authorizing `identity:delete_user(user_id=45e06e0cbc1748848b7ae3d89254a382)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:37:30.061640 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbaa5912-e129-497f-b654-81f3b470a338 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:37:30.108510 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-fbaa5912-e129-497f-b654-81f3b470a338 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45e06e0cbc1748848b7ae3d89254a382'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:37:30.119107 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-fbaa5912-e129-497f-b654-81f3b470a338 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45e06e0cbc1748848b7ae3d89254a382'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:37:30.119932 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-fbaa5912-e129-497f-b654-81f3b470a338 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45e06e0cbc1748848b7ae3d89254a382'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:37:30.120768 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-fbaa5912-e129-497f-b654-81f3b470a338 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45e06e0cbc1748848b7ae3d89254a382'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:37:30.135289 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-fbaa5912-e129-497f-b654-81f3b470a338 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45e06e0cbc1748848b7ae3d89254a382'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:37:30.151303 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1110/2225] 10.222.0.117 () {58 vars in 1228 bytes} [Tue Jan 25 02:37:29 2022] DELETE /identity/v3/users/45e06e0cbc1748848b7ae3d89254a382 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:37:30.157060 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deccb23-afc4-4338-b3c9-2595dc37c87e None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:37:30.157639 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deccb23-afc4-4338-b3c9-2595dc37c87e None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:37:30.157639 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deccb23-afc4-4338-b3c9-2595dc37c87e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:37:30.180466 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-0deccb23-afc4-4338-b3c9-2595dc37c87e None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:37:30.183200 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-0deccb23-afc4-4338-b3c9-2595dc37c87e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:37:30.249859 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1116/2226] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:37:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:37:30.261588 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaa5912-e129-497f-b654-81f3b470a338 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:37:30.263401 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-fbaa5912-e129-497f-b654-81f3b470a338 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:37:30.342959 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaa5912-e129-497f-b654-81f3b470a338 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:37:30.347421 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd704c7d-e8b7-422a-bde3-9c24fa41c24b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca4071c5f8f4a31b5edb81fa66a43a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:37:30.348456 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd704c7d-e8b7-422a-bde3-9c24fa41c24b service neutron] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:37:30.348738 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd704c7d-e8b7-422a-bde3-9c24fa41c24b service neutron] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:37:30.349405 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd704c7d-e8b7-422a-bde3-9c24fa41c24b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:37:30.357953 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd704c7d-e8b7-422a-bde3-9c24fa41c24b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:37:30.359398 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd704c7d-e8b7-422a-bde3-9c24fa41c24b service neutron] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:37:30.368869 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1111/2227] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:37:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:37:30.695797 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0deccb23-afc4-4338-b3c9-2595dc37c87e None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:37:30.698040 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-0deccb23-afc4-4338-b3c9-2595dc37c87e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:37:30.729436 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0deccb23-afc4-4338-b3c9-2595dc37c87e None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:37:30.738614 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a377751a-7775-4d2f-b29c-c4e6fae607c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:37:30.740132 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a377751a-7775-4d2f-b29c-c4e6fae607c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:37:30.740644 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a377751a-7775-4d2f-b29c-c4e6fae607c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:37:30.741154 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a377751a-7775-4d2f-b29c-c4e6fae607c7 admin admin] PATH_INFO: `/v3/projects/d370a525a73b403d91c188fed02e9e71` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:37:30.743292 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a377751a-7775-4d2f-b29c-c4e6fae607c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d370a525a73b403d91c188fed02e9e71)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:37:30.747162 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a377751a-7775-4d2f-b29c-c4e6fae607c7 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:37:30.816345 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-a377751a-7775-4d2f-b29c-c4e6fae607c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd370a525a73b403d91c188fed02e9e71', 'request_id': 'req-a377751a-7775-4d2f-b29c-c4e6fae607c7'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:37:30.823205 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-a377751a-7775-4d2f-b29c-c4e6fae607c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd370a525a73b403d91c188fed02e9e71', 'request_id': 'req-a377751a-7775-4d2f-b29c-c4e6fae607c7'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:37:30.833334 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-a377751a-7775-4d2f-b29c-c4e6fae607c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd370a525a73b403d91c188fed02e9e71', 'request_id': 'req-a377751a-7775-4d2f-b29c-c4e6fae607c7'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:37:30.845678 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-a377751a-7775-4d2f-b29c-c4e6fae607c7 admin admin] The token cache is being invalidate because project d370a525a73b403d91c188fed02e9e71 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79121) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 25 02:37:30.845982 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-a377751a-7775-4d2f-b29c-c4e6fae607c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:37:30.847251 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-a377751a-7775-4d2f-b29c-c4e6fae607c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:37:30.852867 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1117/2228] 10.222.0.117 () {58 vars in 1237 bytes} [Tue Jan 25 02:37:30 2022] DELETE /identity/v3/projects/d370a525a73b403d91c188fed02e9e71 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 25 02:37:30.854172 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd704c7d-e8b7-422a-bde3-9c24fa41c24b service neutron] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:37:30.865384 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd704c7d-e8b7-422a-bde3-9c24fa41c24b service neutron] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:37:30.921497 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ce9396-f227-403e-9744-2a2c5604ac04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:37:30.922378 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ce9396-f227-403e-9744-2a2c5604ac04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:37:30.922665 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ce9396-f227-403e-9744-2a2c5604ac04 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:37:30.922939 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ce9396-f227-403e-9744-2a2c5604ac04 admin admin] PATH_INFO: `/v3/users/7f06bd942cc147ee829abeb3b9609095` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:37:30.924224 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ce9396-f227-403e-9744-2a2c5604ac04 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f06bd942cc147ee829abeb3b9609095)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:37:30.926216 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ce9396-f227-403e-9744-2a2c5604ac04 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:37:30.978524 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-58ce9396-f227-403e-9744-2a2c5604ac04 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f06bd942cc147ee829abeb3b9609095'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:37:31.003835 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-58ce9396-f227-403e-9744-2a2c5604ac04 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f06bd942cc147ee829abeb3b9609095'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:37:31.011965 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-58ce9396-f227-403e-9744-2a2c5604ac04 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f06bd942cc147ee829abeb3b9609095'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:37:31.016415 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-58ce9396-f227-403e-9744-2a2c5604ac04 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f06bd942cc147ee829abeb3b9609095'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:37:31.032781 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-58ce9396-f227-403e-9744-2a2c5604ac04 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f06bd942cc147ee829abeb3b9609095'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:37:31.051171 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1112/2229] 10.222.0.117 () {58 vars in 1228 bytes} [Tue Jan 25 02:37:30 2022] DELETE /identity/v3/users/7f06bd942cc147ee829abeb3b9609095 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:37:31.371724 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a377751a-7775-4d2f-b29c-c4e6fae607c7 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:37:31.373622 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-a377751a-7775-4d2f-b29c-c4e6fae607c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:37:31.388531 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a377751a-7775-4d2f-b29c-c4e6fae607c7 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:37:31.492502 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db469770-dca8-498f-bc08-fc27baa5661d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:37:31.493416 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db469770-dca8-498f-bc08-fc27baa5661d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:37:31.493686 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db469770-dca8-498f-bc08-fc27baa5661d admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:37:31.494145 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db469770-dca8-498f-bc08-fc27baa5661d admin admin] PATH_INFO: `/v3/projects/b5ba90a934ea46528b1ffdedfaef2313` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:37:31.497273 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db469770-dca8-498f-bc08-fc27baa5661d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5ba90a934ea46528b1ffdedfaef2313)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:37:31.499875 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db469770-dca8-498f-bc08-fc27baa5661d admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:37:31.559385 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-db469770-dca8-498f-bc08-fc27baa5661d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5ba90a934ea46528b1ffdedfaef2313', 'request_id': 'req-db469770-dca8-498f-bc08-fc27baa5661d'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:37:31.566991 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-db469770-dca8-498f-bc08-fc27baa5661d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5ba90a934ea46528b1ffdedfaef2313', 'request_id': 'req-db469770-dca8-498f-bc08-fc27baa5661d'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:37:31.575245 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-db469770-dca8-498f-bc08-fc27baa5661d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5ba90a934ea46528b1ffdedfaef2313', 'request_id': 'req-db469770-dca8-498f-bc08-fc27baa5661d'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:37:31.600195 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-db469770-dca8-498f-bc08-fc27baa5661d admin admin] The token cache is being invalidate because project b5ba90a934ea46528b1ffdedfaef2313 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79121) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 25 02:37:31.600486 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-db469770-dca8-498f-bc08-fc27baa5661d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:37:31.601929 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-db469770-dca8-498f-bc08-fc27baa5661d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:37:31.603562 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1118/2230] 10.222.0.117 () {58 vars in 1237 bytes} [Tue Jan 25 02:37:31 2022] DELETE /identity/v3/projects/b5ba90a934ea46528b1ffdedfaef2313 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:37:31.607543 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ce9396-f227-403e-9744-2a2c5604ac04 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:37:31.609421 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-58ce9396-f227-403e-9744-2a2c5604ac04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:37:31.623833 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ce9396-f227-403e-9744-2a2c5604ac04 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:37:31.679000 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576d83d5-9002-4896-808b-5551bd358ac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:37:31.679902 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576d83d5-9002-4896-808b-5551bd358ac8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:37:31.680182 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576d83d5-9002-4896-808b-5551bd358ac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:37:31.680455 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576d83d5-9002-4896-808b-5551bd358ac8 admin admin] PATH_INFO: `/v3/users/4d0e602a1ec34c0ea33aab6c675b6bdf` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:37:31.681641 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576d83d5-9002-4896-808b-5551bd358ac8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d0e602a1ec34c0ea33aab6c675b6bdf)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:37:31.683549 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576d83d5-9002-4896-808b-5551bd358ac8 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:37:31.733590 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-576d83d5-9002-4896-808b-5551bd358ac8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d0e602a1ec34c0ea33aab6c675b6bdf'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:37:31.743405 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-576d83d5-9002-4896-808b-5551bd358ac8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d0e602a1ec34c0ea33aab6c675b6bdf'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:37:31.744192 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-576d83d5-9002-4896-808b-5551bd358ac8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d0e602a1ec34c0ea33aab6c675b6bdf'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:37:31.744991 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-576d83d5-9002-4896-808b-5551bd358ac8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d0e602a1ec34c0ea33aab6c675b6bdf'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:37:31.763334 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-576d83d5-9002-4896-808b-5551bd358ac8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d0e602a1ec34c0ea33aab6c675b6bdf'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:37:31.775983 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1113/2231] 10.222.0.117 () {58 vars in 1228 bytes} [Tue Jan 25 02:37:31 2022] DELETE /identity/v3/users/4d0e602a1ec34c0ea33aab6c675b6bdf => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:37:32.083952 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db469770-dca8-498f-bc08-fc27baa5661d admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:37:32.085389 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-db469770-dca8-498f-bc08-fc27baa5661d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:37:32.102365 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db469770-dca8-498f-bc08-fc27baa5661d admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:37:32.227934 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73166a12-9d3c-48fb-913a-86decaa48f35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:37:32.228960 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73166a12-9d3c-48fb-913a-86decaa48f35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:37:32.229883 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73166a12-9d3c-48fb-913a-86decaa48f35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:37:32.230393 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73166a12-9d3c-48fb-913a-86decaa48f35 admin admin] PATH_INFO: `/v3/projects/1921322f7cdf437ead1d5605a7c501ab` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:37:32.231995 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73166a12-9d3c-48fb-913a-86decaa48f35 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1921322f7cdf437ead1d5605a7c501ab)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:37:32.235027 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73166a12-9d3c-48fb-913a-86decaa48f35 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:37:32.322747 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-73166a12-9d3c-48fb-913a-86decaa48f35 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1921322f7cdf437ead1d5605a7c501ab', 'request_id': 'req-73166a12-9d3c-48fb-913a-86decaa48f35'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:37:32.333501 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-73166a12-9d3c-48fb-913a-86decaa48f35 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1921322f7cdf437ead1d5605a7c501ab', 'request_id': 'req-73166a12-9d3c-48fb-913a-86decaa48f35'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:37:32.341963 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-73166a12-9d3c-48fb-913a-86decaa48f35 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1921322f7cdf437ead1d5605a7c501ab', 'request_id': 'req-73166a12-9d3c-48fb-913a-86decaa48f35'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:37:32.356040 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-73166a12-9d3c-48fb-913a-86decaa48f35 admin admin] The token cache is being invalidate because project 1921322f7cdf437ead1d5605a7c501ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79121) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 25 02:37:32.356340 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-73166a12-9d3c-48fb-913a-86decaa48f35 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:37:32.357010 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-73166a12-9d3c-48fb-913a-86decaa48f35 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:37:32.364927 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1119/2232] 10.222.0.117 () {58 vars in 1237 bytes} [Tue Jan 25 02:37:32 2022] DELETE /identity/v3/projects/1921322f7cdf437ead1d5605a7c501ab => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:37:32.366875 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58704688-2a7c-4067-bf51-adc6dc1ecc5f None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:37:32.367330 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58704688-2a7c-4067-bf51-adc6dc1ecc5f None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:37:32.367671 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58704688-2a7c-4067-bf51-adc6dc1ecc5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:37:32.386848 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-58704688-2a7c-4067-bf51-adc6dc1ecc5f None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:37:32.388099 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-58704688-2a7c-4067-bf51-adc6dc1ecc5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:37:32.453032 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1114/2233] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:37:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:37:32.464707 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4321dfdd-729e-43f3-9280-18307553f186 None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:37:32.465194 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4321dfdd-729e-43f3-9280-18307553f186 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:37:32.465553 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4321dfdd-729e-43f3-9280-18307553f186 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:37:32.484209 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-4321dfdd-729e-43f3-9280-18307553f186 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:37:32.485462 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-4321dfdd-729e-43f3-9280-18307553f186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:37:32.493979 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1120/2234] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:37:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 25 02:37:32.498558 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58704688-2a7c-4067-bf51-adc6dc1ecc5f None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:37:32.509481 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58704688-2a7c-4067-bf51-adc6dc1ecc5f None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:37:32.514163 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216cc38c-424f-42bc-83e5-6981b0743be0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:37:32.514860 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216cc38c-424f-42bc-83e5-6981b0743be0 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:37:32.515142 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216cc38c-424f-42bc-83e5-6981b0743be0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:37:32.515526 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216cc38c-424f-42bc-83e5-6981b0743be0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:37:32.516188 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216cc38c-424f-42bc-83e5-6981b0743be0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:37:32.516495 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216cc38c-424f-42bc-83e5-6981b0743be0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:37:32.518107 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216cc38c-424f-42bc-83e5-6981b0743be0 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:37:32.537710 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1115/2235] 10.222.0.117 () {58 vars in 1157 bytes} [Tue Jan 25 02:37:32 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:37:32.542153 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4321dfdd-729e-43f3-9280-18307553f186 None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:37:32.556272 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4321dfdd-729e-43f3-9280-18307553f186 None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:37:32.564159 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40929d92-2ee8-46ad-8911-70b65e4d2232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:37:32.564829 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40929d92-2ee8-46ad-8911-70b65e4d2232 admin admin] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:37:32.565110 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40929d92-2ee8-46ad-8911-70b65e4d2232 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:37:32.565426 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40929d92-2ee8-46ad-8911-70b65e4d2232 admin admin] PATH_INFO: `/v3/projects` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:37:32.568091 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40929d92-2ee8-46ad-8911-70b65e4d2232 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:37:32.570041 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40929d92-2ee8-46ad-8911-70b65e4d2232 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:37:32.619271 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1121/2236] 10.222.0.117 () {60 vars in 1157 bytes} [Tue Jan 25 02:37:32 2022] POST /identity/v3/projects => generated 362 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 02:37:32.620719 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216cc38c-424f-42bc-83e5-6981b0743be0 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:37:32.636655 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216cc38c-424f-42bc-83e5-6981b0743be0 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:37:32.719222 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457333eb-aeff-4df4-9362-77c29ae8394c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:37:32.720064 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457333eb-aeff-4df4-9362-77c29ae8394c admin admin] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:37:32.720420 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457333eb-aeff-4df4-9362-77c29ae8394c admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:37:32.720770 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457333eb-aeff-4df4-9362-77c29ae8394c admin admin] PATH_INFO: `/v3/users` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:37:32.721580 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457333eb-aeff-4df4-9362-77c29ae8394c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:37:32.724177 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457333eb-aeff-4df4-9362-77c29ae8394c admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:37:32.751960 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1116/2237] 10.222.0.117 () {60 vars in 1148 bytes} [Tue Jan 25 02:37:32 2022] POST /identity/v3/users => generated 282 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 02:37:32.758389 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40929d92-2ee8-46ad-8911-70b65e4d2232 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:37:32.774899 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40929d92-2ee8-46ad-8911-70b65e4d2232 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:37:32.782298 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7228f6fe-bd4f-47b9-b4cf-23f5356a64fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:37:32.783007 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7228f6fe-bd4f-47b9-b4cf-23f5356a64fa admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:37:32.783367 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7228f6fe-bd4f-47b9-b4cf-23f5356a64fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:37:32.784018 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7228f6fe-bd4f-47b9-b4cf-23f5356a64fa admin admin] PATH_INFO: `/v3/roles` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:37:32.785698 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7228f6fe-bd4f-47b9-b4cf-23f5356a64fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:37:32.787593 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7228f6fe-bd4f-47b9-b4cf-23f5356a64fa admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:37:32.803285 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1122/2238] 10.222.0.117 () {58 vars in 1126 bytes} [Tue Jan 25 02:37:32 2022] GET /identity/v3/roles => generated 1427 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 02:37:32.807280 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457333eb-aeff-4df4-9362-77c29ae8394c admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:37:32.831842 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457333eb-aeff-4df4-9362-77c29ae8394c admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:37:32.841803 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3e8db8-566f-4dd9-9271-6b2a7c616eb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:37:32.845169 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3e8db8-566f-4dd9-9271-6b2a7c616eb7 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:37:32.845596 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3e8db8-566f-4dd9-9271-6b2a7c616eb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:37:32.845947 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3e8db8-566f-4dd9-9271-6b2a7c616eb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:37:32.847507 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3e8db8-566f-4dd9-9271-6b2a7c616eb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:37:32.849337 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3e8db8-566f-4dd9-9271-6b2a7c616eb7 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:37:32.869658 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1117/2239] 10.222.0.117 () {58 vars in 1126 bytes} [Tue Jan 25 02:37:32 2022] GET /identity/v3/roles => generated 1427 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 25 02:37:32.870879 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7228f6fe-bd4f-47b9-b4cf-23f5356a64fa admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:37:32.886496 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7228f6fe-bd4f-47b9-b4cf-23f5356a64fa admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:37:32.912040 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a3ecdc-ab8f-47fb-8713-5df522ae976e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:37:32.913309 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a3ecdc-ab8f-47fb-8713-5df522ae976e admin admin] REQUEST_METHOD: `PUT` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:37:32.913818 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a3ecdc-ab8f-47fb-8713-5df522ae976e admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:37:32.914320 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a3ecdc-ab8f-47fb-8713-5df522ae976e admin admin] PATH_INFO: `/v3/projects/ce8490182ea4499ab7ca419dad5bc1f2/users/669df7f794a2484aa2c0c41d21d71cf2/roles/33a8e87420ed423f9cb29e0084eab5d2` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:37:32.963907 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a3ecdc-ab8f-47fb-8713-5df522ae976e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce8490182ea4499ab7ca419dad5bc1f2, user_id=669df7f794a2484aa2c0c41d21d71cf2, role_id=33a8e87420ed423f9cb29e0084eab5d2)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:37:32.966916 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a3ecdc-ab8f-47fb-8713-5df522ae976e admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:37:32.992441 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1123/2240] 10.222.0.117 () {60 vars in 1487 bytes} [Tue Jan 25 02:37:32 2022] PUT /identity/v3/projects/ce8490182ea4499ab7ca419dad5bc1f2/users/669df7f794a2484aa2c0c41d21d71cf2/roles/33a8e87420ed423f9cb29e0084eab5d2 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:37:33.005000 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dad86d-9f1f-4659-9843-58fb7a273928 None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:37:33.005623 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dad86d-9f1f-4659-9843-58fb7a273928 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:37:33.005823 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dad86d-9f1f-4659-9843-58fb7a273928 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:37:33.035288 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-a6dad86d-9f1f-4659-9843-58fb7a273928 None None] MFA Rules not processed for user `669df7f794a2484aa2c0c41d21d71cf2`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:37:33.036810 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-a6dad86d-9f1f-4659-9843-58fb7a273928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:37:33.116566 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1118/2241] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:37:33 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:37:33.145393 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a3ecdc-ab8f-47fb-8713-5df522ae976e admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:37:33.147145 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-96a3ecdc-ab8f-47fb-8713-5df522ae976e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:37:33.208947 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a3ecdc-ab8f-47fb-8713-5df522ae976e admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:37:33.219454 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095f1b77-a11b-45bf-9d83-967ad8dcfe70 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cc5249aea09430080e232cf17757f86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:37:33.220212 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095f1b77-a11b-45bf-9d83-967ad8dcfe70 service cinder] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:37:33.220457 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095f1b77-a11b-45bf-9d83-967ad8dcfe70 service cinder] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:37:33.220742 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095f1b77-a11b-45bf-9d83-967ad8dcfe70 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:37:33.241347 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095f1b77-a11b-45bf-9d83-967ad8dcfe70 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:37:33.243400 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095f1b77-a11b-45bf-9d83-967ad8dcfe70 service cinder] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:37:33.263898 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1124/2242] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:37:33 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:37:33.281998 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dad86d-9f1f-4659-9843-58fb7a273928 None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:37:33.378990 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dad86d-9f1f-4659-9843-58fb7a273928 None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:37:33.384576 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae599841-5eec-4eac-b322-622ee5ee86a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:37:33.385606 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae599841-5eec-4eac-b322-622ee5ee86a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:37:33.385962 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae599841-5eec-4eac-b322-622ee5ee86a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:37:33.386348 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae599841-5eec-4eac-b322-622ee5ee86a0 admin admin] PATH_INFO: `/v3/users/669df7f794a2484aa2c0c41d21d71cf2` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:37:33.387946 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae599841-5eec-4eac-b322-622ee5ee86a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=669df7f794a2484aa2c0c41d21d71cf2)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:37:33.390975 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae599841-5eec-4eac-b322-622ee5ee86a0 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:37:33.476244 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-ae599841-5eec-4eac-b322-622ee5ee86a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '669df7f794a2484aa2c0c41d21d71cf2'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:37:33.488246 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-ae599841-5eec-4eac-b322-622ee5ee86a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '669df7f794a2484aa2c0c41d21d71cf2'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:37:33.488246 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-ae599841-5eec-4eac-b322-622ee5ee86a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '669df7f794a2484aa2c0c41d21d71cf2'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:37:33.488992 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-ae599841-5eec-4eac-b322-622ee5ee86a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '669df7f794a2484aa2c0c41d21d71cf2'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:37:33.504456 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-ae599841-5eec-4eac-b322-622ee5ee86a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '669df7f794a2484aa2c0c41d21d71cf2'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:37:33.517473 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1119/2243] 10.222.0.117 () {58 vars in 1228 bytes} [Tue Jan 25 02:37:33 2022] DELETE /identity/v3/users/669df7f794a2484aa2c0c41d21d71cf2 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:37:33.522450 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e75cf4d-77eb-4d50-981c-daeecb432fd5 None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:37:33.522960 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e75cf4d-77eb-4d50-981c-daeecb432fd5 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:37:33.523081 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e75cf4d-77eb-4d50-981c-daeecb432fd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:37:33.541130 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-6e75cf4d-77eb-4d50-981c-daeecb432fd5 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:37:33.542378 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-6e75cf4d-77eb-4d50-981c-daeecb432fd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:37:33.603038 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1125/2244] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:37:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:37:33.613790 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae599841-5eec-4eac-b322-622ee5ee86a0 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:37:33.615310 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-ae599841-5eec-4eac-b322-622ee5ee86a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:37:33.677384 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae599841-5eec-4eac-b322-622ee5ee86a0 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:37:33.682350 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc10703-781e-4d81-b67c-f2c33f88e765 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca4071c5f8f4a31b5edb81fa66a43a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:37:33.683013 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc10703-781e-4d81-b67c-f2c33f88e765 service neutron] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:37:33.683306 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc10703-781e-4d81-b67c-f2c33f88e765 service neutron] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:37:33.683586 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc10703-781e-4d81-b67c-f2c33f88e765 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:37:33.693735 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc10703-781e-4d81-b67c-f2c33f88e765 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:37:33.695205 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc10703-781e-4d81-b67c-f2c33f88e765 service neutron] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:37:33.705678 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1120/2245] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:37:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:37:34.478962 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e75cf4d-77eb-4d50-981c-daeecb432fd5 None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:37:34.480810 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-6e75cf4d-77eb-4d50-981c-daeecb432fd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:37:34.502261 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e75cf4d-77eb-4d50-981c-daeecb432fd5 None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:37:34.512865 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc10703-781e-4d81-b67c-f2c33f88e765 service neutron] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:37:34.514484 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-0dc10703-781e-4d81-b67c-f2c33f88e765 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:37:34.519735 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6010af4e-d461-4bb8-841f-e8a6d36d6e46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:37:34.520624 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6010af4e-d461-4bb8-841f-e8a6d36d6e46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:37:34.520909 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6010af4e-d461-4bb8-841f-e8a6d36d6e46 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:37:34.521187 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6010af4e-d461-4bb8-841f-e8a6d36d6e46 admin admin] PATH_INFO: `/v3/projects/ce8490182ea4499ab7ca419dad5bc1f2` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:37:34.522606 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6010af4e-d461-4bb8-841f-e8a6d36d6e46 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce8490182ea4499ab7ca419dad5bc1f2)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:37:34.524586 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6010af4e-d461-4bb8-841f-e8a6d36d6e46 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:37:34.529324 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc10703-781e-4d81-b67c-f2c33f88e765 service neutron] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:37:34.535880 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e140249-a6b9-4df3-8759-44908f70d32d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:37:34.537001 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e140249-a6b9-4df3-8759-44908f70d32d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:37:34.537477 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e140249-a6b9-4df3-8759-44908f70d32d admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:37:34.537904 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e140249-a6b9-4df3-8759-44908f70d32d admin admin] PATH_INFO: `/v3/users/0100ebd352fe45da854323b9f38b153f` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:37:34.539457 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e140249-a6b9-4df3-8759-44908f70d32d admin admin] RBAC: Authorizing `identity:delete_user(user_id=0100ebd352fe45da854323b9f38b153f)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:37:34.541669 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e140249-a6b9-4df3-8759-44908f70d32d admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:37:34.578583 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-6010af4e-d461-4bb8-841f-e8a6d36d6e46 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce8490182ea4499ab7ca419dad5bc1f2', 'request_id': 'req-6010af4e-d461-4bb8-841f-e8a6d36d6e46'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:37:34.585171 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-6010af4e-d461-4bb8-841f-e8a6d36d6e46 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce8490182ea4499ab7ca419dad5bc1f2', 'request_id': 'req-6010af4e-d461-4bb8-841f-e8a6d36d6e46'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:37:34.594408 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-6010af4e-d461-4bb8-841f-e8a6d36d6e46 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce8490182ea4499ab7ca419dad5bc1f2', 'request_id': 'req-6010af4e-d461-4bb8-841f-e8a6d36d6e46'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:37:34.600759 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-4e140249-a6b9-4df3-8759-44908f70d32d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0100ebd352fe45da854323b9f38b153f'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:37:34.606403 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-6010af4e-d461-4bb8-841f-e8a6d36d6e46 admin admin] The token cache is being invalidate because project ce8490182ea4499ab7ca419dad5bc1f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79121) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 25 02:37:34.606765 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-6010af4e-d461-4bb8-841f-e8a6d36d6e46 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:37:34.607574 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-6010af4e-d461-4bb8-841f-e8a6d36d6e46 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:37:34.608615 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-4e140249-a6b9-4df3-8759-44908f70d32d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0100ebd352fe45da854323b9f38b153f'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:37:34.609237 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1126/2246] 10.222.0.117 () {58 vars in 1237 bytes} [Tue Jan 25 02:37:34 2022] DELETE /identity/v3/projects/ce8490182ea4499ab7ca419dad5bc1f2 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:37:34.609481 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-4e140249-a6b9-4df3-8759-44908f70d32d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0100ebd352fe45da854323b9f38b153f'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:37:34.610236 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-4e140249-a6b9-4df3-8759-44908f70d32d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0100ebd352fe45da854323b9f38b153f'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:37:34.615784 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2590b6f9-aed8-46ff-8749-46ebc213e0a4 None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:37:34.616075 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2590b6f9-aed8-46ff-8749-46ebc213e0a4 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:37:34.616381 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2590b6f9-aed8-46ff-8749-46ebc213e0a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:37:34.623644 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-4e140249-a6b9-4df3-8759-44908f70d32d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0100ebd352fe45da854323b9f38b153f'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:37:34.635215 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-2590b6f9-aed8-46ff-8749-46ebc213e0a4 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:37:34.636461 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-2590b6f9-aed8-46ff-8749-46ebc213e0a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:37:34.636570 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1121/2247] 10.222.0.117 () {58 vars in 1228 bytes} [Tue Jan 25 02:37:34 2022] DELETE /identity/v3/users/0100ebd352fe45da854323b9f38b153f => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 25 02:37:34.640894 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c5fd7b-eb79-437d-b001-1b6c6a41b0c2 None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:37:34.641190 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c5fd7b-eb79-437d-b001-1b6c6a41b0c2 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:37:34.641478 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c5fd7b-eb79-437d-b001-1b6c6a41b0c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:37:34.659045 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-b9c5fd7b-eb79-437d-b001-1b6c6a41b0c2 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:37:34.661127 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-b9c5fd7b-eb79-437d-b001-1b6c6a41b0c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:37:34.699042 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1127/2248] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:37:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:37:34.707384 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2c4841-2e40-4b79-957a-8fa01c4fea80 None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:37:34.707676 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2c4841-2e40-4b79-957a-8fa01c4fea80 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:37:34.707986 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2c4841-2e40-4b79-957a-8fa01c4fea80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:37:34.725610 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1122/2249] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:37:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 25 02:37:34.727419 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-ba2c4841-2e40-4b79-957a-8fa01c4fea80 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:37:34.728706 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-ba2c4841-2e40-4b79-957a-8fa01c4fea80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:37:34.735310 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c5fd7b-eb79-437d-b001-1b6c6a41b0c2 None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:37:34.736599 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-b9c5fd7b-eb79-437d-b001-1b6c6a41b0c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:37:34.736895 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1128/2250] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:37:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 25 02:37:34.740748 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2c4841-2e40-4b79-957a-8fa01c4fea80 None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:37:34.749547 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2c4841-2e40-4b79-957a-8fa01c4fea80 None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:37:34.754390 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bced52-cd97-4605-8bea-f05671c19bca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:37:34.755150 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bced52-cd97-4605-8bea-f05671c19bca admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:37:34.755432 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bced52-cd97-4605-8bea-f05671c19bca admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:37:34.755722 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bced52-cd97-4605-8bea-f05671c19bca admin admin] PATH_INFO: `/v3/domains` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:37:34.756464 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bced52-cd97-4605-8bea-f05671c19bca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:37:34.756767 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bced52-cd97-4605-8bea-f05671c19bca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:37:34.758427 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bced52-cd97-4605-8bea-f05671c19bca admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:37:34.770335 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1129/2251] 10.222.0.117 () {58 vars in 1157 bytes} [Tue Jan 25 02:37:34 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:37:34.774683 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bced52-cd97-4605-8bea-f05671c19bca admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:37:34.784946 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bced52-cd97-4605-8bea-f05671c19bca admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:37:34.789775 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8e5171-10c5-451f-aa4c-d00263518576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:37:34.790343 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8e5171-10c5-451f-aa4c-d00263518576 admin admin] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:37:34.790631 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8e5171-10c5-451f-aa4c-d00263518576 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:37:34.790908 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8e5171-10c5-451f-aa4c-d00263518576 admin admin] PATH_INFO: `/v3/projects` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:37:34.791615 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8e5171-10c5-451f-aa4c-d00263518576 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:37:34.793555 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8e5171-10c5-451f-aa4c-d00263518576 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:37:34.794038 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c5fd7b-eb79-437d-b001-1b6c6a41b0c2 None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:37:34.798062 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3256946-1a76-4e97-9dbc-e32114483c2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca4071c5f8f4a31b5edb81fa66a43a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:37:34.798705 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3256946-1a76-4e97-9dbc-e32114483c2c service neutron] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:37:34.798989 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3256946-1a76-4e97-9dbc-e32114483c2c service neutron] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:37:34.799267 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3256946-1a76-4e97-9dbc-e32114483c2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:37:34.809001 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3256946-1a76-4e97-9dbc-e32114483c2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:37:34.810629 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3256946-1a76-4e97-9dbc-e32114483c2c service neutron] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:37:34.821382 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1123/2252] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:37:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 25 02:37:34.822376 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1130/2253] 10.222.0.117 () {60 vars in 1157 bytes} [Tue Jan 25 02:37:34 2022] POST /identity/v3/projects => generated 374 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 25 02:37:34.826507 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3256946-1a76-4e97-9dbc-e32114483c2c service neutron] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:37:34.836938 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3256946-1a76-4e97-9dbc-e32114483c2c service neutron] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:37:34.894708 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe71899-125a-4e27-be8e-d7394a0b95a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:37:34.895382 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe71899-125a-4e27-be8e-d7394a0b95a9 admin admin] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:37:34.895666 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe71899-125a-4e27-be8e-d7394a0b95a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:37:34.895971 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe71899-125a-4e27-be8e-d7394a0b95a9 admin admin] PATH_INFO: `/v3/users` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:37:34.896702 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe71899-125a-4e27-be8e-d7394a0b95a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:37:34.898634 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe71899-125a-4e27-be8e-d7394a0b95a9 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:37:34.920138 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1124/2254] 10.222.0.117 () {60 vars in 1148 bytes} [Tue Jan 25 02:37:34 2022] POST /identity/v3/users => generated 288 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 25 02:37:34.924217 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8e5171-10c5-451f-aa4c-d00263518576 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:37:34.935943 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8e5171-10c5-451f-aa4c-d00263518576 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:37:34.940939 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6027e5e6-954c-4bbe-b5be-791c963a9ddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:37:34.941594 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6027e5e6-954c-4bbe-b5be-791c963a9ddb admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:37:34.941904 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6027e5e6-954c-4bbe-b5be-791c963a9ddb admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:37:34.942185 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6027e5e6-954c-4bbe-b5be-791c963a9ddb admin admin] PATH_INFO: `/v3/roles` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:37:34.943646 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6027e5e6-954c-4bbe-b5be-791c963a9ddb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:37:34.944554 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6027e5e6-954c-4bbe-b5be-791c963a9ddb admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:37:34.955299 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1131/2255] 10.222.0.117 () {58 vars in 1126 bytes} [Tue Jan 25 02:37:34 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 02:37:34.960159 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe71899-125a-4e27-be8e-d7394a0b95a9 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:37:34.970793 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe71899-125a-4e27-be8e-d7394a0b95a9 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:37:34.976635 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a8daa8-3819-4f03-811f-1912e0b02b7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:37:34.977311 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a8daa8-3819-4f03-811f-1912e0b02b7f admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:37:34.977596 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a8daa8-3819-4f03-811f-1912e0b02b7f admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:37:34.977868 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a8daa8-3819-4f03-811f-1912e0b02b7f admin admin] PATH_INFO: `/v3/roles` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:37:34.978617 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a8daa8-3819-4f03-811f-1912e0b02b7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:37:34.980262 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a8daa8-3819-4f03-811f-1912e0b02b7f admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:37:34.990504 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1125/2256] 10.222.0.117 () {58 vars in 1126 bytes} [Tue Jan 25 02:37:34 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 02:37:34.995305 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6027e5e6-954c-4bbe-b5be-791c963a9ddb admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:37:35.006168 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6027e5e6-954c-4bbe-b5be-791c963a9ddb admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:37:35.010921 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7986b26b-49ec-4214-b4c8-c5699ae09464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:37:35.011839 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7986b26b-49ec-4214-b4c8-c5699ae09464 admin admin] REQUEST_METHOD: `PUT` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:37:35.012124 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7986b26b-49ec-4214-b4c8-c5699ae09464 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:37:35.012398 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7986b26b-49ec-4214-b4c8-c5699ae09464 admin admin] PATH_INFO: `/v3/projects/8a9bb0c7dc5b4aff91e518a541d3ac57/users/497fdcf73523448f93c9429c22965a1d/roles/33a8e87420ed423f9cb29e0084eab5d2` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:37:35.028633 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7986b26b-49ec-4214-b4c8-c5699ae09464 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a9bb0c7dc5b4aff91e518a541d3ac57, user_id=497fdcf73523448f93c9429c22965a1d, role_id=33a8e87420ed423f9cb29e0084eab5d2)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:37:35.031624 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7986b26b-49ec-4214-b4c8-c5699ae09464 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:37:35.046699 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1132/2257] 10.222.0.117 () {60 vars in 1487 bytes} [Tue Jan 25 02:37:34 2022] PUT /identity/v3/projects/8a9bb0c7dc5b4aff91e518a541d3ac57/users/497fdcf73523448f93c9429c22965a1d/roles/33a8e87420ed423f9cb29e0084eab5d2 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 25 02:37:35.057661 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52df4c07-b0d9-498b-bb6d-96ac7d82eff5 None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:37:35.058039 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52df4c07-b0d9-498b-bb6d-96ac7d82eff5 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:37:35.058394 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52df4c07-b0d9-498b-bb6d-96ac7d82eff5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:37:35.130841 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-52df4c07-b0d9-498b-bb6d-96ac7d82eff5 None None] MFA Rules not processed for user `497fdcf73523448f93c9429c22965a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:37:35.130841 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-52df4c07-b0d9-498b-bb6d-96ac7d82eff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:37:35.205318 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7986b26b-49ec-4214-b4c8-c5699ae09464 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:37:35.208490 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-7986b26b-49ec-4214-b4c8-c5699ae09464 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:37:35.225368 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1126/2258] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:37:35 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:37:35.230842 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52df4c07-b0d9-498b-bb6d-96ac7d82eff5 None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:37:35.315901 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52df4c07-b0d9-498b-bb6d-96ac7d82eff5 None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:37:35.320922 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a46afbe-f440-433d-98b7-208ef4a0ebd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:37:35.321932 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a46afbe-f440-433d-98b7-208ef4a0ebd3 admin admin] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:37:35.322721 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a46afbe-f440-433d-98b7-208ef4a0ebd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:37:35.322721 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a46afbe-f440-433d-98b7-208ef4a0ebd3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:37:35.323265 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a46afbe-f440-433d-98b7-208ef4a0ebd3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:37:35.325222 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a46afbe-f440-433d-98b7-208ef4a0ebd3 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:37:35.326394 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7986b26b-49ec-4214-b4c8-c5699ae09464 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:37:35.332501 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b96ddca-e760-42d1-ba7f-705bb563c6a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:37:35.333448 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b96ddca-e760-42d1-ba7f-705bb563c6a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:37:35.333803 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b96ddca-e760-42d1-ba7f-705bb563c6a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:37:35.334152 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b96ddca-e760-42d1-ba7f-705bb563c6a6 admin admin] PATH_INFO: `/v3/projects/12f72946428a4b5e936cd73d5dfd6c9c` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:37:35.335465 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b96ddca-e760-42d1-ba7f-705bb563c6a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=12f72946428a4b5e936cd73d5dfd6c9c)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:37:35.337512 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b96ddca-e760-42d1-ba7f-705bb563c6a6 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:37:35.369380 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1127/2259] 10.222.0.117 () {60 vars in 1157 bytes} [Tue Jan 25 02:37:35 2022] POST /identity/v3/projects => generated 376 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 02:37:35.370598 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a46afbe-f440-433d-98b7-208ef4a0ebd3 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:37:35.391943 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-8b96ddca-e760-42d1-ba7f-705bb563c6a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12f72946428a4b5e936cd73d5dfd6c9c', 'request_id': 'req-8b96ddca-e760-42d1-ba7f-705bb563c6a6'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:37:35.401144 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-8b96ddca-e760-42d1-ba7f-705bb563c6a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12f72946428a4b5e936cd73d5dfd6c9c', 'request_id': 'req-8b96ddca-e760-42d1-ba7f-705bb563c6a6'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:37:35.411915 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-8b96ddca-e760-42d1-ba7f-705bb563c6a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12f72946428a4b5e936cd73d5dfd6c9c', 'request_id': 'req-8b96ddca-e760-42d1-ba7f-705bb563c6a6'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:37:35.429152 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-8b96ddca-e760-42d1-ba7f-705bb563c6a6 admin admin] The token cache is being invalidate because project 12f72946428a4b5e936cd73d5dfd6c9c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79121) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 25 02:37:35.429625 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-8b96ddca-e760-42d1-ba7f-705bb563c6a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:37:35.431102 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-8b96ddca-e760-42d1-ba7f-705bb563c6a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:37:35.435783 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1133/2260] 10.222.0.117 () {58 vars in 1237 bytes} [Tue Jan 25 02:37:35 2022] DELETE /identity/v3/projects/12f72946428a4b5e936cd73d5dfd6c9c => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:37:35.443231 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b010206-4490-4351-89dc-6f1be94e2415 None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:37:35.443678 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b010206-4490-4351-89dc-6f1be94e2415 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:37:35.444084 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b010206-4490-4351-89dc-6f1be94e2415 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:37:35.462913 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a46afbe-f440-433d-98b7-208ef4a0ebd3 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:37:35.467180 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-5b010206-4490-4351-89dc-6f1be94e2415 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:37:35.469166 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-5b010206-4490-4351-89dc-6f1be94e2415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:37:35.536529 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbd07f1-6c54-4dbc-bdeb-0bf2c64a5865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:37:35.537214 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbd07f1-6c54-4dbc-bdeb-0bf2c64a5865 admin admin] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:37:35.537659 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbd07f1-6c54-4dbc-bdeb-0bf2c64a5865 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:37:35.537845 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbd07f1-6c54-4dbc-bdeb-0bf2c64a5865 admin admin] PATH_INFO: `/v3/users` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:37:35.538574 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbd07f1-6c54-4dbc-bdeb-0bf2c64a5865 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:37:35.541418 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbd07f1-6c54-4dbc-bdeb-0bf2c64a5865 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:37:35.555337 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1134/2261] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:37:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:37:35.562928 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ef9a25-1f80-4579-aa07-a871442b6ba8 None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:37:35.563226 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ef9a25-1f80-4579-aa07-a871442b6ba8 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:37:35.563505 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ef9a25-1f80-4579-aa07-a871442b6ba8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:37:35.564590 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1128/2262] 10.222.0.117 () {60 vars in 1148 bytes} [Tue Jan 25 02:37:35 2022] POST /identity/v3/users => generated 295 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 02:37:35.568881 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbd07f1-6c54-4dbc-bdeb-0bf2c64a5865 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:37:35.573492 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-9bbd07f1-6c54-4dbc-bdeb-0bf2c64a5865 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:37:35.590451 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-06ef9a25-1f80-4579-aa07-a871442b6ba8 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:37:35.592654 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-06ef9a25-1f80-4579-aa07-a871442b6ba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:37:35.595461 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbd07f1-6c54-4dbc-bdeb-0bf2c64a5865 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:37:35.600776 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8cf7d9-1be1-4b78-8181-1afd9b7f990a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:37:35.601579 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1135/2263] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:37:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 25 02:37:35.601762 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8cf7d9-1be1-4b78-8181-1afd9b7f990a admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:37:35.602018 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8cf7d9-1be1-4b78-8181-1afd9b7f990a admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:37:35.602298 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8cf7d9-1be1-4b78-8181-1afd9b7f990a admin admin] PATH_INFO: `/v3/roles` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:37:35.603189 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8cf7d9-1be1-4b78-8181-1afd9b7f990a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:37:35.604931 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8cf7d9-1be1-4b78-8181-1afd9b7f990a admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:37:35.605992 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ef9a25-1f80-4579-aa07-a871442b6ba8 None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:37:35.617227 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ef9a25-1f80-4579-aa07-a871442b6ba8 None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:37:35.617684 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1129/2264] 10.222.0.117 () {58 vars in 1126 bytes} [Tue Jan 25 02:37:35 2022] GET /identity/v3/roles => generated 1427 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 02:37:35.621846 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8cf7d9-1be1-4b78-8181-1afd9b7f990a admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:37:35.622804 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f96c9d-1439-4a83-b9a1-fa6a9113f8af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:37:35.623710 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f96c9d-1439-4a83-b9a1-fa6a9113f8af admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:37:35.624092 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f96c9d-1439-4a83-b9a1-fa6a9113f8af admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:37:35.624442 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f96c9d-1439-4a83-b9a1-fa6a9113f8af admin admin] PATH_INFO: `/v3/domains` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:37:35.625265 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f96c9d-1439-4a83-b9a1-fa6a9113f8af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:37:35.625823 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f96c9d-1439-4a83-b9a1-fa6a9113f8af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:37:35.633411 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8cf7d9-1be1-4b78-8181-1afd9b7f990a admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:37:35.636034 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f96c9d-1439-4a83-b9a1-fa6a9113f8af admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:37:35.641970 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ddb971-baf4-4d65-bb31-c8f52c2d3431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:37:35.642895 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ddb971-baf4-4d65-bb31-c8f52c2d3431 admin admin] REQUEST_METHOD: `PUT` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:37:35.643115 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ddb971-baf4-4d65-bb31-c8f52c2d3431 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:37:35.644034 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ddb971-baf4-4d65-bb31-c8f52c2d3431 admin admin] PATH_INFO: `/v3/projects/0ca07bd9a0714969942fdb4f948da840/users/df2a23c2135f44cebd661eca84517ee1/roles/d8dbc6d83d9d41d28c3feb8b3485b291` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:37:35.652531 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1136/2265] 10.222.0.117 () {58 vars in 1157 bytes} [Tue Jan 25 02:37:35 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:37:35.656473 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f96c9d-1439-4a83-b9a1-fa6a9113f8af admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:37:35.663503 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ddb971-baf4-4d65-bb31-c8f52c2d3431 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ca07bd9a0714969942fdb4f948da840, user_id=df2a23c2135f44cebd661eca84517ee1, role_id=d8dbc6d83d9d41d28c3feb8b3485b291)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:37:35.666365 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ddb971-baf4-4d65-bb31-c8f52c2d3431 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:37:35.668018 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f96c9d-1439-4a83-b9a1-fa6a9113f8af admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:37:35.673523 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4029a2a7-185a-4676-a844-12a349f8b031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:37:35.674298 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4029a2a7-185a-4676-a844-12a349f8b031 admin admin] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:37:35.674607 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4029a2a7-185a-4676-a844-12a349f8b031 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:37:35.675466 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4029a2a7-185a-4676-a844-12a349f8b031 admin admin] PATH_INFO: `/v3/projects` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:37:35.676242 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4029a2a7-185a-4676-a844-12a349f8b031 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:37:35.680108 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4029a2a7-185a-4676-a844-12a349f8b031 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:37:35.684897 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1130/2266] 10.222.0.117 () {60 vars in 1487 bytes} [Tue Jan 25 02:37:35 2022] PUT /identity/v3/projects/0ca07bd9a0714969942fdb4f948da840/users/df2a23c2135f44cebd661eca84517ee1/roles/d8dbc6d83d9d41d28c3feb8b3485b291 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:37:35.688676 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ddb971-baf4-4d65-bb31-c8f52c2d3431 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:37:35.725035 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1137/2267] 10.222.0.117 () {60 vars in 1157 bytes} [Tue Jan 25 02:37:35 2022] POST /identity/v3/projects => generated 386 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 02:37:35.728850 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4029a2a7-185a-4676-a844-12a349f8b031 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:37:35.810399 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ddb971-baf4-4d65-bb31-c8f52c2d3431 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:37:35.829940 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4029a2a7-185a-4676-a844-12a349f8b031 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:37:35.837145 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986c23cc-f28d-45a3-b92e-0b1bf27126f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:37:35.837945 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986c23cc-f28d-45a3-b92e-0b1bf27126f4 admin admin] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:37:35.838238 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986c23cc-f28d-45a3-b92e-0b1bf27126f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:37:35.838523 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986c23cc-f28d-45a3-b92e-0b1bf27126f4 admin admin] PATH_INFO: `/v3/users` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:37:35.839248 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986c23cc-f28d-45a3-b92e-0b1bf27126f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:37:35.842062 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986c23cc-f28d-45a3-b92e-0b1bf27126f4 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:37:35.870351 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1138/2268] 10.222.0.117 () {60 vars in 1148 bytes} [Tue Jan 25 02:37:35 2022] POST /identity/v3/users => generated 294 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 02:37:35.874683 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986c23cc-f28d-45a3-b92e-0b1bf27126f4 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:37:35.905744 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986c23cc-f28d-45a3-b92e-0b1bf27126f4 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:37:35.923364 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97744962-2505-4727-a18f-e4c02a857f1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:37:35.924535 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97744962-2505-4727-a18f-e4c02a857f1c admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:37:35.925061 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97744962-2505-4727-a18f-e4c02a857f1c admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:37:35.925603 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97744962-2505-4727-a18f-e4c02a857f1c admin admin] PATH_INFO: `/v3/roles` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:37:35.926786 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97744962-2505-4727-a18f-e4c02a857f1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:37:35.929411 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97744962-2505-4727-a18f-e4c02a857f1c admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:37:35.945630 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1139/2269] 10.222.0.117 () {58 vars in 1126 bytes} [Tue Jan 25 02:37:35 2022] GET /identity/v3/roles => generated 1427 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 02:37:35.951149 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97744962-2505-4727-a18f-e4c02a857f1c admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:37:35.959171 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5175edb-a9af-4973-b73f-a7e4d1b04819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:37:35.960241 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5175edb-a9af-4973-b73f-a7e4d1b04819 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:37:35.960625 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5175edb-a9af-4973-b73f-a7e4d1b04819 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:37:35.961003 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5175edb-a9af-4973-b73f-a7e4d1b04819 admin admin] PATH_INFO: `/v3/roles` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:37:35.962490 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5175edb-a9af-4973-b73f-a7e4d1b04819 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:37:35.964565 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5175edb-a9af-4973-b73f-a7e4d1b04819 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:37:35.966422 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97744962-2505-4727-a18f-e4c02a857f1c admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:37:35.973580 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573fd124-38ec-470e-9054-b668d31e286b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:37:35.974606 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573fd124-38ec-470e-9054-b668d31e286b admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:37:35.975082 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573fd124-38ec-470e-9054-b668d31e286b admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:37:35.975519 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573fd124-38ec-470e-9054-b668d31e286b admin admin] PATH_INFO: `/v3/roles` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:37:35.976930 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573fd124-38ec-470e-9054-b668d31e286b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:37:35.979980 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573fd124-38ec-470e-9054-b668d31e286b admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:37:35.981783 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1131/2270] 10.222.0.117 () {58 vars in 1126 bytes} [Tue Jan 25 02:37:35 2022] GET /identity/v3/roles => generated 1427 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 25 02:37:35.988586 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5175edb-a9af-4973-b73f-a7e4d1b04819 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:37:36.005693 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1140/2271] 10.222.0.117 () {58 vars in 1126 bytes} [Tue Jan 25 02:37:35 2022] GET /identity/v3/roles => generated 1427 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 25 02:37:36.006753 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573fd124-38ec-470e-9054-b668d31e286b admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:37:36.010727 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5175edb-a9af-4973-b73f-a7e4d1b04819 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:37:36.017225 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573fd124-38ec-470e-9054-b668d31e286b admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:37:36.020351 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331d92f8-fb59-40ab-8a1b-576bfbe8704e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:37:36.021911 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331d92f8-fb59-40ab-8a1b-576bfbe8704e admin admin] REQUEST_METHOD: `PUT` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:37:36.022491 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331d92f8-fb59-40ab-8a1b-576bfbe8704e admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:37:36.022970 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331d92f8-fb59-40ab-8a1b-576bfbe8704e admin admin] PATH_INFO: `/v3/projects/0ca07bd9a0714969942fdb4f948da840/users/df2a23c2135f44cebd661eca84517ee1/roles/d8dbc6d83d9d41d28c3feb8b3485b291` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:37:36.024690 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7874e5aa-623f-42ef-98b5-19ad49bf6ba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:37:36.026193 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7874e5aa-623f-42ef-98b5-19ad49bf6ba5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:37:36.026580 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7874e5aa-623f-42ef-98b5-19ad49bf6ba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:37:36.026682 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331d92f8-fb59-40ab-8a1b-576bfbe8704e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ca07bd9a0714969942fdb4f948da840, user_id=df2a23c2135f44cebd661eca84517ee1, role_id=d8dbc6d83d9d41d28c3feb8b3485b291)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:37:36.027034 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7874e5aa-623f-42ef-98b5-19ad49bf6ba5 admin admin] PATH_INFO: `/v3/projects/9f96268e961a4880bae18fba4ba02872/users/b2066183f2054f7790f7b34f47d4bd8a/roles/33a8e87420ed423f9cb29e0084eab5d2` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:37:36.032159 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331d92f8-fb59-40ab-8a1b-576bfbe8704e admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:37:36.047879 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7874e5aa-623f-42ef-98b5-19ad49bf6ba5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f96268e961a4880bae18fba4ba02872, user_id=b2066183f2054f7790f7b34f47d4bd8a, role_id=33a8e87420ed423f9cb29e0084eab5d2)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:37:36.050759 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7874e5aa-623f-42ef-98b5-19ad49bf6ba5 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:37:36.054954 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1132/2272] 10.222.0.117 () {60 vars in 1487 bytes} [Tue Jan 25 02:37:35 2022] PUT /identity/v3/projects/0ca07bd9a0714969942fdb4f948da840/users/df2a23c2135f44cebd661eca84517ee1/roles/d8dbc6d83d9d41d28c3feb8b3485b291 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:37:36.056965 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcf0cf6-8a87-4ad1-be12-4dbac7827fed None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:37:36.057347 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcf0cf6-8a87-4ad1-be12-4dbac7827fed None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:37:36.057671 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcf0cf6-8a87-4ad1-be12-4dbac7827fed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:37:36.066650 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1141/2273] 10.222.0.117 () {60 vars in 1487 bytes} [Tue Jan 25 02:37:36 2022] PUT /identity/v3/projects/9f96268e961a4880bae18fba4ba02872/users/b2066183f2054f7790f7b34f47d4bd8a/roles/33a8e87420ed423f9cb29e0084eab5d2 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:37:36.080193 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c491759-f2da-439a-b8fa-e7f686eea4e6 None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:37:36.080492 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c491759-f2da-439a-b8fa-e7f686eea4e6 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:37:36.080679 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c491759-f2da-439a-b8fa-e7f686eea4e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:37:36.091231 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-6dcf0cf6-8a87-4ad1-be12-4dbac7827fed None None] MFA Rules not processed for user `df2a23c2135f44cebd661eca84517ee1`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:37:36.092602 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-6dcf0cf6-8a87-4ad1-be12-4dbac7827fed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:37:36.111362 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-7c491759-f2da-439a-b8fa-e7f686eea4e6 None None] MFA Rules not processed for user `b2066183f2054f7790f7b34f47d4bd8a`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:37:36.113316 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-7c491759-f2da-439a-b8fa-e7f686eea4e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:37:36.171476 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1133/2274] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:37:36 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:37:36.185913 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcf0cf6-8a87-4ad1-be12-4dbac7827fed None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:37:36.187851 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-6dcf0cf6-8a87-4ad1-be12-4dbac7827fed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:37:36.189611 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1142/2275] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:37:36 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 25 02:37:36.199910 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c491759-f2da-439a-b8fa-e7f686eea4e6 None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:37:36.201328 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-7c491759-f2da-439a-b8fa-e7f686eea4e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:37:36.255381 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcf0cf6-8a87-4ad1-be12-4dbac7827fed None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:37:36.260056 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afde61bc-bf68-4de8-84cc-847ff809dd2c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cc5249aea09430080e232cf17757f86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:37:36.260982 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afde61bc-bf68-4de8-84cc-847ff809dd2c service cinder] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:37:36.261270 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afde61bc-bf68-4de8-84cc-847ff809dd2c service cinder] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:37:36.261551 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afde61bc-bf68-4de8-84cc-847ff809dd2c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:37:36.263468 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-afde61bc-bf68-4de8-84cc-847ff809dd2c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:37:36.277305 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c491759-f2da-439a-b8fa-e7f686eea4e6 None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:37:36.281906 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82344d1d-9b91-4948-864b-a6cfb811caae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cc5249aea09430080e232cf17757f86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:37:36.283019 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82344d1d-9b91-4948-864b-a6cfb811caae service cinder] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:37:36.283536 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82344d1d-9b91-4948-864b-a6cfb811caae service cinder] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:37:36.284709 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82344d1d-9b91-4948-864b-a6cfb811caae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:37:36.295659 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82344d1d-9b91-4948-864b-a6cfb811caae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:37:36.297312 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82344d1d-9b91-4948-864b-a6cfb811caae service cinder] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:37:36.320620 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1143/2276] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:37:36 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 25 02:37:36.352111 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afde61bc-bf68-4de8-84cc-847ff809dd2c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:37:36.353634 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afde61bc-bf68-4de8-84cc-847ff809dd2c service cinder] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:37:36.374670 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1134/2277] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:37:36 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:37:36.751371 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d41e0f9-87be-4b22-be34-1ecfcb584a48 None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:37:36.752225 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d41e0f9-87be-4b22-be34-1ecfcb584a48 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:37:36.752684 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d41e0f9-87be-4b22-be34-1ecfcb584a48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:37:36.776961 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-3d41e0f9-87be-4b22-be34-1ecfcb584a48 None None] MFA Rules not processed for user `a3a11152b2324f51b9120ec8fc90e227`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:37:36.778194 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-3d41e0f9-87be-4b22-be34-1ecfcb584a48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:37:36.880536 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1144/2278] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:37:36 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:37:38.590087 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afde61bc-bf68-4de8-84cc-847ff809dd2c service cinder] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:37:38.591688 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-afde61bc-bf68-4de8-84cc-847ff809dd2c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:37:38.650526 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afde61bc-bf68-4de8-84cc-847ff809dd2c service cinder] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:37:38.655240 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703fb681-8204-4c3c-9227-d517f81cc40d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca4071c5f8f4a31b5edb81fa66a43a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:37:38.655924 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703fb681-8204-4c3c-9227-d517f81cc40d service neutron] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:37:38.656206 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703fb681-8204-4c3c-9227-d517f81cc40d service neutron] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:37:38.656483 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703fb681-8204-4c3c-9227-d517f81cc40d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:37:38.658316 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-703fb681-8204-4c3c-9227-d517f81cc40d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:37:38.725115 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703fb681-8204-4c3c-9227-d517f81cc40d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:37:38.726616 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703fb681-8204-4c3c-9227-d517f81cc40d service neutron] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:37:38.735981 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1135/2279] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:37:38 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 25 02:37:40.108564 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d41e0f9-87be-4b22-be34-1ecfcb584a48 None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:37:40.202815 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703fb681-8204-4c3c-9227-d517f81cc40d service neutron] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:37:40.210352 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d41e0f9-87be-4b22-be34-1ecfcb584a48 None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:37:40.216482 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703fb681-8204-4c3c-9227-d517f81cc40d service neutron] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:37:40.216875 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3e5efb-f72c-4b8c-92d7-06e4557763f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:37:40.218197 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3e5efb-f72c-4b8c-92d7-06e4557763f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:37:40.218739 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3e5efb-f72c-4b8c-92d7-06e4557763f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:37:40.219360 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3e5efb-f72c-4b8c-92d7-06e4557763f2 admin admin] PATH_INFO: `/v3/users/b2066183f2054f7790f7b34f47d4bd8a` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:37:40.222445 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3e5efb-f72c-4b8c-92d7-06e4557763f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2066183f2054f7790f7b34f47d4bd8a)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:37:40.222647 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103689a9-ea5d-4e38-bf3d-68a6dac4a6ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:37:40.223900 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103689a9-ea5d-4e38-bf3d-68a6dac4a6ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:37:40.224392 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103689a9-ea5d-4e38-bf3d-68a6dac4a6ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:37:40.224499 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3e5efb-f72c-4b8c-92d7-06e4557763f2 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:37:40.224969 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103689a9-ea5d-4e38-bf3d-68a6dac4a6ea admin admin] PATH_INFO: `/v3/users/497fdcf73523448f93c9429c22965a1d` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:37:40.226421 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103689a9-ea5d-4e38-bf3d-68a6dac4a6ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=497fdcf73523448f93c9429c22965a1d)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:37:40.228838 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103689a9-ea5d-4e38-bf3d-68a6dac4a6ea admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:37:40.310821 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-103689a9-ea5d-4e38-bf3d-68a6dac4a6ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '497fdcf73523448f93c9429c22965a1d'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:37:40.320678 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-9a3e5efb-f72c-4b8c-92d7-06e4557763f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2066183f2054f7790f7b34f47d4bd8a'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:37:40.321689 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-9a3e5efb-f72c-4b8c-92d7-06e4557763f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2066183f2054f7790f7b34f47d4bd8a'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:37:40.337668 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-9a3e5efb-f72c-4b8c-92d7-06e4557763f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2066183f2054f7790f7b34f47d4bd8a'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:37:40.338463 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-103689a9-ea5d-4e38-bf3d-68a6dac4a6ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '497fdcf73523448f93c9429c22965a1d'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:37:40.338714 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-9a3e5efb-f72c-4b8c-92d7-06e4557763f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2066183f2054f7790f7b34f47d4bd8a'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:37:40.340115 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-103689a9-ea5d-4e38-bf3d-68a6dac4a6ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '497fdcf73523448f93c9429c22965a1d'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:37:40.341173 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-103689a9-ea5d-4e38-bf3d-68a6dac4a6ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '497fdcf73523448f93c9429c22965a1d'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:37:40.355103 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-9a3e5efb-f72c-4b8c-92d7-06e4557763f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2066183f2054f7790f7b34f47d4bd8a'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:37:40.370967 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-103689a9-ea5d-4e38-bf3d-68a6dac4a6ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '497fdcf73523448f93c9429c22965a1d'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:37:40.398417 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1145/2280] 10.222.0.117 () {58 vars in 1228 bytes} [Tue Jan 25 02:37:40 2022] DELETE /identity/v3/users/b2066183f2054f7790f7b34f47d4bd8a => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:37:40.403153 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edc7eb4-053d-481d-8a42-6226bdad8ff8 None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:37:40.403530 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edc7eb4-053d-481d-8a42-6226bdad8ff8 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:37:40.403982 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edc7eb4-053d-481d-8a42-6226bdad8ff8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:37:40.407818 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1136/2281] 10.222.0.117 () {58 vars in 1228 bytes} [Tue Jan 25 02:37:40 2022] DELETE /identity/v3/users/497fdcf73523448f93c9429c22965a1d => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:37:40.410505 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a94948-8265-4232-bba7-3b64e6b21478 None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:37:40.410811 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a94948-8265-4232-bba7-3b64e6b21478 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:37:40.411094 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a94948-8265-4232-bba7-3b64e6b21478 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:37:40.428397 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-0edc7eb4-053d-481d-8a42-6226bdad8ff8 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:37:40.430524 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-0edc7eb4-053d-481d-8a42-6226bdad8ff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:37:40.467568 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-e2a94948-8265-4232-bba7-3b64e6b21478 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:37:40.470878 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-e2a94948-8265-4232-bba7-3b64e6b21478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:37:40.608888 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1146/2282] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:37:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 25 02:37:40.632411 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edc7eb4-053d-481d-8a42-6226bdad8ff8 None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:37:40.634332 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-0edc7eb4-053d-481d-8a42-6226bdad8ff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:37:40.659661 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1137/2283] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:37:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:37:40.700435 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a94948-8265-4232-bba7-3b64e6b21478 None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:37:40.701990 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-e2a94948-8265-4232-bba7-3b64e6b21478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:37:40.758327 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edc7eb4-053d-481d-8a42-6226bdad8ff8 None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:37:40.767986 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72288f6-be12-4d5a-b41f-d7e74cac5c1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca4071c5f8f4a31b5edb81fa66a43a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:37:40.768693 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72288f6-be12-4d5a-b41f-d7e74cac5c1a service neutron] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:37:40.769041 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72288f6-be12-4d5a-b41f-d7e74cac5c1a service neutron] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:37:40.769258 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72288f6-be12-4d5a-b41f-d7e74cac5c1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:37:40.792234 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a94948-8265-4232-bba7-3b64e6b21478 None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:37:40.794620 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72288f6-be12-4d5a-b41f-d7e74cac5c1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:37:40.796674 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110bf109-5d84-4fe8-a2e1-2b16d196b985 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca4071c5f8f4a31b5edb81fa66a43a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:37:40.797237 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72288f6-be12-4d5a-b41f-d7e74cac5c1a service neutron] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:37:40.797516 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110bf109-5d84-4fe8-a2e1-2b16d196b985 service neutron] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:37:40.797788 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110bf109-5d84-4fe8-a2e1-2b16d196b985 service neutron] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:37:40.798064 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110bf109-5d84-4fe8-a2e1-2b16d196b985 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:37:40.817565 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110bf109-5d84-4fe8-a2e1-2b16d196b985 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:37:40.817830 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1147/2284] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:37:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 25 02:37:40.819270 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110bf109-5d84-4fe8-a2e1-2b16d196b985 service neutron] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:37:40.830754 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1138/2285] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:37:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:37:41.707891 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72288f6-be12-4d5a-b41f-d7e74cac5c1a service neutron] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:37:41.709611 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-f72288f6-be12-4d5a-b41f-d7e74cac5c1a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:37:41.717791 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110bf109-5d84-4fe8-a2e1-2b16d196b985 service neutron] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:37:41.719357 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-110bf109-5d84-4fe8-a2e1-2b16d196b985 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:37:41.741170 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110bf109-5d84-4fe8-a2e1-2b16d196b985 service neutron] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:37:41.742006 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72288f6-be12-4d5a-b41f-d7e74cac5c1a service neutron] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:37:41.764650 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4a9d4d-15a1-432c-8ad9-ac992162830d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:37:41.764953 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf3d8e1-e5de-48f5-8d09-041048bdedd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:37:41.780232 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4a9d4d-15a1-432c-8ad9-ac992162830d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:37:41.780329 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf3d8e1-e5de-48f5-8d09-041048bdedd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:37:41.781104 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf3d8e1-e5de-48f5-8d09-041048bdedd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:37:41.781838 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4a9d4d-15a1-432c-8ad9-ac992162830d admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:37:41.782189 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf3d8e1-e5de-48f5-8d09-041048bdedd1 admin admin] PATH_INFO: `/v3/projects/9f96268e961a4880bae18fba4ba02872` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:37:41.782672 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4a9d4d-15a1-432c-8ad9-ac992162830d admin admin] PATH_INFO: `/v3/projects/8a9bb0c7dc5b4aff91e518a541d3ac57` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:37:41.793154 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4a9d4d-15a1-432c-8ad9-ac992162830d admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a9bb0c7dc5b4aff91e518a541d3ac57)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:37:41.793816 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf3d8e1-e5de-48f5-8d09-041048bdedd1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f96268e961a4880bae18fba4ba02872)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:37:41.802025 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf3d8e1-e5de-48f5-8d09-041048bdedd1 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:37:41.810137 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4a9d4d-15a1-432c-8ad9-ac992162830d admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:37:41.960767 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-adf3d8e1-e5de-48f5-8d09-041048bdedd1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f96268e961a4880bae18fba4ba02872', 'request_id': 'req-adf3d8e1-e5de-48f5-8d09-041048bdedd1'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:37:41.969501 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-6e4a9d4d-15a1-432c-8ad9-ac992162830d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a9bb0c7dc5b4aff91e518a541d3ac57', 'request_id': 'req-6e4a9d4d-15a1-432c-8ad9-ac992162830d'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:37:41.978731 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-adf3d8e1-e5de-48f5-8d09-041048bdedd1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f96268e961a4880bae18fba4ba02872', 'request_id': 'req-adf3d8e1-e5de-48f5-8d09-041048bdedd1'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:37:41.984134 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-6e4a9d4d-15a1-432c-8ad9-ac992162830d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a9bb0c7dc5b4aff91e518a541d3ac57', 'request_id': 'req-6e4a9d4d-15a1-432c-8ad9-ac992162830d'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:37:41.996608 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-6e4a9d4d-15a1-432c-8ad9-ac992162830d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a9bb0c7dc5b4aff91e518a541d3ac57', 'request_id': 'req-6e4a9d4d-15a1-432c-8ad9-ac992162830d'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:37:42.010417 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-adf3d8e1-e5de-48f5-8d09-041048bdedd1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f96268e961a4880bae18fba4ba02872', 'request_id': 'req-adf3d8e1-e5de-48f5-8d09-041048bdedd1'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:37:42.033106 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-adf3d8e1-e5de-48f5-8d09-041048bdedd1 admin admin] The token cache is being invalidate because project 9f96268e961a4880bae18fba4ba02872 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79121) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 25 02:37:42.033903 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-adf3d8e1-e5de-48f5-8d09-041048bdedd1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:37:42.036310 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-adf3d8e1-e5de-48f5-8d09-041048bdedd1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:37:42.039170 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1148/2286] 10.222.0.117 () {58 vars in 1237 bytes} [Tue Jan 25 02:37:41 2022] DELETE /identity/v3/projects/9f96268e961a4880bae18fba4ba02872 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:37:42.050536 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9d3149-b2c0-400e-a220-390f13f70f8c None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:37:42.051492 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9d3149-b2c0-400e-a220-390f13f70f8c None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:37:42.052033 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9d3149-b2c0-400e-a220-390f13f70f8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:37:42.052171 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-6e4a9d4d-15a1-432c-8ad9-ac992162830d admin admin] The token cache is being invalidate because project 8a9bb0c7dc5b4aff91e518a541d3ac57 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79120) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 25 02:37:42.053786 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-6e4a9d4d-15a1-432c-8ad9-ac992162830d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:37:42.056251 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-6e4a9d4d-15a1-432c-8ad9-ac992162830d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:37:42.059412 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1139/2287] 10.222.0.117 () {58 vars in 1237 bytes} [Tue Jan 25 02:37:41 2022] DELETE /identity/v3/projects/8a9bb0c7dc5b4aff91e518a541d3ac57 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:37:42.067560 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4a9d4d-15a1-432c-8ad9-ac992162830d admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:37:42.074912 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-6e4a9d4d-15a1-432c-8ad9-ac992162830d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:37:42.100091 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-8e9d3149-b2c0-400e-a220-390f13f70f8c None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:37:42.102897 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-8e9d3149-b2c0-400e-a220-390f13f70f8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:37:42.294754 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1149/2288] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:37:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:37:42.302051 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4a9d4d-15a1-432c-8ad9-ac992162830d admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:37:42.306566 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00078b6-a896-493a-8c35-1ec191b09c3f None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:37:42.306863 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00078b6-a896-493a-8c35-1ec191b09c3f None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:37:42.307146 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00078b6-a896-493a-8c35-1ec191b09c3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:37:42.320949 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7373eb48-bff0-4ede-bef5-5961a0f50cb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:37:42.322477 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7373eb48-bff0-4ede-bef5-5961a0f50cb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:37:42.322770 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7373eb48-bff0-4ede-bef5-5961a0f50cb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:37:42.323045 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7373eb48-bff0-4ede-bef5-5961a0f50cb3 admin admin] PATH_INFO: `/v3/users/df2a23c2135f44cebd661eca84517ee1` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:37:42.325965 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7373eb48-bff0-4ede-bef5-5961a0f50cb3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=df2a23c2135f44cebd661eca84517ee1)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:37:42.333625 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7373eb48-bff0-4ede-bef5-5961a0f50cb3 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:37:42.352317 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-f00078b6-a896-493a-8c35-1ec191b09c3f None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:37:42.356467 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-f00078b6-a896-493a-8c35-1ec191b09c3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:37:42.386900 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1150/2289] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:37:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:37:42.388135 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00078b6-a896-493a-8c35-1ec191b09c3f None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:37:42.411729 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00078b6-a896-493a-8c35-1ec191b09c3f None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:37:42.429902 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfef425-447f-4f76-bd96-c9b5d01263ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:37:42.433567 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfef425-447f-4f76-bd96-c9b5d01263ca admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:37:42.434704 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfef425-447f-4f76-bd96-c9b5d01263ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:37:42.436072 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfef425-447f-4f76-bd96-c9b5d01263ca admin admin] PATH_INFO: `/v3/domains` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:37:42.438247 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfef425-447f-4f76-bd96-c9b5d01263ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:37:42.438564 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfef425-447f-4f76-bd96-c9b5d01263ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:37:42.446425 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfef425-447f-4f76-bd96-c9b5d01263ca admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:37:42.464389 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-7373eb48-bff0-4ede-bef5-5961a0f50cb3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df2a23c2135f44cebd661eca84517ee1'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:37:42.481778 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-7373eb48-bff0-4ede-bef5-5961a0f50cb3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df2a23c2135f44cebd661eca84517ee1'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:37:42.482749 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-7373eb48-bff0-4ede-bef5-5961a0f50cb3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df2a23c2135f44cebd661eca84517ee1'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:37:42.489545 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-7373eb48-bff0-4ede-bef5-5961a0f50cb3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df2a23c2135f44cebd661eca84517ee1'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:37:42.489729 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1151/2290] 10.222.0.117 () {58 vars in 1157 bytes} [Tue Jan 25 02:37:42 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:37:42.492522 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfef425-447f-4f76-bd96-c9b5d01263ca admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:37:42.496232 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-4bfef425-447f-4f76-bd96-c9b5d01263ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:37:42.516814 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-7373eb48-bff0-4ede-bef5-5961a0f50cb3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df2a23c2135f44cebd661eca84517ee1'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:37:42.526734 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfef425-447f-4f76-bd96-c9b5d01263ca admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:37:42.540304 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41548b7-e26e-42b2-b8ef-656244b984c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:37:42.541789 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41548b7-e26e-42b2-b8ef-656244b984c6 admin admin] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:37:42.542076 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41548b7-e26e-42b2-b8ef-656244b984c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:37:42.542514 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41548b7-e26e-42b2-b8ef-656244b984c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:37:42.543067 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41548b7-e26e-42b2-b8ef-656244b984c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:37:42.548586 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41548b7-e26e-42b2-b8ef-656244b984c6 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:37:42.561512 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1140/2291] 10.222.0.117 () {58 vars in 1228 bytes} [Tue Jan 25 02:37:42 2022] DELETE /identity/v3/users/df2a23c2135f44cebd661eca84517ee1 => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:37:42.605276 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1152/2292] 10.222.0.117 () {60 vars in 1157 bytes} [Tue Jan 25 02:37:42 2022] POST /identity/v3/projects => generated 370 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 02:37:42.609269 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7373eb48-bff0-4ede-bef5-5961a0f50cb3 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:37:42.742969 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7373eb48-bff0-4ede-bef5-5961a0f50cb3 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:37:42.894639 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b2d785-daa7-4cbd-b15d-42549da6847d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:37:42.895786 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b2d785-daa7-4cbd-b15d-42549da6847d admin admin] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:37:42.897250 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b2d785-daa7-4cbd-b15d-42549da6847d admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:37:42.897689 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b2d785-daa7-4cbd-b15d-42549da6847d admin admin] PATH_INFO: `/v3/users` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:37:42.901476 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b2d785-daa7-4cbd-b15d-42549da6847d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:37:42.905239 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b2d785-daa7-4cbd-b15d-42549da6847d admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:37:42.949118 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1141/2293] 10.222.0.117 () {60 vars in 1148 bytes} [Tue Jan 25 02:37:42 2022] POST /identity/v3/users => generated 286 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 02:37:42.954026 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41548b7-e26e-42b2-b8ef-656244b984c6 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:37:42.977403 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41548b7-e26e-42b2-b8ef-656244b984c6 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:37:42.982862 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d573196-3a81-4bdf-84b8-dc8e77596fd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:37:42.984055 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d573196-3a81-4bdf-84b8-dc8e77596fd5 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:37:42.984698 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d573196-3a81-4bdf-84b8-dc8e77596fd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:37:42.985216 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d573196-3a81-4bdf-84b8-dc8e77596fd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:37:42.986232 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d573196-3a81-4bdf-84b8-dc8e77596fd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:37:42.989867 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d573196-3a81-4bdf-84b8-dc8e77596fd5 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:37:43.013139 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1153/2294] 10.222.0.117 () {58 vars in 1126 bytes} [Tue Jan 25 02:37:42 2022] GET /identity/v3/roles => generated 1427 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 02:37:43.017427 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b2d785-daa7-4cbd-b15d-42549da6847d admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:37:43.038102 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b2d785-daa7-4cbd-b15d-42549da6847d admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:37:43.056048 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43a9d97-b8f1-400b-a317-83d2a13d1495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:37:43.058239 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43a9d97-b8f1-400b-a317-83d2a13d1495 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:37:43.059911 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43a9d97-b8f1-400b-a317-83d2a13d1495 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:37:43.061792 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43a9d97-b8f1-400b-a317-83d2a13d1495 admin admin] PATH_INFO: `/v3/roles` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:37:43.062704 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43a9d97-b8f1-400b-a317-83d2a13d1495 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:37:43.070346 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43a9d97-b8f1-400b-a317-83d2a13d1495 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:37:43.098064 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1142/2295] 10.222.0.117 () {58 vars in 1126 bytes} [Tue Jan 25 02:37:43 2022] GET /identity/v3/roles => generated 1427 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 02:37:43.099960 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d573196-3a81-4bdf-84b8-dc8e77596fd5 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:37:43.117524 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d573196-3a81-4bdf-84b8-dc8e77596fd5 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:37:43.138786 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840126cd-2edf-4959-a467-fd60904fcb5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:37:43.139907 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840126cd-2edf-4959-a467-fd60904fcb5a admin admin] REQUEST_METHOD: `PUT` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:37:43.140327 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840126cd-2edf-4959-a467-fd60904fcb5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:37:43.140654 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840126cd-2edf-4959-a467-fd60904fcb5a admin admin] PATH_INFO: `/v3/projects/6b2b7f1df6f240f184b9a03603619ec0/users/20029276fe6f426395cd8d2b6f87cdbe/roles/33a8e87420ed423f9cb29e0084eab5d2` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:37:43.161769 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840126cd-2edf-4959-a467-fd60904fcb5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b2b7f1df6f240f184b9a03603619ec0, user_id=20029276fe6f426395cd8d2b6f87cdbe, role_id=33a8e87420ed423f9cb29e0084eab5d2)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:37:43.166259 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840126cd-2edf-4959-a467-fd60904fcb5a admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:37:43.191815 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1154/2296] 10.222.0.117 () {60 vars in 1487 bytes} [Tue Jan 25 02:37:43 2022] PUT /identity/v3/projects/6b2b7f1df6f240f184b9a03603619ec0/users/20029276fe6f426395cd8d2b6f87cdbe/roles/33a8e87420ed423f9cb29e0084eab5d2 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:37:43.199738 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6799ca-645c-463a-b1b9-d0352cfa2cb3 None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:37:43.200030 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6799ca-645c-463a-b1b9-d0352cfa2cb3 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:37:43.200317 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6799ca-645c-463a-b1b9-d0352cfa2cb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:37:43.232695 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-fc6799ca-645c-463a-b1b9-d0352cfa2cb3 None None] MFA Rules not processed for user `20029276fe6f426395cd8d2b6f87cdbe`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:37:43.233950 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-fc6799ca-645c-463a-b1b9-d0352cfa2cb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:37:43.313682 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1143/2297] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:37:43 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:37:43.323242 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840126cd-2edf-4959-a467-fd60904fcb5a admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:37:43.325285 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-840126cd-2edf-4959-a467-fd60904fcb5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:37:43.403601 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840126cd-2edf-4959-a467-fd60904fcb5a admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:37:43.411661 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99abf259-23ae-4ad7-953e-93c0bcfeadbf service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db3663416137459d9da4a71032505b0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:37:43.412612 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99abf259-23ae-4ad7-953e-93c0bcfeadbf service glance] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:37:43.412612 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99abf259-23ae-4ad7-953e-93c0bcfeadbf service glance] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:37:43.412905 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99abf259-23ae-4ad7-953e-93c0bcfeadbf service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:37:43.422991 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99abf259-23ae-4ad7-953e-93c0bcfeadbf service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:37:43.424479 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99abf259-23ae-4ad7-953e-93c0bcfeadbf service glance] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:37:43.435314 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1155/2298] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:37:43 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:37:43.916843 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6799ca-645c-463a-b1b9-d0352cfa2cb3 None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:37:43.919220 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-fc6799ca-645c-463a-b1b9-d0352cfa2cb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:37:44.016860 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6799ca-645c-463a-b1b9-d0352cfa2cb3 None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:37:44.030300 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7f8100-1a3b-4024-84a8-a436862ee227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:37:44.031507 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7f8100-1a3b-4024-84a8-a436862ee227 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:37:44.031975 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7f8100-1a3b-4024-84a8-a436862ee227 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:37:44.032359 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7f8100-1a3b-4024-84a8-a436862ee227 admin admin] PATH_INFO: `/v3/projects/0ca07bd9a0714969942fdb4f948da840` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:37:44.035674 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7f8100-1a3b-4024-84a8-a436862ee227 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ca07bd9a0714969942fdb4f948da840)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:37:44.041343 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7f8100-1a3b-4024-84a8-a436862ee227 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:37:44.150454 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-2d7f8100-1a3b-4024-84a8-a436862ee227 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ca07bd9a0714969942fdb4f948da840', 'request_id': 'req-2d7f8100-1a3b-4024-84a8-a436862ee227'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:37:44.165450 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-2d7f8100-1a3b-4024-84a8-a436862ee227 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ca07bd9a0714969942fdb4f948da840', 'request_id': 'req-2d7f8100-1a3b-4024-84a8-a436862ee227'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:37:44.179680 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-2d7f8100-1a3b-4024-84a8-a436862ee227 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ca07bd9a0714969942fdb4f948da840', 'request_id': 'req-2d7f8100-1a3b-4024-84a8-a436862ee227'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:37:44.205368 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-2d7f8100-1a3b-4024-84a8-a436862ee227 admin admin] The token cache is being invalidate because project 0ca07bd9a0714969942fdb4f948da840 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79120) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 25 02:37:44.206485 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-2d7f8100-1a3b-4024-84a8-a436862ee227 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:37:44.207732 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-2d7f8100-1a3b-4024-84a8-a436862ee227 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:37:44.210017 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1144/2299] 10.222.0.117 () {58 vars in 1237 bytes} [Tue Jan 25 02:37:43 2022] DELETE /identity/v3/projects/0ca07bd9a0714969942fdb4f948da840 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:37:44.216050 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5871c0-5639-4319-951a-27a47a635a67 None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:37:44.216586 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5871c0-5639-4319-951a-27a47a635a67 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:37:44.216885 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5871c0-5639-4319-951a-27a47a635a67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:37:44.246889 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-ba5871c0-5639-4319-951a-27a47a635a67 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:37:44.253842 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-ba5871c0-5639-4319-951a-27a47a635a67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:37:44.373180 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1156/2300] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:37:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:37:44.381308 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d28f48e-e36b-4ba7-ac61-d853ed5ad4d0 None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:37:44.381604 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d28f48e-e36b-4ba7-ac61-d853ed5ad4d0 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:37:44.381914 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d28f48e-e36b-4ba7-ac61-d853ed5ad4d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:37:44.432551 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-3d28f48e-e36b-4ba7-ac61-d853ed5ad4d0 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:37:44.433973 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-3d28f48e-e36b-4ba7-ac61-d853ed5ad4d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:37:44.458637 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1145/2301] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:37:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:37:44.463112 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5871c0-5639-4319-951a-27a47a635a67 None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:37:44.477444 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5871c0-5639-4319-951a-27a47a635a67 None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:37:44.490175 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eead97a6-f483-4e0c-9370-d24650cb65e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:37:44.491280 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eead97a6-f483-4e0c-9370-d24650cb65e6 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:37:44.491571 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eead97a6-f483-4e0c-9370-d24650cb65e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:37:44.491875 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eead97a6-f483-4e0c-9370-d24650cb65e6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:37:44.492700 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eead97a6-f483-4e0c-9370-d24650cb65e6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:37:44.492989 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eead97a6-f483-4e0c-9370-d24650cb65e6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:37:44.494621 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eead97a6-f483-4e0c-9370-d24650cb65e6 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:37:44.528731 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1157/2302] 10.222.0.117 () {58 vars in 1157 bytes} [Tue Jan 25 02:37:44 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 02:37:44.537690 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d28f48e-e36b-4ba7-ac61-d853ed5ad4d0 None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:37:44.556333 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d28f48e-e36b-4ba7-ac61-d853ed5ad4d0 None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:37:44.570751 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62cd0ff-441d-4ddd-8872-d676f699d078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:37:44.571497 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62cd0ff-441d-4ddd-8872-d676f699d078 admin admin] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:37:44.571900 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62cd0ff-441d-4ddd-8872-d676f699d078 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:37:44.572500 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62cd0ff-441d-4ddd-8872-d676f699d078 admin admin] PATH_INFO: `/v3/projects` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:37:44.573294 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62cd0ff-441d-4ddd-8872-d676f699d078 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:37:44.575312 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62cd0ff-441d-4ddd-8872-d676f699d078 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:37:44.610827 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1146/2303] 10.222.0.117 () {60 vars in 1157 bytes} [Tue Jan 25 02:37:44 2022] POST /identity/v3/projects => generated 378 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 25 02:37:44.615638 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eead97a6-f483-4e0c-9370-d24650cb65e6 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:37:44.626679 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eead97a6-f483-4e0c-9370-d24650cb65e6 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:37:44.722463 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4c9509-84e7-4134-89c5-64ec1e79c8a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:37:44.723149 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4c9509-84e7-4134-89c5-64ec1e79c8a7 admin admin] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:37:44.723432 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4c9509-84e7-4134-89c5-64ec1e79c8a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:37:44.723727 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4c9509-84e7-4134-89c5-64ec1e79c8a7 admin admin] PATH_INFO: `/v3/users` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:37:44.724666 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4c9509-84e7-4134-89c5-64ec1e79c8a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:37:44.726512 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4c9509-84e7-4134-89c5-64ec1e79c8a7 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:37:44.758277 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1158/2304] 10.222.0.117 () {60 vars in 1148 bytes} [Tue Jan 25 02:37:44 2022] POST /identity/v3/users => generated 290 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 02:37:44.759561 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62cd0ff-441d-4ddd-8872-d676f699d078 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:37:44.772001 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62cd0ff-441d-4ddd-8872-d676f699d078 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:37:44.777860 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a6f601-46ca-4ae7-992b-c436bd220886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:37:44.778529 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a6f601-46ca-4ae7-992b-c436bd220886 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:37:44.778808 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a6f601-46ca-4ae7-992b-c436bd220886 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:37:44.779078 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a6f601-46ca-4ae7-992b-c436bd220886 admin admin] PATH_INFO: `/v3/roles` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:37:44.780392 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a6f601-46ca-4ae7-992b-c436bd220886 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:37:44.781674 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a6f601-46ca-4ae7-992b-c436bd220886 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:37:44.793275 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1147/2305] 10.222.0.117 () {58 vars in 1126 bytes} [Tue Jan 25 02:37:44 2022] GET /identity/v3/roles => generated 1427 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 02:37:44.797587 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4c9509-84e7-4134-89c5-64ec1e79c8a7 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:37:44.810310 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4c9509-84e7-4134-89c5-64ec1e79c8a7 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:37:44.815874 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9123fa7-6dcd-4174-8003-449febf57dcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:37:44.816854 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9123fa7-6dcd-4174-8003-449febf57dcf admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:37:44.817134 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9123fa7-6dcd-4174-8003-449febf57dcf admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:37:44.817408 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9123fa7-6dcd-4174-8003-449febf57dcf admin admin] PATH_INFO: `/v3/roles` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:37:44.821594 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9123fa7-6dcd-4174-8003-449febf57dcf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:37:44.821594 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9123fa7-6dcd-4174-8003-449febf57dcf admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:37:44.843352 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1159/2306] 10.222.0.117 () {58 vars in 1126 bytes} [Tue Jan 25 02:37:44 2022] GET /identity/v3/roles => generated 1427 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 02:37:44.845184 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a6f601-46ca-4ae7-992b-c436bd220886 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:37:44.863487 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a6f601-46ca-4ae7-992b-c436bd220886 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:37:44.869510 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d52886-4b4e-43e9-a9a1-4a4acfb6ecc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:37:44.869832 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d52886-4b4e-43e9-a9a1-4a4acfb6ecc3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:37:44.870158 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d52886-4b4e-43e9-a9a1-4a4acfb6ecc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:37:44.870441 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d52886-4b4e-43e9-a9a1-4a4acfb6ecc3 admin admin] PATH_INFO: `/v3/projects/328b1538b6f2451896aedffaa316f568/users/dfedbce156f7467e9f2658072b6fb6dd/roles/33a8e87420ed423f9cb29e0084eab5d2` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:37:44.886742 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d52886-4b4e-43e9-a9a1-4a4acfb6ecc3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=328b1538b6f2451896aedffaa316f568, user_id=dfedbce156f7467e9f2658072b6fb6dd, role_id=33a8e87420ed423f9cb29e0084eab5d2)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:37:44.890086 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d52886-4b4e-43e9-a9a1-4a4acfb6ecc3 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:37:44.907883 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1148/2307] 10.222.0.117 () {60 vars in 1487 bytes} [Tue Jan 25 02:37:44 2022] PUT /identity/v3/projects/328b1538b6f2451896aedffaa316f568/users/dfedbce156f7467e9f2658072b6fb6dd/roles/33a8e87420ed423f9cb29e0084eab5d2 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:37:44.921656 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3926b93-717c-4eb3-b9cd-b2b081c7ac9a None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:37:44.924035 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3926b93-717c-4eb3-b9cd-b2b081c7ac9a None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:37:44.925121 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3926b93-717c-4eb3-b9cd-b2b081c7ac9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:37:44.981077 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-f3926b93-717c-4eb3-b9cd-b2b081c7ac9a None None] MFA Rules not processed for user `dfedbce156f7467e9f2658072b6fb6dd`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:37:44.983913 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-f3926b93-717c-4eb3-b9cd-b2b081c7ac9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:37:45.059965 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1160/2308] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:37:44 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:37:45.071458 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d52886-4b4e-43e9-a9a1-4a4acfb6ecc3 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:37:45.073302 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-b0d52886-4b4e-43e9-a9a1-4a4acfb6ecc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:37:45.164008 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d52886-4b4e-43e9-a9a1-4a4acfb6ecc3 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:37:45.176014 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96387ad-355b-4317-92ca-8b75135429f1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cc5249aea09430080e232cf17757f86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:37:45.176845 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96387ad-355b-4317-92ca-8b75135429f1 service cinder] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:37:45.177224 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96387ad-355b-4317-92ca-8b75135429f1 service cinder] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:37:45.177594 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96387ad-355b-4317-92ca-8b75135429f1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:37:45.186409 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96387ad-355b-4317-92ca-8b75135429f1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:37:45.187890 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96387ad-355b-4317-92ca-8b75135429f1 service cinder] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:37:45.197475 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1149/2309] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:37:45 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:38:08.559424 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2d1887-293c-45f5-95ba-98d50909188e None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:38:08.560018 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2d1887-293c-45f5-95ba-98d50909188e None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:38:08.560018 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2d1887-293c-45f5-95ba-98d50909188e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:38:08.587618 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-ca2d1887-293c-45f5-95ba-98d50909188e None None] MFA Rules not processed for user `5924414ee6e948a680b8b75c8797b466`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:38:08.588843 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-ca2d1887-293c-45f5-95ba-98d50909188e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:38:08.663971 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1161/2310] 10.222.0.117 () {58 vars in 1014 bytes} [Tue Jan 25 02:38:08 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:38:08.708513 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96387ad-355b-4317-92ca-8b75135429f1 service cinder] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:38:08.709936 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-d96387ad-355b-4317-92ca-8b75135429f1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:38:08.809415 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96387ad-355b-4317-92ca-8b75135429f1 service cinder] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:38:08.815926 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff290f2c-b7ec-4892-917f-f9799619a46f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100f12ee56754f1c859106bf3e473df6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:38:08.816727 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff290f2c-b7ec-4892-917f-f9799619a46f service swift] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:38:08.817059 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff290f2c-b7ec-4892-917f-f9799619a46f service swift] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:38:08.817343 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff290f2c-b7ec-4892-917f-f9799619a46f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:38:08.826209 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff290f2c-b7ec-4892-917f-f9799619a46f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:38:08.827836 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff290f2c-b7ec-4892-917f-f9799619a46f service swift] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:38:08.836567 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1150/2311] 10.222.0.117 () {60 vars in 1389 bytes} [Tue Jan 25 02:38:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 25 02:38:09.373893 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519e4aa9-a150-42cc-9b46-bf5dbe116b6e None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:38:09.374187 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519e4aa9-a150-42cc-9b46-bf5dbe116b6e None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:38:09.374468 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519e4aa9-a150-42cc-9b46-bf5dbe116b6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:38:09.396563 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-519e4aa9-a150-42cc-9b46-bf5dbe116b6e None None] MFA Rules not processed for user `5924414ee6e948a680b8b75c8797b466`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:38:09.397812 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-519e4aa9-a150-42cc-9b46-bf5dbe116b6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:38:09.409012 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1162/2312] 10.222.0.117 () {58 vars in 972 bytes} [Tue Jan 25 02:38:09 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:38:09.423926 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff290f2c-b7ec-4892-917f-f9799619a46f service swift] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:38:09.435625 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff290f2c-b7ec-4892-917f-f9799619a46f service swift] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:38:09.442003 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75787251-ecb6-4577-9d6a-5a9f4b9f37f7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100f12ee56754f1c859106bf3e473df6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:38:09.442996 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75787251-ecb6-4577-9d6a-5a9f4b9f37f7 service swift] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:38:09.443284 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75787251-ecb6-4577-9d6a-5a9f4b9f37f7 service swift] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:38:09.443560 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75787251-ecb6-4577-9d6a-5a9f4b9f37f7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:38:09.451808 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75787251-ecb6-4577-9d6a-5a9f4b9f37f7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:38:09.453383 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75787251-ecb6-4577-9d6a-5a9f4b9f37f7 service swift] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:38:09.464772 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1151/2313] 10.222.0.117 () {60 vars in 1389 bytes} [Tue Jan 25 02:38:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 25 02:38:09.656361 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b546b5df-5c00-4e2a-83b9-b47432ab3ad5 None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:38:09.656840 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b546b5df-5c00-4e2a-83b9-b47432ab3ad5 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:38:09.656949 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b546b5df-5c00-4e2a-83b9-b47432ab3ad5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:38:09.674838 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-b546b5df-5c00-4e2a-83b9-b47432ab3ad5 None None] MFA Rules not processed for user `5924414ee6e948a680b8b75c8797b466`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:38:09.676774 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-b546b5df-5c00-4e2a-83b9-b47432ab3ad5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:38:09.684174 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1163/2314] 10.222.0.117 () {58 vars in 1014 bytes} [Tue Jan 25 02:38:09 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:38:09.695911 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75787251-ecb6-4577-9d6a-5a9f4b9f37f7 service swift] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:38:09.706973 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75787251-ecb6-4577-9d6a-5a9f4b9f37f7 service swift] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:38:09.712138 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da98ccb-9733-47c6-8221-44f000a82dcf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100f12ee56754f1c859106bf3e473df6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:38:09.712773 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da98ccb-9733-47c6-8221-44f000a82dcf service swift] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:38:09.713058 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da98ccb-9733-47c6-8221-44f000a82dcf service swift] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:38:09.713338 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da98ccb-9733-47c6-8221-44f000a82dcf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:38:09.721366 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da98ccb-9733-47c6-8221-44f000a82dcf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:38:09.723441 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da98ccb-9733-47c6-8221-44f000a82dcf service swift] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:38:09.731418 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1152/2315] 10.222.0.117 () {60 vars in 1389 bytes} [Tue Jan 25 02:38:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 25 02:38:10.052362 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a141aa-3c67-4d63-99c7-d59e4ee40ee1 None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:38:10.052666 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a141aa-3c67-4d63-99c7-d59e4ee40ee1 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:38:10.052946 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a141aa-3c67-4d63-99c7-d59e4ee40ee1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:38:10.072287 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-d2a141aa-3c67-4d63-99c7-d59e4ee40ee1 None None] MFA Rules not processed for user `5924414ee6e948a680b8b75c8797b466`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:38:10.073770 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-d2a141aa-3c67-4d63-99c7-d59e4ee40ee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:38:10.084125 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1164/2316] 10.222.0.117 () {58 vars in 972 bytes} [Tue Jan 25 02:38:10 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:38:10.099282 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da98ccb-9733-47c6-8221-44f000a82dcf service swift] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:38:10.110721 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da98ccb-9733-47c6-8221-44f000a82dcf service swift] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:38:10.117104 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c9892e-cde8-4886-9dee-ed48f261c0ea service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100f12ee56754f1c859106bf3e473df6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:38:10.117980 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c9892e-cde8-4886-9dee-ed48f261c0ea service swift] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:38:10.118520 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c9892e-cde8-4886-9dee-ed48f261c0ea service swift] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:38:10.119089 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c9892e-cde8-4886-9dee-ed48f261c0ea service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:38:10.128469 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c9892e-cde8-4886-9dee-ed48f261c0ea service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:38:10.130610 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c9892e-cde8-4886-9dee-ed48f261c0ea service swift] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:38:10.140211 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1153/2317] 10.222.0.117 () {60 vars in 1389 bytes} [Tue Jan 25 02:38:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 25 02:38:17.450478 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a141aa-3c67-4d63-99c7-d59e4ee40ee1 None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:38:17.451943 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-d2a141aa-3c67-4d63-99c7-d59e4ee40ee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:38:17.553234 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a141aa-3c67-4d63-99c7-d59e4ee40ee1 None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:38:17.558970 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6997fd8c-1936-4b48-826f-b3fcf3e66247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:38:17.560019 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6997fd8c-1936-4b48-826f-b3fcf3e66247 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:38:17.560179 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6997fd8c-1936-4b48-826f-b3fcf3e66247 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:38:17.560459 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6997fd8c-1936-4b48-826f-b3fcf3e66247 admin admin] PATH_INFO: `/v3/users/1ed7af8fdcc24a288a38beebd541744e` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:38:17.561685 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6997fd8c-1936-4b48-826f-b3fcf3e66247 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ed7af8fdcc24a288a38beebd541744e)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:38:17.563799 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6997fd8c-1936-4b48-826f-b3fcf3e66247 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:38:17.617587 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-6997fd8c-1936-4b48-826f-b3fcf3e66247 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ed7af8fdcc24a288a38beebd541744e'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:38:17.618330 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-6997fd8c-1936-4b48-826f-b3fcf3e66247 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ed7af8fdcc24a288a38beebd541744e'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:38:17.624970 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-6997fd8c-1936-4b48-826f-b3fcf3e66247 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ed7af8fdcc24a288a38beebd541744e'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:38:17.625790 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-6997fd8c-1936-4b48-826f-b3fcf3e66247 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ed7af8fdcc24a288a38beebd541744e'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:38:17.633988 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-6997fd8c-1936-4b48-826f-b3fcf3e66247 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ed7af8fdcc24a288a38beebd541744e'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:38:17.652791 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1165/2318] 10.222.0.117 () {58 vars in 1228 bytes} [Tue Jan 25 02:38:17 2022] DELETE /identity/v3/users/1ed7af8fdcc24a288a38beebd541744e => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:38:17.660646 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8772d74c-2dfe-4842-a322-090fea3bf930 None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:38:17.662676 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8772d74c-2dfe-4842-a322-090fea3bf930 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:38:17.663019 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8772d74c-2dfe-4842-a322-090fea3bf930 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:38:17.694054 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-8772d74c-2dfe-4842-a322-090fea3bf930 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:38:17.695274 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-8772d74c-2dfe-4842-a322-090fea3bf930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:38:17.784318 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6997fd8c-1936-4b48-826f-b3fcf3e66247 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:38:17.787470 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-6997fd8c-1936-4b48-826f-b3fcf3e66247 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:38:17.791030 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1154/2319] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:38:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:38:17.899901 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6997fd8c-1936-4b48-826f-b3fcf3e66247 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:38:17.904608 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb032f1-8394-4c60-810e-55179a8321ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca4071c5f8f4a31b5edb81fa66a43a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:38:17.905416 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb032f1-8394-4c60-810e-55179a8321ea service neutron] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:38:17.905701 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb032f1-8394-4c60-810e-55179a8321ea service neutron] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:38:17.905978 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb032f1-8394-4c60-810e-55179a8321ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:38:17.917770 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb032f1-8394-4c60-810e-55179a8321ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:38:17.919561 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb032f1-8394-4c60-810e-55179a8321ea service neutron] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:38:17.929761 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1166/2320] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:38:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:38:18.114233 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8772d74c-2dfe-4842-a322-090fea3bf930 None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:38:18.115798 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-8772d74c-2dfe-4842-a322-090fea3bf930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:38:18.130075 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8772d74c-2dfe-4842-a322-090fea3bf930 None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:38:18.136423 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41962f1-d813-4476-837a-28b4acdc493d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:38:18.137298 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41962f1-d813-4476-837a-28b4acdc493d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:38:18.137582 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41962f1-d813-4476-837a-28b4acdc493d admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:38:18.137859 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41962f1-d813-4476-837a-28b4acdc493d admin admin] PATH_INFO: `/v3/projects/ca89fe619a044ee683b1b81b0d90e2ac` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:38:18.139151 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41962f1-d813-4476-837a-28b4acdc493d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca89fe619a044ee683b1b81b0d90e2ac)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:38:18.141971 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41962f1-d813-4476-837a-28b4acdc493d admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:38:18.196091 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-f41962f1-d813-4476-837a-28b4acdc493d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca89fe619a044ee683b1b81b0d90e2ac', 'request_id': 'req-f41962f1-d813-4476-837a-28b4acdc493d'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:38:18.203044 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-f41962f1-d813-4476-837a-28b4acdc493d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca89fe619a044ee683b1b81b0d90e2ac', 'request_id': 'req-f41962f1-d813-4476-837a-28b4acdc493d'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:38:18.210542 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-f41962f1-d813-4476-837a-28b4acdc493d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca89fe619a044ee683b1b81b0d90e2ac', 'request_id': 'req-f41962f1-d813-4476-837a-28b4acdc493d'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:38:18.224559 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-f41962f1-d813-4476-837a-28b4acdc493d admin admin] The token cache is being invalidate because project ca89fe619a044ee683b1b81b0d90e2ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79120) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 25 02:38:18.224851 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-f41962f1-d813-4476-837a-28b4acdc493d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:38:18.225488 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-f41962f1-d813-4476-837a-28b4acdc493d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:38:18.227040 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1155/2321] 10.222.0.117 () {58 vars in 1237 bytes} [Tue Jan 25 02:38:18 2022] DELETE /identity/v3/projects/ca89fe619a044ee683b1b81b0d90e2ac => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:38:20.540575 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b262d34b-1363-46f2-91e7-c6e45823cb7f None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:38:20.541109 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b262d34b-1363-46f2-91e7-c6e45823cb7f None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:38:20.541109 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b262d34b-1363-46f2-91e7-c6e45823cb7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:38:20.559154 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-b262d34b-1363-46f2-91e7-c6e45823cb7f None None] MFA Rules not processed for user `63855c1cdc7b46548312f2e14d99cfe1`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:38:20.560353 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-b262d34b-1363-46f2-91e7-c6e45823cb7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:38:20.616152 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1167/2322] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:38:20 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:38:21.405179 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41962f1-d813-4476-837a-28b4acdc493d admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:38:21.406984 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-f41962f1-d813-4476-837a-28b4acdc493d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:38:21.478419 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41962f1-d813-4476-837a-28b4acdc493d admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:38:21.484323 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b032262f-abc0-4c7d-90a2-56b6d1935236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:38:21.485284 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b032262f-abc0-4c7d-90a2-56b6d1935236 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:38:21.485643 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b032262f-abc0-4c7d-90a2-56b6d1935236 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:38:21.485991 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b032262f-abc0-4c7d-90a2-56b6d1935236 admin admin] PATH_INFO: `/v3/users/dfedbce156f7467e9f2658072b6fb6dd` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:38:21.487536 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b032262f-abc0-4c7d-90a2-56b6d1935236 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dfedbce156f7467e9f2658072b6fb6dd)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:38:21.490225 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b032262f-abc0-4c7d-90a2-56b6d1935236 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:38:21.537227 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-b032262f-abc0-4c7d-90a2-56b6d1935236 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dfedbce156f7467e9f2658072b6fb6dd'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:38:21.544390 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-b032262f-abc0-4c7d-90a2-56b6d1935236 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dfedbce156f7467e9f2658072b6fb6dd'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:38:21.545071 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-b032262f-abc0-4c7d-90a2-56b6d1935236 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dfedbce156f7467e9f2658072b6fb6dd'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:38:21.545715 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-b032262f-abc0-4c7d-90a2-56b6d1935236 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dfedbce156f7467e9f2658072b6fb6dd'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:38:21.558502 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-b032262f-abc0-4c7d-90a2-56b6d1935236 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dfedbce156f7467e9f2658072b6fb6dd'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:38:21.571183 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1156/2323] 10.222.0.117 () {58 vars in 1228 bytes} [Tue Jan 25 02:38:21 2022] DELETE /identity/v3/users/dfedbce156f7467e9f2658072b6fb6dd => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:38:21.575625 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ed3e37-3d25-4ece-afcb-796190100457 None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:38:21.576146 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ed3e37-3d25-4ece-afcb-796190100457 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:38:21.576146 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ed3e37-3d25-4ece-afcb-796190100457 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:38:21.595549 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-e3ed3e37-3d25-4ece-afcb-796190100457 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:38:21.597591 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-e3ed3e37-3d25-4ece-afcb-796190100457 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:38:21.655466 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1168/2324] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:38:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:38:21.665483 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b032262f-abc0-4c7d-90a2-56b6d1935236 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:38:21.666930 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-b032262f-abc0-4c7d-90a2-56b6d1935236 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:38:21.722941 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b032262f-abc0-4c7d-90a2-56b6d1935236 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:38:21.726752 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaa8a00-cfa4-4878-a36b-86c23777c0f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca4071c5f8f4a31b5edb81fa66a43a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:38:21.727392 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaa8a00-cfa4-4878-a36b-86c23777c0f6 service neutron] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:38:21.727679 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaa8a00-cfa4-4878-a36b-86c23777c0f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:38:21.727986 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaa8a00-cfa4-4878-a36b-86c23777c0f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:38:21.736839 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aaa8a00-cfa4-4878-a36b-86c23777c0f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:38:21.738862 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aaa8a00-cfa4-4878-a36b-86c23777c0f6 service neutron] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:38:21.748189 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1157/2325] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:38:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:38:22.229375 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ed3e37-3d25-4ece-afcb-796190100457 None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:38:22.230960 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-e3ed3e37-3d25-4ece-afcb-796190100457 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:38:22.245075 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ed3e37-3d25-4ece-afcb-796190100457 None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:38:22.250075 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4a0d9a-39f1-4034-aaec-336d3fc31d8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:38:22.251172 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4a0d9a-39f1-4034-aaec-336d3fc31d8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:38:22.251681 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4a0d9a-39f1-4034-aaec-336d3fc31d8c admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:38:22.252223 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4a0d9a-39f1-4034-aaec-336d3fc31d8c admin admin] PATH_INFO: `/v3/projects/328b1538b6f2451896aedffaa316f568` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:38:22.254519 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4a0d9a-39f1-4034-aaec-336d3fc31d8c admin admin] RBAC: Authorizing `identity:delete_project(project_id=328b1538b6f2451896aedffaa316f568)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:38:22.256481 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4a0d9a-39f1-4034-aaec-336d3fc31d8c admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:38:22.304680 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-1c4a0d9a-39f1-4034-aaec-336d3fc31d8c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '328b1538b6f2451896aedffaa316f568', 'request_id': 'req-1c4a0d9a-39f1-4034-aaec-336d3fc31d8c'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:38:22.310271 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-1c4a0d9a-39f1-4034-aaec-336d3fc31d8c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '328b1538b6f2451896aedffaa316f568', 'request_id': 'req-1c4a0d9a-39f1-4034-aaec-336d3fc31d8c'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:38:22.317969 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-1c4a0d9a-39f1-4034-aaec-336d3fc31d8c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '328b1538b6f2451896aedffaa316f568', 'request_id': 'req-1c4a0d9a-39f1-4034-aaec-336d3fc31d8c'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:38:22.329084 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-1c4a0d9a-39f1-4034-aaec-336d3fc31d8c admin admin] The token cache is being invalidate because project 328b1538b6f2451896aedffaa316f568 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79121) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 25 02:38:22.329374 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-1c4a0d9a-39f1-4034-aaec-336d3fc31d8c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:38:22.329991 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-1c4a0d9a-39f1-4034-aaec-336d3fc31d8c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:38:22.332381 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1169/2326] 10.222.0.117 () {58 vars in 1237 bytes} [Tue Jan 25 02:38:22 2022] DELETE /identity/v3/projects/328b1538b6f2451896aedffaa316f568 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:38:22.338386 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc6ddd6-35ab-48f8-950f-6348daf5ecc1 None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:38:22.338678 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc6ddd6-35ab-48f8-950f-6348daf5ecc1 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:38:22.338958 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc6ddd6-35ab-48f8-950f-6348daf5ecc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:38:22.376310 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-fdc6ddd6-35ab-48f8-950f-6348daf5ecc1 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:38:22.377628 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-fdc6ddd6-35ab-48f8-950f-6348daf5ecc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:38:22.438934 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1158/2327] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:38:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:38:22.446884 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4506e9ed-92c9-45ff-8835-8c94381e0d54 None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:38:22.447180 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4506e9ed-92c9-45ff-8835-8c94381e0d54 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:38:22.447461 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4506e9ed-92c9-45ff-8835-8c94381e0d54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:38:22.466394 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-4506e9ed-92c9-45ff-8835-8c94381e0d54 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:38:22.467595 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-4506e9ed-92c9-45ff-8835-8c94381e0d54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:38:22.476028 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1170/2328] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:38:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:38:22.480230 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc6ddd6-35ab-48f8-950f-6348daf5ecc1 None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:38:22.490178 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc6ddd6-35ab-48f8-950f-6348daf5ecc1 None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:38:22.494701 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d324cd0f-b8ee-4cca-bbbd-069f69f70b86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:38:22.495342 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d324cd0f-b8ee-4cca-bbbd-069f69f70b86 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:38:22.495626 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d324cd0f-b8ee-4cca-bbbd-069f69f70b86 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:38:22.495927 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d324cd0f-b8ee-4cca-bbbd-069f69f70b86 admin admin] PATH_INFO: `/v3/domains` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:38:22.496658 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d324cd0f-b8ee-4cca-bbbd-069f69f70b86 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:38:22.496962 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d324cd0f-b8ee-4cca-bbbd-069f69f70b86 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:38:22.498558 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d324cd0f-b8ee-4cca-bbbd-069f69f70b86 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:38:22.510131 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1159/2329] 10.222.0.117 () {58 vars in 1157 bytes} [Tue Jan 25 02:38:22 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:38:22.514339 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4506e9ed-92c9-45ff-8835-8c94381e0d54 None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:38:22.524151 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4506e9ed-92c9-45ff-8835-8c94381e0d54 None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:38:22.529041 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac1eb9d-8f97-4dbd-bb93-6160f4da52a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:38:22.529686 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac1eb9d-8f97-4dbd-bb93-6160f4da52a0 admin admin] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:38:22.529973 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac1eb9d-8f97-4dbd-bb93-6160f4da52a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:38:22.530251 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac1eb9d-8f97-4dbd-bb93-6160f4da52a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:38:22.530970 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac1eb9d-8f97-4dbd-bb93-6160f4da52a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:38:22.532922 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac1eb9d-8f97-4dbd-bb93-6160f4da52a0 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:38:22.558623 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1171/2330] 10.222.0.117 () {60 vars in 1157 bytes} [Tue Jan 25 02:38:22 2022] POST /identity/v3/projects => generated 376 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 25 02:38:22.562714 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d324cd0f-b8ee-4cca-bbbd-069f69f70b86 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:38:22.572489 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d324cd0f-b8ee-4cca-bbbd-069f69f70b86 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:38:22.627554 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501a0ebe-5795-4aaa-b58d-0af8081062ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:38:22.628328 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501a0ebe-5795-4aaa-b58d-0af8081062ba admin admin] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:38:22.628328 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501a0ebe-5795-4aaa-b58d-0af8081062ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:38:22.628861 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501a0ebe-5795-4aaa-b58d-0af8081062ba admin admin] PATH_INFO: `/v3/users` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:38:22.629567 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501a0ebe-5795-4aaa-b58d-0af8081062ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:38:22.631856 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501a0ebe-5795-4aaa-b58d-0af8081062ba admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:38:22.652342 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1160/2331] 10.222.0.117 () {60 vars in 1148 bytes} [Tue Jan 25 02:38:22 2022] POST /identity/v3/users => generated 289 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 25 02:38:22.656416 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac1eb9d-8f97-4dbd-bb93-6160f4da52a0 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:38:22.667250 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac1eb9d-8f97-4dbd-bb93-6160f4da52a0 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:38:22.676366 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba183e9-533d-45ef-aa03-16fb998df552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:38:22.677083 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba183e9-533d-45ef-aa03-16fb998df552 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:38:22.677439 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba183e9-533d-45ef-aa03-16fb998df552 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:38:22.677630 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba183e9-533d-45ef-aa03-16fb998df552 admin admin] PATH_INFO: `/v3/roles` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:38:22.678398 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba183e9-533d-45ef-aa03-16fb998df552 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:38:22.680051 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba183e9-533d-45ef-aa03-16fb998df552 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:38:22.691429 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1172/2332] 10.222.0.117 () {58 vars in 1126 bytes} [Tue Jan 25 02:38:22 2022] GET /identity/v3/roles => generated 1427 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 02:38:22.695203 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501a0ebe-5795-4aaa-b58d-0af8081062ba admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:38:22.705201 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501a0ebe-5795-4aaa-b58d-0af8081062ba admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:38:22.711414 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca845b98-31f0-475c-a8e6-ddf22587b53b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:38:22.712136 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca845b98-31f0-475c-a8e6-ddf22587b53b admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:38:22.712418 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca845b98-31f0-475c-a8e6-ddf22587b53b admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:38:22.712686 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca845b98-31f0-475c-a8e6-ddf22587b53b admin admin] PATH_INFO: `/v3/roles` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:38:22.713417 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca845b98-31f0-475c-a8e6-ddf22587b53b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:38:22.714995 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca845b98-31f0-475c-a8e6-ddf22587b53b admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:38:22.726252 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1161/2333] 10.222.0.117 () {58 vars in 1126 bytes} [Tue Jan 25 02:38:22 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 02:38:22.730527 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba183e9-533d-45ef-aa03-16fb998df552 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:38:22.740503 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba183e9-533d-45ef-aa03-16fb998df552 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:38:22.745306 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099f8f8f-ffe4-4ada-aacf-a3bb81846118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:38:22.746178 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099f8f8f-ffe4-4ada-aacf-a3bb81846118 admin admin] REQUEST_METHOD: `PUT` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:38:22.746458 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099f8f8f-ffe4-4ada-aacf-a3bb81846118 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:38:22.746730 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099f8f8f-ffe4-4ada-aacf-a3bb81846118 admin admin] PATH_INFO: `/v3/projects/aa9ef1e813764e05bf1c4ff98ee14c17/users/c4b894108cf243dea7e948f221bbe150/roles/33a8e87420ed423f9cb29e0084eab5d2` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:38:22.762234 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099f8f8f-ffe4-4ada-aacf-a3bb81846118 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa9ef1e813764e05bf1c4ff98ee14c17, user_id=c4b894108cf243dea7e948f221bbe150, role_id=33a8e87420ed423f9cb29e0084eab5d2)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:38:22.764771 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099f8f8f-ffe4-4ada-aacf-a3bb81846118 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:38:22.781333 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1173/2334] 10.222.0.117 () {60 vars in 1487 bytes} [Tue Jan 25 02:38:22 2022] PUT /identity/v3/projects/aa9ef1e813764e05bf1c4ff98ee14c17/users/c4b894108cf243dea7e948f221bbe150/roles/33a8e87420ed423f9cb29e0084eab5d2 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 25 02:38:22.795235 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c440cd4-e0e7-4058-90ca-b9236633e77f None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:38:22.795529 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c440cd4-e0e7-4058-90ca-b9236633e77f None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:38:22.795842 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c440cd4-e0e7-4058-90ca-b9236633e77f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:38:22.822478 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-3c440cd4-e0e7-4058-90ca-b9236633e77f None None] MFA Rules not processed for user `c4b894108cf243dea7e948f221bbe150`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:38:22.823680 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-3c440cd4-e0e7-4058-90ca-b9236633e77f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:38:22.884891 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1162/2335] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:38:22 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:38:22.894618 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099f8f8f-ffe4-4ada-aacf-a3bb81846118 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:38:22.896324 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-099f8f8f-ffe4-4ada-aacf-a3bb81846118 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:38:22.952837 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099f8f8f-ffe4-4ada-aacf-a3bb81846118 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:38:22.956960 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf830cc-f19a-43cc-8f93-8041d8932384 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cc5249aea09430080e232cf17757f86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:38:22.958199 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf830cc-f19a-43cc-8f93-8041d8932384 service cinder] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:38:22.958199 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf830cc-f19a-43cc-8f93-8041d8932384 service cinder] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:38:22.958199 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf830cc-f19a-43cc-8f93-8041d8932384 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:38:22.966239 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf830cc-f19a-43cc-8f93-8041d8932384 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:38:22.967681 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf830cc-f19a-43cc-8f93-8041d8932384 service cinder] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:38:22.977957 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1174/2336] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:38:22 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:38:27.265456 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50de6bf7-f938-4416-a70a-2c8adfbd7fe1 None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:38:27.266014 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50de6bf7-f938-4416-a70a-2c8adfbd7fe1 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:38:27.266014 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50de6bf7-f938-4416-a70a-2c8adfbd7fe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:38:27.300220 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-50de6bf7-f938-4416-a70a-2c8adfbd7fe1 None None] MFA Rules not processed for user `5924414ee6e948a680b8b75c8797b466`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:38:27.302081 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-50de6bf7-f938-4416-a70a-2c8adfbd7fe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:38:27.367121 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1163/2337] 10.222.0.117 () {58 vars in 1014 bytes} [Tue Jan 25 02:38:27 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:38:27.383353 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf830cc-f19a-43cc-8f93-8041d8932384 service cinder] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:38:27.385645 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-6bf830cc-f19a-43cc-8f93-8041d8932384 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:38:27.469407 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf830cc-f19a-43cc-8f93-8041d8932384 service cinder] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:38:27.478451 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da7aaeb-514e-432f-94af-21e3a032da2f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100f12ee56754f1c859106bf3e473df6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:38:27.478451 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da7aaeb-514e-432f-94af-21e3a032da2f service swift] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:38:27.478451 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da7aaeb-514e-432f-94af-21e3a032da2f service swift] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:38:27.478451 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da7aaeb-514e-432f-94af-21e3a032da2f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:38:27.487285 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da7aaeb-514e-432f-94af-21e3a032da2f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:38:27.489110 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da7aaeb-514e-432f-94af-21e3a032da2f service swift] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:38:27.502324 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1175/2338] 10.222.0.117 () {60 vars in 1389 bytes} [Tue Jan 25 02:38:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 25 02:38:29.463809 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50de6bf7-f938-4416-a70a-2c8adfbd7fe1 None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:38:29.531756 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50de6bf7-f938-4416-a70a-2c8adfbd7fe1 None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:38:29.555940 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c05bd7-5895-4755-8c64-502e164f2fdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:38:29.556843 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c05bd7-5895-4755-8c64-502e164f2fdb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:38:29.557126 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c05bd7-5895-4755-8c64-502e164f2fdb admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:38:29.557402 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c05bd7-5895-4755-8c64-502e164f2fdb admin admin] PATH_INFO: `/v3/users/c4b894108cf243dea7e948f221bbe150` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:38:29.558805 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c05bd7-5895-4755-8c64-502e164f2fdb admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4b894108cf243dea7e948f221bbe150)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:38:29.560858 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c05bd7-5895-4755-8c64-502e164f2fdb admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:38:29.632120 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-86c05bd7-5895-4755-8c64-502e164f2fdb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4b894108cf243dea7e948f221bbe150'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:38:29.641811 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-86c05bd7-5895-4755-8c64-502e164f2fdb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4b894108cf243dea7e948f221bbe150'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:38:29.642983 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-86c05bd7-5895-4755-8c64-502e164f2fdb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4b894108cf243dea7e948f221bbe150'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:38:29.643727 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-86c05bd7-5895-4755-8c64-502e164f2fdb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4b894108cf243dea7e948f221bbe150'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:38:29.659473 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-86c05bd7-5895-4755-8c64-502e164f2fdb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4b894108cf243dea7e948f221bbe150'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:38:29.682505 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1164/2339] 10.222.0.117 () {58 vars in 1228 bytes} [Tue Jan 25 02:38:29 2022] DELETE /identity/v3/users/c4b894108cf243dea7e948f221bbe150 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:38:29.686894 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e509a1-2b2f-4393-a9db-d060723f8a12 None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:38:29.687409 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e509a1-2b2f-4393-a9db-d060723f8a12 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:38:29.687515 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e509a1-2b2f-4393-a9db-d060723f8a12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:38:29.713446 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-d4e509a1-2b2f-4393-a9db-d060723f8a12 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:38:29.714723 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-d4e509a1-2b2f-4393-a9db-d060723f8a12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:38:29.848016 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1176/2340] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:38:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:38:29.848939 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c05bd7-5895-4755-8c64-502e164f2fdb admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:38:29.851225 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-86c05bd7-5895-4755-8c64-502e164f2fdb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:38:29.961105 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c05bd7-5895-4755-8c64-502e164f2fdb admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:38:29.965745 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617a5f8a-9588-4b5b-950d-e1861eabb49c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca4071c5f8f4a31b5edb81fa66a43a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:38:29.966879 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617a5f8a-9588-4b5b-950d-e1861eabb49c service neutron] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:38:29.967400 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617a5f8a-9588-4b5b-950d-e1861eabb49c service neutron] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:38:29.967687 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617a5f8a-9588-4b5b-950d-e1861eabb49c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:38:29.997426 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617a5f8a-9588-4b5b-950d-e1861eabb49c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:38:29.997426 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617a5f8a-9588-4b5b-950d-e1861eabb49c service neutron] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:38:30.013296 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1165/2341] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:38:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 25 02:38:30.497044 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e509a1-2b2f-4393-a9db-d060723f8a12 None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:38:30.499338 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-d4e509a1-2b2f-4393-a9db-d060723f8a12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:38:30.522756 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e509a1-2b2f-4393-a9db-d060723f8a12 None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:38:30.534130 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0740861-032f-4853-aa3f-b66d37612ce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:38:30.536136 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0740861-032f-4853-aa3f-b66d37612ce0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:38:30.536734 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0740861-032f-4853-aa3f-b66d37612ce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:38:30.538880 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0740861-032f-4853-aa3f-b66d37612ce0 admin admin] PATH_INFO: `/v3/projects/aa9ef1e813764e05bf1c4ff98ee14c17` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:38:30.540715 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0740861-032f-4853-aa3f-b66d37612ce0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa9ef1e813764e05bf1c4ff98ee14c17)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:38:30.543039 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0740861-032f-4853-aa3f-b66d37612ce0 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:38:30.635511 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-c0740861-032f-4853-aa3f-b66d37612ce0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa9ef1e813764e05bf1c4ff98ee14c17', 'request_id': 'req-c0740861-032f-4853-aa3f-b66d37612ce0'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:38:30.644095 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-c0740861-032f-4853-aa3f-b66d37612ce0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa9ef1e813764e05bf1c4ff98ee14c17', 'request_id': 'req-c0740861-032f-4853-aa3f-b66d37612ce0'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:38:30.655534 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-c0740861-032f-4853-aa3f-b66d37612ce0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa9ef1e813764e05bf1c4ff98ee14c17', 'request_id': 'req-c0740861-032f-4853-aa3f-b66d37612ce0'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:38:30.669565 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-c0740861-032f-4853-aa3f-b66d37612ce0 admin admin] The token cache is being invalidate because project aa9ef1e813764e05bf1c4ff98ee14c17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79121) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 25 02:38:30.670082 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-c0740861-032f-4853-aa3f-b66d37612ce0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:38:30.670831 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-c0740861-032f-4853-aa3f-b66d37612ce0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:38:30.675773 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1177/2342] 10.222.0.117 () {58 vars in 1237 bytes} [Tue Jan 25 02:38:30 2022] DELETE /identity/v3/projects/aa9ef1e813764e05bf1c4ff98ee14c17 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:38:30.680587 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cf39d8-692d-492b-8995-3a19bc3ab822 None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:38:30.681153 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cf39d8-692d-492b-8995-3a19bc3ab822 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:38:30.686725 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cf39d8-692d-492b-8995-3a19bc3ab822 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:38:30.729288 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-82cf39d8-692d-492b-8995-3a19bc3ab822 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:38:30.730649 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-82cf39d8-692d-492b-8995-3a19bc3ab822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:38:30.803299 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1166/2343] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:38:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:38:30.811456 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85a570a-f618-4e3c-9319-5b3976bc08a7 None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:38:30.812042 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85a570a-f618-4e3c-9319-5b3976bc08a7 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:38:30.812042 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85a570a-f618-4e3c-9319-5b3976bc08a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:38:30.838410 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-f85a570a-f618-4e3c-9319-5b3976bc08a7 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:38:30.840175 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-f85a570a-f618-4e3c-9319-5b3976bc08a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:38:30.852977 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1178/2344] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:38:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:38:30.856551 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cf39d8-692d-492b-8995-3a19bc3ab822 None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:38:30.868389 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cf39d8-692d-492b-8995-3a19bc3ab822 None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:38:30.873748 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f518e0d-cbf6-4a8d-84c1-3997645a1bfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:38:30.874411 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f518e0d-cbf6-4a8d-84c1-3997645a1bfc admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:38:30.874874 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f518e0d-cbf6-4a8d-84c1-3997645a1bfc admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:38:30.875145 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f518e0d-cbf6-4a8d-84c1-3997645a1bfc admin admin] PATH_INFO: `/v3/domains` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:38:30.876171 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f518e0d-cbf6-4a8d-84c1-3997645a1bfc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:38:30.876645 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f518e0d-cbf6-4a8d-84c1-3997645a1bfc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:38:30.878404 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f518e0d-cbf6-4a8d-84c1-3997645a1bfc admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:38:30.894287 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1167/2345] 10.222.0.117 () {58 vars in 1157 bytes} [Tue Jan 25 02:38:30 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:38:30.896560 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85a570a-f618-4e3c-9319-5b3976bc08a7 None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:38:30.907682 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85a570a-f618-4e3c-9319-5b3976bc08a7 None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:38:30.914221 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c42c9f-14bf-49b6-bbcb-3e5816e12557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:38:30.914991 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c42c9f-14bf-49b6-bbcb-3e5816e12557 admin admin] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:38:30.915496 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c42c9f-14bf-49b6-bbcb-3e5816e12557 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:38:30.916009 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c42c9f-14bf-49b6-bbcb-3e5816e12557 admin admin] PATH_INFO: `/v3/projects` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:38:30.916780 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c42c9f-14bf-49b6-bbcb-3e5816e12557 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:38:30.918995 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c42c9f-14bf-49b6-bbcb-3e5816e12557 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:38:30.953498 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1179/2346] 10.222.0.117 () {60 vars in 1157 bytes} [Tue Jan 25 02:38:30 2022] POST /identity/v3/projects => generated 374 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 02:38:30.959345 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f518e0d-cbf6-4a8d-84c1-3997645a1bfc admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:38:30.972829 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f518e0d-cbf6-4a8d-84c1-3997645a1bfc admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:38:31.052071 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ad7460-fc9d-401d-ab7a-9e3b1ae8a784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:38:31.052939 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ad7460-fc9d-401d-ab7a-9e3b1ae8a784 admin admin] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:38:31.053332 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ad7460-fc9d-401d-ab7a-9e3b1ae8a784 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:38:31.053689 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ad7460-fc9d-401d-ab7a-9e3b1ae8a784 admin admin] PATH_INFO: `/v3/users` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:38:31.054484 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ad7460-fc9d-401d-ab7a-9e3b1ae8a784 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:38:31.056645 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ad7460-fc9d-401d-ab7a-9e3b1ae8a784 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:38:31.079787 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1168/2347] 10.222.0.117 () {60 vars in 1148 bytes} [Tue Jan 25 02:38:30 2022] POST /identity/v3/users => generated 288 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 25 02:38:31.084466 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c42c9f-14bf-49b6-bbcb-3e5816e12557 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:38:31.096175 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c42c9f-14bf-49b6-bbcb-3e5816e12557 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:38:31.102266 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfa11f4-d7d0-419a-a674-16dcfadd890d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:38:31.103260 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfa11f4-d7d0-419a-a674-16dcfadd890d admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:38:31.103726 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfa11f4-d7d0-419a-a674-16dcfadd890d admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:38:31.104159 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfa11f4-d7d0-419a-a674-16dcfadd890d admin admin] PATH_INFO: `/v3/roles` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:38:31.105087 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfa11f4-d7d0-419a-a674-16dcfadd890d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:38:31.106872 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfa11f4-d7d0-419a-a674-16dcfadd890d admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:38:31.121900 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1180/2348] 10.222.0.117 () {58 vars in 1126 bytes} [Tue Jan 25 02:38:31 2022] GET /identity/v3/roles => generated 1427 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 02:38:31.125918 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ad7460-fc9d-401d-ab7a-9e3b1ae8a784 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:38:31.139525 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ad7460-fc9d-401d-ab7a-9e3b1ae8a784 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:38:31.156072 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d93e095-c274-4894-80ad-dc05606e38eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:38:31.156796 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d93e095-c274-4894-80ad-dc05606e38eb admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:38:31.157078 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d93e095-c274-4894-80ad-dc05606e38eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:38:31.157488 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d93e095-c274-4894-80ad-dc05606e38eb admin admin] PATH_INFO: `/v3/roles` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:38:31.158452 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d93e095-c274-4894-80ad-dc05606e38eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:38:31.160116 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d93e095-c274-4894-80ad-dc05606e38eb admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:38:31.176462 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1169/2349] 10.222.0.117 () {58 vars in 1126 bytes} [Tue Jan 25 02:38:31 2022] GET /identity/v3/roles => generated 1427 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 02:38:31.179264 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfa11f4-d7d0-419a-a674-16dcfadd890d admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:38:31.189759 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfa11f4-d7d0-419a-a674-16dcfadd890d admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:38:31.195613 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cc0aee-1ac2-4e26-83c1-fe6057895381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:38:31.196553 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cc0aee-1ac2-4e26-83c1-fe6057895381 admin admin] REQUEST_METHOD: `PUT` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:38:31.196836 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cc0aee-1ac2-4e26-83c1-fe6057895381 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:38:31.197108 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cc0aee-1ac2-4e26-83c1-fe6057895381 admin admin] PATH_INFO: `/v3/projects/bc694ce2854a4952a814d65fcc2bdc67/users/8953c3cca6984a32aa5676bbe3b2fa18/roles/33a8e87420ed423f9cb29e0084eab5d2` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:38:31.216062 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cc0aee-1ac2-4e26-83c1-fe6057895381 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc694ce2854a4952a814d65fcc2bdc67, user_id=8953c3cca6984a32aa5676bbe3b2fa18, role_id=33a8e87420ed423f9cb29e0084eab5d2)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:38:31.220044 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cc0aee-1ac2-4e26-83c1-fe6057895381 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:38:31.250116 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1181/2350] 10.222.0.117 () {60 vars in 1487 bytes} [Tue Jan 25 02:38:31 2022] PUT /identity/v3/projects/bc694ce2854a4952a814d65fcc2bdc67/users/8953c3cca6984a32aa5676bbe3b2fa18/roles/33a8e87420ed423f9cb29e0084eab5d2 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 25 02:38:31.263807 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8296850c-f7e2-47d1-afa3-f817b8e78325 None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:38:31.264187 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8296850c-f7e2-47d1-afa3-f817b8e78325 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:38:31.264532 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8296850c-f7e2-47d1-afa3-f817b8e78325 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:38:31.296279 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-8296850c-f7e2-47d1-afa3-f817b8e78325 None None] MFA Rules not processed for user `8953c3cca6984a32aa5676bbe3b2fa18`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:38:31.297758 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-8296850c-f7e2-47d1-afa3-f817b8e78325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:38:31.383885 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1170/2351] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:38:31 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:38:31.401688 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cc0aee-1ac2-4e26-83c1-fe6057895381 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:38:31.403420 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-53cc0aee-1ac2-4e26-83c1-fe6057895381 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:38:31.482926 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cc0aee-1ac2-4e26-83c1-fe6057895381 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:38:31.486807 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a55b7e4-8e92-42f5-a7cd-61c1ebd7a22c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cc5249aea09430080e232cf17757f86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:38:31.487532 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a55b7e4-8e92-42f5-a7cd-61c1ebd7a22c service cinder] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:38:31.487954 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a55b7e4-8e92-42f5-a7cd-61c1ebd7a22c service cinder] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:38:31.488303 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a55b7e4-8e92-42f5-a7cd-61c1ebd7a22c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:38:31.499983 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a55b7e4-8e92-42f5-a7cd-61c1ebd7a22c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:38:31.502862 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a55b7e4-8e92-42f5-a7cd-61c1ebd7a22c service cinder] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:38:31.518787 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1182/2352] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:38:31 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:38:35.406549 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8296850c-f7e2-47d1-afa3-f817b8e78325 None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:38:35.408092 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-8296850c-f7e2-47d1-afa3-f817b8e78325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:38:35.495685 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8296850c-f7e2-47d1-afa3-f817b8e78325 None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:38:35.500755 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6531a70-390d-48e5-812d-92ef36aa68cb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '890151a6bf2840f0a0a00f45dd2d38a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:38:35.501397 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6531a70-390d-48e5-812d-92ef36aa68cb service placement] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:38:35.501683 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6531a70-390d-48e5-812d-92ef36aa68cb service placement] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:38:35.501961 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6531a70-390d-48e5-812d-92ef36aa68cb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:38:35.503760 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-a6531a70-390d-48e5-812d-92ef36aa68cb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:38:35.517232 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6531a70-390d-48e5-812d-92ef36aa68cb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:38:35.518859 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6531a70-390d-48e5-812d-92ef36aa68cb service placement] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:38:35.534201 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1171/2353] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:38:35 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:38:41.308200 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a55b7e4-8e92-42f5-a7cd-61c1ebd7a22c service cinder] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:38:41.309832 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-2a55b7e4-8e92-42f5-a7cd-61c1ebd7a22c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:38:41.416795 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a55b7e4-8e92-42f5-a7cd-61c1ebd7a22c service cinder] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:38:41.432363 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce9098f-7910-427a-b584-7b1c4c397dc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:38:41.433683 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce9098f-7910-427a-b584-7b1c4c397dc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:38:41.434197 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce9098f-7910-427a-b584-7b1c4c397dc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:38:41.434655 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce9098f-7910-427a-b584-7b1c4c397dc6 admin admin] PATH_INFO: `/v3/users/20029276fe6f426395cd8d2b6f87cdbe` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:38:41.438966 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce9098f-7910-427a-b584-7b1c4c397dc6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=20029276fe6f426395cd8d2b6f87cdbe)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:38:41.439943 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce9098f-7910-427a-b584-7b1c4c397dc6 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:38:41.501495 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-9ce9098f-7910-427a-b584-7b1c4c397dc6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20029276fe6f426395cd8d2b6f87cdbe'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:38:41.502625 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-9ce9098f-7910-427a-b584-7b1c4c397dc6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20029276fe6f426395cd8d2b6f87cdbe'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:38:41.513219 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-9ce9098f-7910-427a-b584-7b1c4c397dc6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20029276fe6f426395cd8d2b6f87cdbe'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:38:41.514295 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-9ce9098f-7910-427a-b584-7b1c4c397dc6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20029276fe6f426395cd8d2b6f87cdbe'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:38:41.527013 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-9ce9098f-7910-427a-b584-7b1c4c397dc6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20029276fe6f426395cd8d2b6f87cdbe'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:38:41.555058 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1183/2354] 10.222.0.117 () {58 vars in 1228 bytes} [Tue Jan 25 02:38:41 2022] DELETE /identity/v3/users/20029276fe6f426395cd8d2b6f87cdbe => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:38:41.556301 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1a814b-7b11-49ff-9f91-a300ad03bb80 None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:38:41.557180 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1a814b-7b11-49ff-9f91-a300ad03bb80 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:38:41.557636 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1a814b-7b11-49ff-9f91-a300ad03bb80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:38:41.576548 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-1f1a814b-7b11-49ff-9f91-a300ad03bb80 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:38:41.577980 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-1f1a814b-7b11-49ff-9f91-a300ad03bb80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:38:41.644539 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1172/2355] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:38:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 25 02:38:41.656390 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce9098f-7910-427a-b584-7b1c4c397dc6 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:38:41.659456 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-9ce9098f-7910-427a-b584-7b1c4c397dc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:38:41.727903 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce9098f-7910-427a-b584-7b1c4c397dc6 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:38:41.731752 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b66a0b-1471-4707-b931-84bdd6b30718 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca4071c5f8f4a31b5edb81fa66a43a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:38:41.732398 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b66a0b-1471-4707-b931-84bdd6b30718 service neutron] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:38:41.732680 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b66a0b-1471-4707-b931-84bdd6b30718 service neutron] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:38:41.732953 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b66a0b-1471-4707-b931-84bdd6b30718 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:38:41.743294 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b66a0b-1471-4707-b931-84bdd6b30718 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:38:41.744781 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b66a0b-1471-4707-b931-84bdd6b30718 service neutron] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:38:41.755853 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1184/2356] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:38:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 25 02:38:42.136623 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1a814b-7b11-49ff-9f91-a300ad03bb80 None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:38:42.138128 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-1f1a814b-7b11-49ff-9f91-a300ad03bb80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:38:42.151016 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1a814b-7b11-49ff-9f91-a300ad03bb80 None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:38:42.159631 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318edf8b-7e2f-4255-b03e-c40489c37528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:38:42.162196 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318edf8b-7e2f-4255-b03e-c40489c37528 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:38:42.164114 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318edf8b-7e2f-4255-b03e-c40489c37528 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:38:42.164114 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318edf8b-7e2f-4255-b03e-c40489c37528 admin admin] PATH_INFO: `/v3/projects/6b2b7f1df6f240f184b9a03603619ec0` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:38:42.164684 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318edf8b-7e2f-4255-b03e-c40489c37528 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b2b7f1df6f240f184b9a03603619ec0)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:38:42.166694 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318edf8b-7e2f-4255-b03e-c40489c37528 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:38:42.241153 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-318edf8b-7e2f-4255-b03e-c40489c37528 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b2b7f1df6f240f184b9a03603619ec0', 'request_id': 'req-318edf8b-7e2f-4255-b03e-c40489c37528'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:38:42.247727 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-318edf8b-7e2f-4255-b03e-c40489c37528 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b2b7f1df6f240f184b9a03603619ec0', 'request_id': 'req-318edf8b-7e2f-4255-b03e-c40489c37528'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:38:42.256782 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-318edf8b-7e2f-4255-b03e-c40489c37528 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b2b7f1df6f240f184b9a03603619ec0', 'request_id': 'req-318edf8b-7e2f-4255-b03e-c40489c37528'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:38:42.279363 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-318edf8b-7e2f-4255-b03e-c40489c37528 admin admin] The token cache is being invalidate because project 6b2b7f1df6f240f184b9a03603619ec0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79120) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 25 02:38:42.279874 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-318edf8b-7e2f-4255-b03e-c40489c37528 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:38:42.280782 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-318edf8b-7e2f-4255-b03e-c40489c37528 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:38:42.295725 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1173/2357] 10.222.0.117 () {58 vars in 1237 bytes} [Tue Jan 25 02:38:42 2022] DELETE /identity/v3/projects/6b2b7f1df6f240f184b9a03603619ec0 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:38:48.956192 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b66a0b-1471-4707-b931-84bdd6b30718 service neutron] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:38:48.958918 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-47b66a0b-1471-4707-b931-84bdd6b30718 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:38:48.972022 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b66a0b-1471-4707-b931-84bdd6b30718 service neutron] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:38:49.033652 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d602a8a-b629-49d3-98e2-56ea457f3a73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:38:49.034543 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d602a8a-b629-49d3-98e2-56ea457f3a73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:38:49.034897 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d602a8a-b629-49d3-98e2-56ea457f3a73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:38:49.035788 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d602a8a-b629-49d3-98e2-56ea457f3a73 admin admin] PATH_INFO: `/v3/users/8953c3cca6984a32aa5676bbe3b2fa18` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:38:49.037070 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d602a8a-b629-49d3-98e2-56ea457f3a73 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8953c3cca6984a32aa5676bbe3b2fa18)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:38:49.039041 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d602a8a-b629-49d3-98e2-56ea457f3a73 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:38:49.090354 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-5d602a8a-b629-49d3-98e2-56ea457f3a73 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8953c3cca6984a32aa5676bbe3b2fa18'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:38:49.091406 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-5d602a8a-b629-49d3-98e2-56ea457f3a73 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8953c3cca6984a32aa5676bbe3b2fa18'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:38:49.099557 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-5d602a8a-b629-49d3-98e2-56ea457f3a73 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8953c3cca6984a32aa5676bbe3b2fa18'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:38:49.108497 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-5d602a8a-b629-49d3-98e2-56ea457f3a73 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8953c3cca6984a32aa5676bbe3b2fa18'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:38:49.120349 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-5d602a8a-b629-49d3-98e2-56ea457f3a73 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8953c3cca6984a32aa5676bbe3b2fa18'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:38:49.147764 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1185/2358] 10.222.0.117 () {58 vars in 1228 bytes} [Tue Jan 25 02:38:48 2022] DELETE /identity/v3/users/8953c3cca6984a32aa5676bbe3b2fa18 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:38:49.153405 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4911e036-4b16-4a77-85bf-95bf3a3ee9c5 None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:38:49.153915 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4911e036-4b16-4a77-85bf-95bf3a3ee9c5 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:38:49.154258 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4911e036-4b16-4a77-85bf-95bf3a3ee9c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:38:49.188812 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-4911e036-4b16-4a77-85bf-95bf3a3ee9c5 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:38:49.190449 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-4911e036-4b16-4a77-85bf-95bf3a3ee9c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:38:49.263541 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1174/2359] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:38:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:38:49.273437 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d602a8a-b629-49d3-98e2-56ea457f3a73 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:38:49.274887 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-5d602a8a-b629-49d3-98e2-56ea457f3a73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:38:49.358128 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d602a8a-b629-49d3-98e2-56ea457f3a73 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:38:49.362127 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd1d6c0-633d-4d8e-a1b0-3011620f4cdd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca4071c5f8f4a31b5edb81fa66a43a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:38:49.362760 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd1d6c0-633d-4d8e-a1b0-3011620f4cdd service neutron] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:38:49.363832 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd1d6c0-633d-4d8e-a1b0-3011620f4cdd service neutron] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:38:49.364090 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd1d6c0-633d-4d8e-a1b0-3011620f4cdd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:38:49.376744 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd1d6c0-633d-4d8e-a1b0-3011620f4cdd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:38:49.378609 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd1d6c0-633d-4d8e-a1b0-3011620f4cdd service neutron] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:38:49.391892 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1186/2360] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:38:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:38:49.695913 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4911e036-4b16-4a77-85bf-95bf3a3ee9c5 None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:38:49.697389 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-4911e036-4b16-4a77-85bf-95bf3a3ee9c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:38:49.720625 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4911e036-4b16-4a77-85bf-95bf3a3ee9c5 None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:38:49.726432 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78133ed6-ef66-4afc-917e-b7b3951bc342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:38:49.728225 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78133ed6-ef66-4afc-917e-b7b3951bc342 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:38:49.728515 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78133ed6-ef66-4afc-917e-b7b3951bc342 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:38:49.728786 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78133ed6-ef66-4afc-917e-b7b3951bc342 admin admin] PATH_INFO: `/v3/projects/bc694ce2854a4952a814d65fcc2bdc67` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:38:49.730265 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78133ed6-ef66-4afc-917e-b7b3951bc342 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc694ce2854a4952a814d65fcc2bdc67)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:38:49.732250 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78133ed6-ef66-4afc-917e-b7b3951bc342 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:38:49.787412 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-78133ed6-ef66-4afc-917e-b7b3951bc342 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc694ce2854a4952a814d65fcc2bdc67', 'request_id': 'req-78133ed6-ef66-4afc-917e-b7b3951bc342'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:38:49.793230 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-78133ed6-ef66-4afc-917e-b7b3951bc342 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc694ce2854a4952a814d65fcc2bdc67', 'request_id': 'req-78133ed6-ef66-4afc-917e-b7b3951bc342'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:38:49.800313 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-78133ed6-ef66-4afc-917e-b7b3951bc342 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc694ce2854a4952a814d65fcc2bdc67', 'request_id': 'req-78133ed6-ef66-4afc-917e-b7b3951bc342'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:38:49.815497 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-78133ed6-ef66-4afc-917e-b7b3951bc342 admin admin] The token cache is being invalidate because project bc694ce2854a4952a814d65fcc2bdc67 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79120) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 25 02:38:49.815823 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-78133ed6-ef66-4afc-917e-b7b3951bc342 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:38:49.816477 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-78133ed6-ef66-4afc-917e-b7b3951bc342 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:38:49.818092 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1175/2361] 10.222.0.117 () {58 vars in 1237 bytes} [Tue Jan 25 02:38:49 2022] DELETE /identity/v3/projects/bc694ce2854a4952a814d65fcc2bdc67 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:38:51.323799 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af14b968-632f-429b-8f82-de80d44b9670 None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:38:51.324281 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af14b968-632f-429b-8f82-de80d44b9670 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:38:51.324386 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af14b968-632f-429b-8f82-de80d44b9670 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:38:51.342128 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-af14b968-632f-429b-8f82-de80d44b9670 None None] MFA Rules not processed for user `5924414ee6e948a680b8b75c8797b466`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:38:51.343337 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-af14b968-632f-429b-8f82-de80d44b9670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:38:51.403562 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1187/2362] 10.222.0.117 () {58 vars in 972 bytes} [Tue Jan 25 02:38:51 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:38:51.416267 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78133ed6-ef66-4afc-917e-b7b3951bc342 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:38:51.417683 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-78133ed6-ef66-4afc-917e-b7b3951bc342 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:38:51.496675 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78133ed6-ef66-4afc-917e-b7b3951bc342 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:38:51.501765 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40650e3-bf41-4ba0-97cc-5cbe4251218d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100f12ee56754f1c859106bf3e473df6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:38:51.502415 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40650e3-bf41-4ba0-97cc-5cbe4251218d service swift] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:38:51.502693 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40650e3-bf41-4ba0-97cc-5cbe4251218d service swift] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:38:51.502969 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40650e3-bf41-4ba0-97cc-5cbe4251218d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:38:51.511896 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40650e3-bf41-4ba0-97cc-5cbe4251218d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:38:51.513475 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40650e3-bf41-4ba0-97cc-5cbe4251218d service swift] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:38:51.522147 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1176/2363] 10.222.0.117 () {60 vars in 1389 bytes} [Tue Jan 25 02:38:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 25 02:38:53.404694 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af14b968-632f-429b-8f82-de80d44b9670 None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:38:53.406182 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-af14b968-632f-429b-8f82-de80d44b9670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:38:53.472183 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af14b968-632f-429b-8f82-de80d44b9670 None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:38:53.476937 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72e032d-3004-459e-8de5-0de1ef09e368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:38:53.477798 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72e032d-3004-459e-8de5-0de1ef09e368 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:38:53.478081 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72e032d-3004-459e-8de5-0de1ef09e368 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:38:53.478356 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72e032d-3004-459e-8de5-0de1ef09e368 admin admin] PATH_INFO: `/v3/users/a3a11152b2324f51b9120ec8fc90e227` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:38:53.479553 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72e032d-3004-459e-8de5-0de1ef09e368 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3a11152b2324f51b9120ec8fc90e227)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:38:53.481529 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72e032d-3004-459e-8de5-0de1ef09e368 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:38:53.525819 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-d72e032d-3004-459e-8de5-0de1ef09e368 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3a11152b2324f51b9120ec8fc90e227'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:38:53.526465 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-d72e032d-3004-459e-8de5-0de1ef09e368 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3a11152b2324f51b9120ec8fc90e227'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:38:53.532959 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-d72e032d-3004-459e-8de5-0de1ef09e368 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3a11152b2324f51b9120ec8fc90e227'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:38:53.533583 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-d72e032d-3004-459e-8de5-0de1ef09e368 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3a11152b2324f51b9120ec8fc90e227'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:38:53.542456 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-d72e032d-3004-459e-8de5-0de1ef09e368 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3a11152b2324f51b9120ec8fc90e227'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:38:53.560054 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1188/2364] 10.222.0.117 () {58 vars in 1228 bytes} [Tue Jan 25 02:38:53 2022] DELETE /identity/v3/users/a3a11152b2324f51b9120ec8fc90e227 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:38:53.733342 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40650e3-bf41-4ba0-97cc-5cbe4251218d service swift] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:38:53.745025 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40650e3-bf41-4ba0-97cc-5cbe4251218d service swift] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:38:53.800052 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2010b4-d0f6-4a1c-9e7a-fb45de6cdccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:38:53.801622 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2010b4-d0f6-4a1c-9e7a-fb45de6cdccf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:38:53.802128 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2010b4-d0f6-4a1c-9e7a-fb45de6cdccf admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:38:53.802417 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2010b4-d0f6-4a1c-9e7a-fb45de6cdccf admin admin] PATH_INFO: `/v3/projects/18d6138733cc4dd9a2af54fecae74805` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:38:53.803608 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2010b4-d0f6-4a1c-9e7a-fb45de6cdccf admin admin] RBAC: Authorizing `identity:delete_project(project_id=18d6138733cc4dd9a2af54fecae74805)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:38:53.805520 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2010b4-d0f6-4a1c-9e7a-fb45de6cdccf admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:38:53.851016 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-3c2010b4-d0f6-4a1c-9e7a-fb45de6cdccf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18d6138733cc4dd9a2af54fecae74805', 'request_id': 'req-3c2010b4-d0f6-4a1c-9e7a-fb45de6cdccf'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:38:53.856130 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-3c2010b4-d0f6-4a1c-9e7a-fb45de6cdccf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18d6138733cc4dd9a2af54fecae74805', 'request_id': 'req-3c2010b4-d0f6-4a1c-9e7a-fb45de6cdccf'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:38:53.861892 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-3c2010b4-d0f6-4a1c-9e7a-fb45de6cdccf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18d6138733cc4dd9a2af54fecae74805', 'request_id': 'req-3c2010b4-d0f6-4a1c-9e7a-fb45de6cdccf'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:38:53.875304 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-3c2010b4-d0f6-4a1c-9e7a-fb45de6cdccf admin admin] The token cache is being invalidate because project 18d6138733cc4dd9a2af54fecae74805 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79120) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 25 02:38:53.875591 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-3c2010b4-d0f6-4a1c-9e7a-fb45de6cdccf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:38:53.876213 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-3c2010b4-d0f6-4a1c-9e7a-fb45de6cdccf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:38:53.877730 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1177/2365] 10.222.0.117 () {58 vars in 1237 bytes} [Tue Jan 25 02:38:53 2022] DELETE /identity/v3/projects/18d6138733cc4dd9a2af54fecae74805 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:39:22.094791 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72e032d-3004-459e-8de5-0de1ef09e368 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:39:22.096395 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-d72e032d-3004-459e-8de5-0de1ef09e368 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:39:22.112657 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72e032d-3004-459e-8de5-0de1ef09e368 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:39:22.175950 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c227fdf-446f-40a3-9dea-ecc420804558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:39:22.176840 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c227fdf-446f-40a3-9dea-ecc420804558 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:39:22.177128 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c227fdf-446f-40a3-9dea-ecc420804558 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:39:22.177406 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c227fdf-446f-40a3-9dea-ecc420804558 admin admin] PATH_INFO: `/v3/users/ee5b954a34da4c95aab352015a7c551c` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:39:22.178646 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c227fdf-446f-40a3-9dea-ecc420804558 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee5b954a34da4c95aab352015a7c551c)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:39:22.180642 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c227fdf-446f-40a3-9dea-ecc420804558 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:39:22.232630 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-7c227fdf-446f-40a3-9dea-ecc420804558 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee5b954a34da4c95aab352015a7c551c'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:39:22.233273 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-7c227fdf-446f-40a3-9dea-ecc420804558 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee5b954a34da4c95aab352015a7c551c'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:39:22.240742 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-7c227fdf-446f-40a3-9dea-ecc420804558 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee5b954a34da4c95aab352015a7c551c'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:39:22.242092 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-7c227fdf-446f-40a3-9dea-ecc420804558 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee5b954a34da4c95aab352015a7c551c'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:39:22.250570 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-7c227fdf-446f-40a3-9dea-ecc420804558 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee5b954a34da4c95aab352015a7c551c'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:39:22.270265 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1189/2366] 10.222.0.117 () {58 vars in 1228 bytes} [Tue Jan 25 02:39:22 2022] DELETE /identity/v3/users/ee5b954a34da4c95aab352015a7c551c => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:39:22.440328 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2010b4-d0f6-4a1c-9e7a-fb45de6cdccf admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:39:22.442740 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-3c2010b4-d0f6-4a1c-9e7a-fb45de6cdccf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:39:22.455934 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2010b4-d0f6-4a1c-9e7a-fb45de6cdccf admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:39:22.512936 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21d65cd-ea42-427c-ad0d-58cafdc3c80d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:39:22.513791 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21d65cd-ea42-427c-ad0d-58cafdc3c80d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:39:22.514070 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21d65cd-ea42-427c-ad0d-58cafdc3c80d admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:39:22.514375 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21d65cd-ea42-427c-ad0d-58cafdc3c80d admin admin] PATH_INFO: `/v3/projects/feffe01cf3f84eb1800d246f235af06f` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:39:22.515544 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21d65cd-ea42-427c-ad0d-58cafdc3c80d admin admin] RBAC: Authorizing `identity:delete_project(project_id=feffe01cf3f84eb1800d246f235af06f)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:39:22.517466 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21d65cd-ea42-427c-ad0d-58cafdc3c80d admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:39:22.562828 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-f21d65cd-ea42-427c-ad0d-58cafdc3c80d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'feffe01cf3f84eb1800d246f235af06f', 'request_id': 'req-f21d65cd-ea42-427c-ad0d-58cafdc3c80d'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:39:22.568141 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-f21d65cd-ea42-427c-ad0d-58cafdc3c80d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'feffe01cf3f84eb1800d246f235af06f', 'request_id': 'req-f21d65cd-ea42-427c-ad0d-58cafdc3c80d'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:39:22.574061 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-f21d65cd-ea42-427c-ad0d-58cafdc3c80d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'feffe01cf3f84eb1800d246f235af06f', 'request_id': 'req-f21d65cd-ea42-427c-ad0d-58cafdc3c80d'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:39:22.586573 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-f21d65cd-ea42-427c-ad0d-58cafdc3c80d admin admin] The token cache is being invalidate because project feffe01cf3f84eb1800d246f235af06f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79120) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 25 02:39:22.586866 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-f21d65cd-ea42-427c-ad0d-58cafdc3c80d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:39:22.587497 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-f21d65cd-ea42-427c-ad0d-58cafdc3c80d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:39:22.589157 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1178/2367] 10.222.0.117 () {58 vars in 1237 bytes} [Tue Jan 25 02:39:22 2022] DELETE /identity/v3/projects/feffe01cf3f84eb1800d246f235af06f => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:39:22.595034 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c949859-43b9-4884-921e-6487ad9a4c1e None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:39:22.595327 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c949859-43b9-4884-921e-6487ad9a4c1e None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:39:22.595609 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c949859-43b9-4884-921e-6487ad9a4c1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:39:22.613780 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-4c949859-43b9-4884-921e-6487ad9a4c1e None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:39:22.614987 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-4c949859-43b9-4884-921e-6487ad9a4c1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:39:22.671351 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1190/2368] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:39:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:39:22.679480 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8b4da2-7cd6-414d-a177-299203d84e5a None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:39:22.679797 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8b4da2-7cd6-414d-a177-299203d84e5a None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:39:22.680068 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8b4da2-7cd6-414d-a177-299203d84e5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:39:22.697969 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-6d8b4da2-7cd6-414d-a177-299203d84e5a None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:39:22.699170 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-6d8b4da2-7cd6-414d-a177-299203d84e5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:39:22.707805 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1179/2369] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:39:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:39:22.711930 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c949859-43b9-4884-921e-6487ad9a4c1e None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:39:22.721694 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c949859-43b9-4884-921e-6487ad9a4c1e None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:39:22.727155 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9771c68e-21cb-4987-97d8-22c9d4a82736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:39:22.727848 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9771c68e-21cb-4987-97d8-22c9d4a82736 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:39:22.728136 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9771c68e-21cb-4987-97d8-22c9d4a82736 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:39:22.728418 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9771c68e-21cb-4987-97d8-22c9d4a82736 admin admin] PATH_INFO: `/v3/domains` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:39:22.729160 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9771c68e-21cb-4987-97d8-22c9d4a82736 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:39:22.729468 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9771c68e-21cb-4987-97d8-22c9d4a82736 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:39:22.731074 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9771c68e-21cb-4987-97d8-22c9d4a82736 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:39:22.742431 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1191/2370] 10.222.0.117 () {58 vars in 1157 bytes} [Tue Jan 25 02:39:22 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 02:39:22.746685 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8b4da2-7cd6-414d-a177-299203d84e5a None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:39:22.755781 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8b4da2-7cd6-414d-a177-299203d84e5a None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:39:22.760487 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ec063c-1d8f-448a-84b4-ce25591dbc73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:39:22.761129 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ec063c-1d8f-448a-84b4-ce25591dbc73 admin admin] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:39:22.761414 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ec063c-1d8f-448a-84b4-ce25591dbc73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:39:22.761693 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ec063c-1d8f-448a-84b4-ce25591dbc73 admin admin] PATH_INFO: `/v3/projects` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:39:22.762421 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ec063c-1d8f-448a-84b4-ce25591dbc73 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:39:22.764348 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ec063c-1d8f-448a-84b4-ce25591dbc73 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:39:22.792294 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1180/2371] 10.222.0.117 () {60 vars in 1157 bytes} [Tue Jan 25 02:39:22 2022] POST /identity/v3/projects => generated 376 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 02:39:22.795208 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9771c68e-21cb-4987-97d8-22c9d4a82736 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:39:22.805148 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9771c68e-21cb-4987-97d8-22c9d4a82736 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:39:22.860408 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45a8324-95b2-4efc-a063-1df2b6442f48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:39:22.861326 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45a8324-95b2-4efc-a063-1df2b6442f48 admin admin] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:39:22.861326 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45a8324-95b2-4efc-a063-1df2b6442f48 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:39:22.861528 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45a8324-95b2-4efc-a063-1df2b6442f48 admin admin] PATH_INFO: `/v3/users` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:39:22.862213 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45a8324-95b2-4efc-a063-1df2b6442f48 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:39:22.864247 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45a8324-95b2-4efc-a063-1df2b6442f48 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:39:22.887933 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1192/2372] 10.222.0.117 () {60 vars in 1148 bytes} [Tue Jan 25 02:39:22 2022] POST /identity/v3/users => generated 289 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 02:39:22.889189 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ec063c-1d8f-448a-84b4-ce25591dbc73 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:39:22.900349 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ec063c-1d8f-448a-84b4-ce25591dbc73 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:39:22.905007 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5609d5fd-2bee-4300-9ec7-274fdaf87068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:39:22.905666 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5609d5fd-2bee-4300-9ec7-274fdaf87068 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:39:22.905951 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5609d5fd-2bee-4300-9ec7-274fdaf87068 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:39:22.906225 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5609d5fd-2bee-4300-9ec7-274fdaf87068 admin admin] PATH_INFO: `/v3/roles` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:39:22.906991 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5609d5fd-2bee-4300-9ec7-274fdaf87068 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:39:22.908609 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5609d5fd-2bee-4300-9ec7-274fdaf87068 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:39:22.919493 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1181/2373] 10.222.0.117 () {58 vars in 1126 bytes} [Tue Jan 25 02:39:22 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 02:39:22.923543 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45a8324-95b2-4efc-a063-1df2b6442f48 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:39:22.933929 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45a8324-95b2-4efc-a063-1df2b6442f48 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:39:22.938612 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ce074b-b627-44bf-a161-f78be3df9e28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:39:22.939271 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ce074b-b627-44bf-a161-f78be3df9e28 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:39:22.939553 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ce074b-b627-44bf-a161-f78be3df9e28 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:39:22.939861 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ce074b-b627-44bf-a161-f78be3df9e28 admin admin] PATH_INFO: `/v3/roles` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:39:22.940639 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ce074b-b627-44bf-a161-f78be3df9e28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:39:22.942791 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ce074b-b627-44bf-a161-f78be3df9e28 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:39:22.952839 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1193/2374] 10.222.0.117 () {58 vars in 1126 bytes} [Tue Jan 25 02:39:22 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 02:39:22.957631 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5609d5fd-2bee-4300-9ec7-274fdaf87068 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:39:22.967313 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5609d5fd-2bee-4300-9ec7-274fdaf87068 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:39:22.972109 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f5c51b-0d36-4817-aeaf-24241a87587a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:39:22.973133 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f5c51b-0d36-4817-aeaf-24241a87587a admin admin] REQUEST_METHOD: `PUT` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:39:22.973414 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f5c51b-0d36-4817-aeaf-24241a87587a admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:39:22.973693 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f5c51b-0d36-4817-aeaf-24241a87587a admin admin] PATH_INFO: `/v3/projects/334fc558eb7e4efb8031bd3f409ddfda/users/8f9b0a291a2041aab799eef5bbf8f77b/roles/33a8e87420ed423f9cb29e0084eab5d2` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:39:22.988105 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f5c51b-0d36-4817-aeaf-24241a87587a admin admin] RBAC: Authorizing `identity:create_grant(project_id=334fc558eb7e4efb8031bd3f409ddfda, user_id=8f9b0a291a2041aab799eef5bbf8f77b, role_id=33a8e87420ed423f9cb29e0084eab5d2)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:39:22.990814 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f5c51b-0d36-4817-aeaf-24241a87587a admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:39:23.006321 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1182/2375] 10.222.0.117 () {60 vars in 1487 bytes} [Tue Jan 25 02:39:22 2022] PUT /identity/v3/projects/334fc558eb7e4efb8031bd3f409ddfda/users/8f9b0a291a2041aab799eef5bbf8f77b/roles/33a8e87420ed423f9cb29e0084eab5d2 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:39:23.011872 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68115d7-25a9-4e2e-a9a4-3563cd10b11c None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:39:23.012182 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68115d7-25a9-4e2e-a9a4-3563cd10b11c None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:39:23.012488 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68115d7-25a9-4e2e-a9a4-3563cd10b11c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:39:23.036869 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-e68115d7-25a9-4e2e-a9a4-3563cd10b11c None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:39:23.038068 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-e68115d7-25a9-4e2e-a9a4-3563cd10b11c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:39:23.099139 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1194/2376] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:39:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:39:23.108746 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f5c51b-0d36-4817-aeaf-24241a87587a admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:39:23.110524 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-96f5c51b-0d36-4817-aeaf-24241a87587a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:39:23.168527 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f5c51b-0d36-4817-aeaf-24241a87587a admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:39:23.172284 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e226384c-d617-4629-8d40-af26b5e7e9b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca4071c5f8f4a31b5edb81fa66a43a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:39:23.172934 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e226384c-d617-4629-8d40-af26b5e7e9b7 service neutron] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:39:23.173220 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e226384c-d617-4629-8d40-af26b5e7e9b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:39:23.173496 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e226384c-d617-4629-8d40-af26b5e7e9b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:39:23.183191 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e226384c-d617-4629-8d40-af26b5e7e9b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:39:23.184661 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e226384c-d617-4629-8d40-af26b5e7e9b7 service neutron] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:39:23.194692 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1183/2377] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:39:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:39:26.128387 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68115d7-25a9-4e2e-a9a4-3563cd10b11c None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:39:26.133212 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-e68115d7-25a9-4e2e-a9a4-3563cd10b11c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:39:26.150670 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68115d7-25a9-4e2e-a9a4-3563cd10b11c None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:39:26.156085 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f259a5-7976-4da4-bcc4-eb2751496a02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:39:26.156881 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f259a5-7976-4da4-bcc4-eb2751496a02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:39:26.157165 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f259a5-7976-4da4-bcc4-eb2751496a02 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:39:26.157441 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f259a5-7976-4da4-bcc4-eb2751496a02 admin admin] PATH_INFO: `/v3/users/63855c1cdc7b46548312f2e14d99cfe1` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:39:26.158711 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f259a5-7976-4da4-bcc4-eb2751496a02 admin admin] RBAC: Authorizing `identity:delete_user(user_id=63855c1cdc7b46548312f2e14d99cfe1)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:39:26.161432 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f259a5-7976-4da4-bcc4-eb2751496a02 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:39:26.217067 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-21f259a5-7976-4da4-bcc4-eb2751496a02 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63855c1cdc7b46548312f2e14d99cfe1'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:39:26.217763 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-21f259a5-7976-4da4-bcc4-eb2751496a02 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63855c1cdc7b46548312f2e14d99cfe1'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:39:26.226942 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-21f259a5-7976-4da4-bcc4-eb2751496a02 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63855c1cdc7b46548312f2e14d99cfe1'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:39:26.227797 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-21f259a5-7976-4da4-bcc4-eb2751496a02 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63855c1cdc7b46548312f2e14d99cfe1'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:39:26.236449 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-21f259a5-7976-4da4-bcc4-eb2751496a02 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63855c1cdc7b46548312f2e14d99cfe1'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:39:26.260638 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1195/2378] 10.222.0.117 () {58 vars in 1228 bytes} [Tue Jan 25 02:39:26 2022] DELETE /identity/v3/users/63855c1cdc7b46548312f2e14d99cfe1 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:39:26.528483 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e226384c-d617-4629-8d40-af26b5e7e9b7 service neutron] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:39:26.539674 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e226384c-d617-4629-8d40-af26b5e7e9b7 service neutron] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:39:26.609902 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0801f2cb-f791-43fa-921c-59f87d9156f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:39:26.611001 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0801f2cb-f791-43fa-921c-59f87d9156f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:39:26.611494 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0801f2cb-f791-43fa-921c-59f87d9156f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:39:26.611991 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0801f2cb-f791-43fa-921c-59f87d9156f4 admin admin] PATH_INFO: `/v3/projects/6d1acc2413564b368f3c2ec812ffe6ef` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:39:26.614353 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0801f2cb-f791-43fa-921c-59f87d9156f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d1acc2413564b368f3c2ec812ffe6ef)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:39:26.616820 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0801f2cb-f791-43fa-921c-59f87d9156f4 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:39:26.666129 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-0801f2cb-f791-43fa-921c-59f87d9156f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d1acc2413564b368f3c2ec812ffe6ef', 'request_id': 'req-0801f2cb-f791-43fa-921c-59f87d9156f4'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:39:26.671658 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-0801f2cb-f791-43fa-921c-59f87d9156f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d1acc2413564b368f3c2ec812ffe6ef', 'request_id': 'req-0801f2cb-f791-43fa-921c-59f87d9156f4'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:39:26.685853 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-0801f2cb-f791-43fa-921c-59f87d9156f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d1acc2413564b368f3c2ec812ffe6ef', 'request_id': 'req-0801f2cb-f791-43fa-921c-59f87d9156f4'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:39:26.699774 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-0801f2cb-f791-43fa-921c-59f87d9156f4 admin admin] The token cache is being invalidate because project 6d1acc2413564b368f3c2ec812ffe6ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79120) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 25 02:39:26.700343 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-0801f2cb-f791-43fa-921c-59f87d9156f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:39:26.701162 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-0801f2cb-f791-43fa-921c-59f87d9156f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:39:26.702928 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1184/2379] 10.222.0.117 () {58 vars in 1237 bytes} [Tue Jan 25 02:39:26 2022] DELETE /identity/v3/projects/6d1acc2413564b368f3c2ec812ffe6ef => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:39:26.709497 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91576f6-a820-46c2-8b51-26e6872d7ce0 None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:39:26.709794 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91576f6-a820-46c2-8b51-26e6872d7ce0 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:39:26.710070 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91576f6-a820-46c2-8b51-26e6872d7ce0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:39:26.733760 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-f91576f6-a820-46c2-8b51-26e6872d7ce0 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:39:26.735000 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-f91576f6-a820-46c2-8b51-26e6872d7ce0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:39:26.801153 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1196/2380] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:39:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:39:26.809290 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768e8836-bba4-49a4-93b6-e9fbd5de31ae None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:39:26.809786 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768e8836-bba4-49a4-93b6-e9fbd5de31ae None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:39:26.810277 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768e8836-bba4-49a4-93b6-e9fbd5de31ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:39:26.847197 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-768e8836-bba4-49a4-93b6-e9fbd5de31ae None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:39:26.849277 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-768e8836-bba4-49a4-93b6-e9fbd5de31ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:39:26.857863 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1185/2381] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:39:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:39:26.862418 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91576f6-a820-46c2-8b51-26e6872d7ce0 None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:39:26.872990 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91576f6-a820-46c2-8b51-26e6872d7ce0 None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:39:26.878138 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae387cd3-6dd9-40e1-a8f9-41293bd14e13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:39:26.879368 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae387cd3-6dd9-40e1-a8f9-41293bd14e13 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:39:26.879723 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae387cd3-6dd9-40e1-a8f9-41293bd14e13 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:39:26.880211 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae387cd3-6dd9-40e1-a8f9-41293bd14e13 admin admin] PATH_INFO: `/v3/domains` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:39:26.880830 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae387cd3-6dd9-40e1-a8f9-41293bd14e13 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:39:26.881193 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae387cd3-6dd9-40e1-a8f9-41293bd14e13 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:39:26.882989 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae387cd3-6dd9-40e1-a8f9-41293bd14e13 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:39:26.896141 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1197/2382] 10.222.0.117 () {58 vars in 1157 bytes} [Tue Jan 25 02:39:26 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:39:26.900542 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768e8836-bba4-49a4-93b6-e9fbd5de31ae None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:39:26.909770 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768e8836-bba4-49a4-93b6-e9fbd5de31ae None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:39:26.914871 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52e429b-8442-4899-be4b-78ab19e71048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:39:26.915532 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52e429b-8442-4899-be4b-78ab19e71048 admin admin] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:39:26.915850 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52e429b-8442-4899-be4b-78ab19e71048 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:39:26.916127 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52e429b-8442-4899-be4b-78ab19e71048 admin admin] PATH_INFO: `/v3/projects` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:39:26.916939 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52e429b-8442-4899-be4b-78ab19e71048 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:39:26.918855 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52e429b-8442-4899-be4b-78ab19e71048 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:39:26.950342 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1186/2383] 10.222.0.117 () {60 vars in 1157 bytes} [Tue Jan 25 02:39:26 2022] POST /identity/v3/projects => generated 372 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 02:39:26.952303 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae387cd3-6dd9-40e1-a8f9-41293bd14e13 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:39:26.963903 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae387cd3-6dd9-40e1-a8f9-41293bd14e13 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:39:27.024304 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a21d3cd-e200-44e8-b8ca-cd45aa9f0c7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:39:27.025325 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a21d3cd-e200-44e8-b8ca-cd45aa9f0c7e admin admin] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:39:27.025525 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a21d3cd-e200-44e8-b8ca-cd45aa9f0c7e admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:39:27.025905 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a21d3cd-e200-44e8-b8ca-cd45aa9f0c7e admin admin] PATH_INFO: `/v3/users` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:39:27.026681 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a21d3cd-e200-44e8-b8ca-cd45aa9f0c7e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:39:27.028835 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a21d3cd-e200-44e8-b8ca-cd45aa9f0c7e admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:39:27.049995 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1198/2384] 10.222.0.117 () {60 vars in 1148 bytes} [Tue Jan 25 02:39:26 2022] POST /identity/v3/users => generated 287 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 02:39:27.054768 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52e429b-8442-4899-be4b-78ab19e71048 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:39:27.065584 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52e429b-8442-4899-be4b-78ab19e71048 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:39:27.072811 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6037d778-e6f8-4d43-8874-5f1b471ce20e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:39:27.073713 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6037d778-e6f8-4d43-8874-5f1b471ce20e admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:39:27.074035 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6037d778-e6f8-4d43-8874-5f1b471ce20e admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:39:27.074318 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6037d778-e6f8-4d43-8874-5f1b471ce20e admin admin] PATH_INFO: `/v3/roles` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:39:27.075277 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6037d778-e6f8-4d43-8874-5f1b471ce20e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:39:27.076712 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6037d778-e6f8-4d43-8874-5f1b471ce20e admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:39:27.091655 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1187/2385] 10.222.0.117 () {58 vars in 1126 bytes} [Tue Jan 25 02:39:27 2022] GET /identity/v3/roles => generated 1427 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 02:39:27.093477 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a21d3cd-e200-44e8-b8ca-cd45aa9f0c7e admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:39:27.107443 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a21d3cd-e200-44e8-b8ca-cd45aa9f0c7e admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:39:27.112985 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4258287c-b87a-43da-b551-3a7478f6df70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:39:27.114028 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4258287c-b87a-43da-b551-3a7478f6df70 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:39:27.114352 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4258287c-b87a-43da-b551-3a7478f6df70 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:39:27.114659 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4258287c-b87a-43da-b551-3a7478f6df70 admin admin] PATH_INFO: `/v3/roles` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:39:27.115460 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4258287c-b87a-43da-b551-3a7478f6df70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:39:27.117127 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4258287c-b87a-43da-b551-3a7478f6df70 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:39:27.127521 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1199/2386] 10.222.0.117 () {58 vars in 1126 bytes} [Tue Jan 25 02:39:27 2022] GET /identity/v3/roles => generated 1427 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 02:39:27.132237 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6037d778-e6f8-4d43-8874-5f1b471ce20e admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:39:27.159426 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6037d778-e6f8-4d43-8874-5f1b471ce20e admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:39:27.166621 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db52b436-72ce-44e8-a558-75648e0afc61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:39:27.167795 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db52b436-72ce-44e8-a558-75648e0afc61 admin admin] REQUEST_METHOD: `PUT` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:39:27.168214 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db52b436-72ce-44e8-a558-75648e0afc61 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:39:27.168564 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db52b436-72ce-44e8-a558-75648e0afc61 admin admin] PATH_INFO: `/v3/projects/2d1e558c616c4630847d555adbce2d74/users/b5c627f252a14a0c9489919da41642e5/roles/33a8e87420ed423f9cb29e0084eab5d2` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:39:27.195592 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db52b436-72ce-44e8-a558-75648e0afc61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d1e558c616c4630847d555adbce2d74, user_id=b5c627f252a14a0c9489919da41642e5, role_id=33a8e87420ed423f9cb29e0084eab5d2)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:39:27.199893 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db52b436-72ce-44e8-a558-75648e0afc61 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:39:27.230215 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1188/2387] 10.222.0.117 () {60 vars in 1487 bytes} [Tue Jan 25 02:39:27 2022] PUT /identity/v3/projects/2d1e558c616c4630847d555adbce2d74/users/b5c627f252a14a0c9489919da41642e5/roles/33a8e87420ed423f9cb29e0084eab5d2 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:39:27.241621 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac6e731-3aad-4711-88a5-abcd7396fba5 None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:39:27.242482 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac6e731-3aad-4711-88a5-abcd7396fba5 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:39:27.242903 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac6e731-3aad-4711-88a5-abcd7396fba5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:39:27.274025 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-9ac6e731-3aad-4711-88a5-abcd7396fba5 None None] MFA Rules not processed for user `b5c627f252a14a0c9489919da41642e5`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:39:27.275594 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-9ac6e731-3aad-4711-88a5-abcd7396fba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:39:27.361287 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db52b436-72ce-44e8-a558-75648e0afc61 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:39:27.364364 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1200/2388] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:39:27 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:39:27.461388 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db52b436-72ce-44e8-a558-75648e0afc61 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:39:27.466902 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9f7f8e-6d67-46c5-9679-9883ebe8ac2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:39:27.467905 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9f7f8e-6d67-46c5-9679-9883ebe8ac2d admin admin] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:39:27.468286 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9f7f8e-6d67-46c5-9679-9883ebe8ac2d admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:39:27.468639 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9f7f8e-6d67-46c5-9679-9883ebe8ac2d admin admin] PATH_INFO: `/v3/projects` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:39:27.469671 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9f7f8e-6d67-46c5-9679-9883ebe8ac2d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:39:27.471776 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9f7f8e-6d67-46c5-9679-9883ebe8ac2d admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:39:27.515988 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac6e731-3aad-4711-88a5-abcd7396fba5 None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:39:27.531718 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1189/2389] 10.222.0.117 () {60 vars in 1157 bytes} [Tue Jan 25 02:39:27 2022] POST /identity/v3/projects => generated 372 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 02:39:27.535495 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac6e731-3aad-4711-88a5-abcd7396fba5 None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:39:27.607573 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803a547d-2b05-4346-9e8e-20089944892d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:39:27.608793 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803a547d-2b05-4346-9e8e-20089944892d admin admin] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:39:27.609164 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803a547d-2b05-4346-9e8e-20089944892d admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:39:27.609517 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803a547d-2b05-4346-9e8e-20089944892d admin admin] PATH_INFO: `/v3/users` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:39:27.610495 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803a547d-2b05-4346-9e8e-20089944892d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:39:27.613913 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803a547d-2b05-4346-9e8e-20089944892d admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:39:27.639171 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1201/2390] 10.222.0.117 () {60 vars in 1148 bytes} [Tue Jan 25 02:39:27 2022] POST /identity/v3/users => generated 293 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 02:39:27.642843 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9f7f8e-6d67-46c5-9679-9883ebe8ac2d admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:39:27.657457 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9f7f8e-6d67-46c5-9679-9883ebe8ac2d admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:39:27.664509 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6235afa9-5a9f-4923-93c4-2113ce26ddca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:39:27.665882 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6235afa9-5a9f-4923-93c4-2113ce26ddca admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:39:27.666347 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6235afa9-5a9f-4923-93c4-2113ce26ddca admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:39:27.667516 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6235afa9-5a9f-4923-93c4-2113ce26ddca admin admin] PATH_INFO: `/v3/roles` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:39:27.668841 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6235afa9-5a9f-4923-93c4-2113ce26ddca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:39:27.671550 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6235afa9-5a9f-4923-93c4-2113ce26ddca admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:39:27.687762 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1190/2391] 10.222.0.117 () {58 vars in 1126 bytes} [Tue Jan 25 02:39:27 2022] GET /identity/v3/roles => generated 1427 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 02:39:27.692566 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803a547d-2b05-4346-9e8e-20089944892d admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:39:27.705303 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803a547d-2b05-4346-9e8e-20089944892d admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:39:27.715146 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2c9cca-a5af-4d6c-b76e-1c9ce7385410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:39:27.716703 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2c9cca-a5af-4d6c-b76e-1c9ce7385410 admin admin] REQUEST_METHOD: `PUT` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:39:27.717049 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2c9cca-a5af-4d6c-b76e-1c9ce7385410 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:39:27.717459 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2c9cca-a5af-4d6c-b76e-1c9ce7385410 admin admin] PATH_INFO: `/v3/projects/2f63d52f3bcd4a149b68ef8dd85ce183/users/8b47d98e05bf473a933e0713431273d0/roles/d8dbc6d83d9d41d28c3feb8b3485b291` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:39:27.734946 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2c9cca-a5af-4d6c-b76e-1c9ce7385410 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f63d52f3bcd4a149b68ef8dd85ce183, user_id=8b47d98e05bf473a933e0713431273d0, role_id=d8dbc6d83d9d41d28c3feb8b3485b291)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:39:27.737645 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2c9cca-a5af-4d6c-b76e-1c9ce7385410 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:39:27.754490 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1202/2392] 10.222.0.117 () {60 vars in 1487 bytes} [Tue Jan 25 02:39:27 2022] PUT /identity/v3/projects/2f63d52f3bcd4a149b68ef8dd85ce183/users/8b47d98e05bf473a933e0713431273d0/roles/d8dbc6d83d9d41d28c3feb8b3485b291 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:39:27.758312 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6235afa9-5a9f-4923-93c4-2113ce26ddca admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:39:27.768570 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6235afa9-5a9f-4923-93c4-2113ce26ddca admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:39:27.835371 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cb580d-4a59-4f6b-8673-115280c3a277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:39:27.836434 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cb580d-4a59-4f6b-8673-115280c3a277 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:39:27.836935 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cb580d-4a59-4f6b-8673-115280c3a277 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:39:27.837466 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cb580d-4a59-4f6b-8673-115280c3a277 admin admin] PATH_INFO: `/v3/roles` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:39:27.838442 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cb580d-4a59-4f6b-8673-115280c3a277 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:39:27.840413 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cb580d-4a59-4f6b-8673-115280c3a277 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:39:27.852151 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1191/2393] 10.222.0.117 () {58 vars in 1126 bytes} [Tue Jan 25 02:39:27 2022] GET /identity/v3/roles => generated 1427 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 02:39:27.856228 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2c9cca-a5af-4d6c-b76e-1c9ce7385410 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:39:27.867084 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2c9cca-a5af-4d6c-b76e-1c9ce7385410 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:39:27.872698 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96be5983-35fa-4de2-9906-2ed2e742151f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:39:27.873674 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96be5983-35fa-4de2-9906-2ed2e742151f admin admin] REQUEST_METHOD: `PUT` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:39:27.874389 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96be5983-35fa-4de2-9906-2ed2e742151f admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:39:27.874864 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96be5983-35fa-4de2-9906-2ed2e742151f admin admin] PATH_INFO: `/v3/projects/2f63d52f3bcd4a149b68ef8dd85ce183/users/8b47d98e05bf473a933e0713431273d0/roles/d8dbc6d83d9d41d28c3feb8b3485b291` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:39:27.877581 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96be5983-35fa-4de2-9906-2ed2e742151f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f63d52f3bcd4a149b68ef8dd85ce183, user_id=8b47d98e05bf473a933e0713431273d0, role_id=d8dbc6d83d9d41d28c3feb8b3485b291)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:39:27.881680 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96be5983-35fa-4de2-9906-2ed2e742151f admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:39:27.902262 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1203/2394] 10.222.0.117 () {60 vars in 1487 bytes} [Tue Jan 25 02:39:27 2022] PUT /identity/v3/projects/2f63d52f3bcd4a149b68ef8dd85ce183/users/8b47d98e05bf473a933e0713431273d0/roles/d8dbc6d83d9d41d28c3feb8b3485b291 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:39:27.904825 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3463063c-e2a6-41f4-8c3b-b7410315da70 None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:39:27.905175 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3463063c-e2a6-41f4-8c3b-b7410315da70 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:39:27.905474 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3463063c-e2a6-41f4-8c3b-b7410315da70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:39:27.946966 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-3463063c-e2a6-41f4-8c3b-b7410315da70 None None] MFA Rules not processed for user `8b47d98e05bf473a933e0713431273d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:39:27.948390 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-3463063c-e2a6-41f4-8c3b-b7410315da70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:39:28.030498 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1192/2395] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:39:27 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:39:28.041371 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96be5983-35fa-4de2-9906-2ed2e742151f admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:39:28.043272 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-96be5983-35fa-4de2-9906-2ed2e742151f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:39:28.160779 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96be5983-35fa-4de2-9906-2ed2e742151f admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:39:28.165693 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a598a780-1b7c-4e5f-ad28-f2d90603a850 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cc5249aea09430080e232cf17757f86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:39:28.166357 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a598a780-1b7c-4e5f-ad28-f2d90603a850 service cinder] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:39:28.166660 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a598a780-1b7c-4e5f-ad28-f2d90603a850 service cinder] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:39:28.166934 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a598a780-1b7c-4e5f-ad28-f2d90603a850 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:39:28.181947 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a598a780-1b7c-4e5f-ad28-f2d90603a850 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:39:28.183468 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a598a780-1b7c-4e5f-ad28-f2d90603a850 service cinder] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:39:28.196065 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1204/2396] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:39:28 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:39:28.279228 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513873d3-234a-4099-984f-4c31ffcc4216 None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:39:28.279552 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513873d3-234a-4099-984f-4c31ffcc4216 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:39:28.279907 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513873d3-234a-4099-984f-4c31ffcc4216 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:39:28.283795 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a598a780-1b7c-4e5f-ad28-f2d90603a850 service cinder] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:39:28.293237 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a598a780-1b7c-4e5f-ad28-f2d90603a850 service cinder] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:39:28.297285 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7879fb-d9f4-41c7-bc9c-b246a3f45427 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cc5249aea09430080e232cf17757f86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:39:28.297944 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7879fb-d9f4-41c7-bc9c-b246a3f45427 service cinder] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:39:28.298218 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7879fb-d9f4-41c7-bc9c-b246a3f45427 service cinder] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:39:28.298544 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7879fb-d9f4-41c7-bc9c-b246a3f45427 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:39:28.310731 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-513873d3-234a-4099-984f-4c31ffcc4216 None None] MFA Rules not processed for user `8f9b0a291a2041aab799eef5bbf8f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:39:28.311988 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-513873d3-234a-4099-984f-4c31ffcc4216 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:39:28.404068 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7879fb-d9f4-41c7-bc9c-b246a3f45427 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:39:28.405527 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7879fb-d9f4-41c7-bc9c-b246a3f45427 service cinder] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:39:28.422669 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1205/2397] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:39:28 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 25 02:39:28.428576 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1193/2398] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:39:28 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:39:28.440475 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7879fb-d9f4-41c7-bc9c-b246a3f45427 service cinder] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:39:28.442164 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-7f7879fb-d9f4-41c7-bc9c-b246a3f45427 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:39:28.578499 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7879fb-d9f4-41c7-bc9c-b246a3f45427 service cinder] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:39:28.586658 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282fffa5-aad7-47ed-8838-c8b658461167 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9ad6269900346458050063c12cac299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:39:28.591823 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282fffa5-aad7-47ed-8838-c8b658461167 service nova] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:39:28.591823 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282fffa5-aad7-47ed-8838-c8b658461167 service nova] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:39:28.591823 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282fffa5-aad7-47ed-8838-c8b658461167 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:39:28.598646 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282fffa5-aad7-47ed-8838-c8b658461167 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:39:28.600332 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282fffa5-aad7-47ed-8838-c8b658461167 service nova] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:39:28.610404 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1206/2399] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:39:28 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:39:30.867756 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15df141a-967d-4507-a6a2-99e6560fe895 None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:39:30.868591 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15df141a-967d-4507-a6a2-99e6560fe895 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:39:30.868894 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15df141a-967d-4507-a6a2-99e6560fe895 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:39:30.886840 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-15df141a-967d-4507-a6a2-99e6560fe895 None None] MFA Rules not processed for user `8f9b0a291a2041aab799eef5bbf8f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:39:30.888198 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-15df141a-967d-4507-a6a2-99e6560fe895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:39:30.895305 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1194/2400] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:39:30 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:39:39.057044 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a626ad66-067c-4b86-8731-ed400203b0c1 None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:39:39.057703 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a626ad66-067c-4b86-8731-ed400203b0c1 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:39:39.057703 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a626ad66-067c-4b86-8731-ed400203b0c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:39:39.118659 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-a626ad66-067c-4b86-8731-ed400203b0c1 None None] MFA Rules not processed for user `5924414ee6e948a680b8b75c8797b466`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:39:39.120034 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-a626ad66-067c-4b86-8731-ed400203b0c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:39:39.201281 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1207/2401] 10.222.0.117 () {58 vars in 1014 bytes} [Tue Jan 25 02:39:39 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:39:39.225042 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15df141a-967d-4507-a6a2-99e6560fe895 None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:39:39.226467 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-15df141a-967d-4507-a6a2-99e6560fe895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:39:39.332956 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15df141a-967d-4507-a6a2-99e6560fe895 None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:39:39.333861 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c313fe-49b5-4fb4-86c5-4daf9dc77e75 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100f12ee56754f1c859106bf3e473df6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:39:39.334671 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c313fe-49b5-4fb4-86c5-4daf9dc77e75 service swift] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:39:39.334951 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c313fe-49b5-4fb4-86c5-4daf9dc77e75 service swift] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:39:39.335222 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c313fe-49b5-4fb4-86c5-4daf9dc77e75 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:39:39.345985 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c313fe-49b5-4fb4-86c5-4daf9dc77e75 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:39:39.348689 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c313fe-49b5-4fb4-86c5-4daf9dc77e75 service swift] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:39:39.358780 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1195/2402] 10.222.0.117 () {60 vars in 1389 bytes} [Tue Jan 25 02:39:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 25 02:39:54.513312 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ceb38a-868e-43b5-b184-2844b8e6b607 None None] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:39:54.513917 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ceb38a-868e-43b5-b184-2844b8e6b607 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:39:54.513917 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ceb38a-868e-43b5-b184-2844b8e6b607 None None] PATH_INFO: `/` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:39:54.515679 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1208/2403] 10.222.0.117 () {54 vars in 926 bytes} [Tue Jan 25 02:39:54 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:39:54.522448 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3a99a7-b272-4f4e-b6ae-98012a27af18 None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:39:54.522916 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3a99a7-b272-4f4e-b6ae-98012a27af18 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:39:54.522916 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3a99a7-b272-4f4e-b6ae-98012a27af18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:39:54.561336 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-2f3a99a7-b272-4f4e-b6ae-98012a27af18 None None] MFA Rules not processed for user `d9ad6269900346458050063c12cac299`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:39:54.562106 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-2f3a99a7-b272-4f4e-b6ae-98012a27af18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:39:54.571674 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1196/2404] 10.222.0.117 () {58 vars in 1023 bytes} [Tue Jan 25 02:39:54 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 25 02:39:54.584194 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ceb38a-868e-43b5-b184-2844b8e6b607 None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:39:54.585880 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-24ceb38a-868e-43b5-b184-2844b8e6b607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:39:54.664824 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ceb38a-868e-43b5-b184-2844b8e6b607 None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:39:54.668450 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5be379-32e8-44d2-9bbc-10d5727a1153 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db3663416137459d9da4a71032505b0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:39:54.669083 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5be379-32e8-44d2-9bbc-10d5727a1153 service glance] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:39:54.669365 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5be379-32e8-44d2-9bbc-10d5727a1153 service glance] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:39:54.669642 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5be379-32e8-44d2-9bbc-10d5727a1153 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:39:54.680575 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5be379-32e8-44d2-9bbc-10d5727a1153 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:39:54.682029 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5be379-32e8-44d2-9bbc-10d5727a1153 service glance] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:39:54.692544 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1209/2405] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:39:54 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:39:54.760335 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfef886-a4bf-4361-92af-7e1099f39e5e None None] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:39:54.760625 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfef886-a4bf-4361-92af-7e1099f39e5e None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:39:54.760905 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfef886-a4bf-4361-92af-7e1099f39e5e None None] PATH_INFO: `/` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:39:54.762688 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1197/2406] 10.222.0.117 () {54 vars in 926 bytes} [Tue Jan 25 02:39:54 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:39:54.767403 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c7b03c-8bac-48c3-86aa-228efb5a895f None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:39:54.767729 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c7b03c-8bac-48c3-86aa-228efb5a895f None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:39:54.767987 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c7b03c-8bac-48c3-86aa-228efb5a895f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:39:54.786647 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-52c7b03c-8bac-48c3-86aa-228efb5a895f None None] MFA Rules not processed for user `9ca4071c5f8f4a31b5edb81fa66a43a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:39:54.787804 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-52c7b03c-8bac-48c3-86aa-228efb5a895f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:39:54.837999 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1210/2407] 10.222.0.117 () {58 vars in 1023 bytes} [Tue Jan 25 02:39:54 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:39:54.850392 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfef886-a4bf-4361-92af-7e1099f39e5e None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:39:54.852217 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-9cfef886-a4bf-4361-92af-7e1099f39e5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:39:54.865167 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfef886-a4bf-4361-92af-7e1099f39e5e None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:39:54.868660 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15413d7-4773-4ca7-948d-a3482ff05405 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca4071c5f8f4a31b5edb81fa66a43a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:39:54.869293 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15413d7-4773-4ca7-948d-a3482ff05405 service neutron] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:39:54.869573 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15413d7-4773-4ca7-948d-a3482ff05405 service neutron] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:39:54.869845 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15413d7-4773-4ca7-948d-a3482ff05405 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:39:54.876837 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15413d7-4773-4ca7-948d-a3482ff05405 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:39:54.878275 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15413d7-4773-4ca7-948d-a3482ff05405 service neutron] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:39:54.886262 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1198/2408] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:39:54 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:40:03.755239 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdb862b-942d-4e2f-81e4-e82e00e1f7b5 None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:40:03.755798 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdb862b-942d-4e2f-81e4-e82e00e1f7b5 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:40:03.755798 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdb862b-942d-4e2f-81e4-e82e00e1f7b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:40:03.773571 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-4fdb862b-942d-4e2f-81e4-e82e00e1f7b5 None None] MFA Rules not processed for user `5924414ee6e948a680b8b75c8797b466`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:40:03.774796 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-4fdb862b-942d-4e2f-81e4-e82e00e1f7b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:40:03.782234 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1211/2409] 10.222.0.117 () {58 vars in 1014 bytes} [Tue Jan 25 02:40:03 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:40:03.794339 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15413d7-4773-4ca7-948d-a3482ff05405 service neutron] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:40:03.807256 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15413d7-4773-4ca7-948d-a3482ff05405 service neutron] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:40:03.812543 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ca18a6-9152-4885-9af0-e903f6cd89b2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100f12ee56754f1c859106bf3e473df6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:40:03.813217 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ca18a6-9152-4885-9af0-e903f6cd89b2 service swift] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:40:03.813502 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ca18a6-9152-4885-9af0-e903f6cd89b2 service swift] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:40:03.813780 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ca18a6-9152-4885-9af0-e903f6cd89b2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:40:03.826259 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ca18a6-9152-4885-9af0-e903f6cd89b2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:40:03.828116 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ca18a6-9152-4885-9af0-e903f6cd89b2 service swift] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:40:03.839046 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1199/2410] 10.222.0.117 () {60 vars in 1389 bytes} [Tue Jan 25 02:40:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 25 02:40:18.354287 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdb862b-942d-4e2f-81e4-e82e00e1f7b5 None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:40:18.419082 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdb862b-942d-4e2f-81e4-e82e00e1f7b5 None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:40:18.423759 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9416e9-43e0-42cb-9bf2-8ceebe137831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:40:18.424653 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9416e9-43e0-42cb-9bf2-8ceebe137831 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:40:18.424936 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9416e9-43e0-42cb-9bf2-8ceebe137831 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:40:18.425212 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9416e9-43e0-42cb-9bf2-8ceebe137831 admin admin] PATH_INFO: `/v3/users/b5c627f252a14a0c9489919da41642e5` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:40:18.426689 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9416e9-43e0-42cb-9bf2-8ceebe137831 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5c627f252a14a0c9489919da41642e5)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:40:18.428807 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9416e9-43e0-42cb-9bf2-8ceebe137831 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:40:18.474568 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-bb9416e9-43e0-42cb-9bf2-8ceebe137831 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5c627f252a14a0c9489919da41642e5'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:40:18.475217 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-bb9416e9-43e0-42cb-9bf2-8ceebe137831 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5c627f252a14a0c9489919da41642e5'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:40:18.481785 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-bb9416e9-43e0-42cb-9bf2-8ceebe137831 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5c627f252a14a0c9489919da41642e5'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:40:18.482410 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-bb9416e9-43e0-42cb-9bf2-8ceebe137831 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5c627f252a14a0c9489919da41642e5'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:40:18.489551 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-bb9416e9-43e0-42cb-9bf2-8ceebe137831 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5c627f252a14a0c9489919da41642e5'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:40:18.505854 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1212/2411] 10.222.0.117 () {58 vars in 1228 bytes} [Tue Jan 25 02:40:18 2022] DELETE /identity/v3/users/b5c627f252a14a0c9489919da41642e5 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:40:18.510385 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2104b58-cdf7-47d7-99c9-aa253657bb44 None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:40:18.510907 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2104b58-cdf7-47d7-99c9-aa253657bb44 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:40:18.511012 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2104b58-cdf7-47d7-99c9-aa253657bb44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:40:18.528528 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-f2104b58-cdf7-47d7-99c9-aa253657bb44 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:40:18.529649 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-f2104b58-cdf7-47d7-99c9-aa253657bb44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:40:18.586024 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1200/2412] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:40:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:40:18.595733 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9416e9-43e0-42cb-9bf2-8ceebe137831 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:40:18.597239 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-bb9416e9-43e0-42cb-9bf2-8ceebe137831 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:40:18.653042 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9416e9-43e0-42cb-9bf2-8ceebe137831 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:40:18.656900 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71e5b54-65f3-4b94-a4bc-20adda2a5b13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca4071c5f8f4a31b5edb81fa66a43a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:40:18.657542 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71e5b54-65f3-4b94-a4bc-20adda2a5b13 service neutron] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:40:18.657829 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71e5b54-65f3-4b94-a4bc-20adda2a5b13 service neutron] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:40:18.658105 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71e5b54-65f3-4b94-a4bc-20adda2a5b13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:40:18.667890 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71e5b54-65f3-4b94-a4bc-20adda2a5b13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:40:18.669340 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71e5b54-65f3-4b94-a4bc-20adda2a5b13 service neutron] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:40:18.679028 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1213/2413] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:40:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:40:18.935600 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2104b58-cdf7-47d7-99c9-aa253657bb44 None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:40:18.937089 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-f2104b58-cdf7-47d7-99c9-aa253657bb44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:40:18.949311 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2104b58-cdf7-47d7-99c9-aa253657bb44 None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:40:18.954275 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7fe0fa-35c9-4717-ae88-6641bd4ac6fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:40:18.955146 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7fe0fa-35c9-4717-ae88-6641bd4ac6fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:40:18.955515 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7fe0fa-35c9-4717-ae88-6641bd4ac6fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:40:18.956003 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7fe0fa-35c9-4717-ae88-6641bd4ac6fc admin admin] PATH_INFO: `/v3/projects/2d1e558c616c4630847d555adbce2d74` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:40:18.957243 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7fe0fa-35c9-4717-ae88-6641bd4ac6fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d1e558c616c4630847d555adbce2d74)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:40:18.959666 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7fe0fa-35c9-4717-ae88-6641bd4ac6fc admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:40:19.005350 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-cd7fe0fa-35c9-4717-ae88-6641bd4ac6fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d1e558c616c4630847d555adbce2d74', 'request_id': 'req-cd7fe0fa-35c9-4717-ae88-6641bd4ac6fc'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:40:19.010965 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-cd7fe0fa-35c9-4717-ae88-6641bd4ac6fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d1e558c616c4630847d555adbce2d74', 'request_id': 'req-cd7fe0fa-35c9-4717-ae88-6641bd4ac6fc'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:40:19.017329 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-cd7fe0fa-35c9-4717-ae88-6641bd4ac6fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d1e558c616c4630847d555adbce2d74', 'request_id': 'req-cd7fe0fa-35c9-4717-ae88-6641bd4ac6fc'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:40:19.028770 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-cd7fe0fa-35c9-4717-ae88-6641bd4ac6fc admin admin] The token cache is being invalidate because project 2d1e558c616c4630847d555adbce2d74 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79120) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 25 02:40:19.029056 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-cd7fe0fa-35c9-4717-ae88-6641bd4ac6fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:40:19.029666 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-cd7fe0fa-35c9-4717-ae88-6641bd4ac6fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:40:19.031225 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1201/2414] 10.222.0.117 () {58 vars in 1237 bytes} [Tue Jan 25 02:40:18 2022] DELETE /identity/v3/projects/2d1e558c616c4630847d555adbce2d74 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:40:19.035199 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71e5b54-65f3-4b94-a4bc-20adda2a5b13 service neutron] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:40:19.045211 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71e5b54-65f3-4b94-a4bc-20adda2a5b13 service neutron] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:40:19.101814 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4206551a-89fb-4384-bdae-fe8f2c5bea1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:40:19.102593 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4206551a-89fb-4384-bdae-fe8f2c5bea1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:40:19.102873 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4206551a-89fb-4384-bdae-fe8f2c5bea1a admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:40:19.103145 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4206551a-89fb-4384-bdae-fe8f2c5bea1a admin admin] PATH_INFO: `/v3/users/8b47d98e05bf473a933e0713431273d0` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:40:19.104343 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4206551a-89fb-4384-bdae-fe8f2c5bea1a admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b47d98e05bf473a933e0713431273d0)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:40:19.106238 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4206551a-89fb-4384-bdae-fe8f2c5bea1a admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:40:19.151179 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-4206551a-89fb-4384-bdae-fe8f2c5bea1a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b47d98e05bf473a933e0713431273d0'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:40:19.151885 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-4206551a-89fb-4384-bdae-fe8f2c5bea1a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b47d98e05bf473a933e0713431273d0'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:40:19.158577 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-4206551a-89fb-4384-bdae-fe8f2c5bea1a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b47d98e05bf473a933e0713431273d0'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:40:19.159212 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-4206551a-89fb-4384-bdae-fe8f2c5bea1a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b47d98e05bf473a933e0713431273d0'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:40:19.167171 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-4206551a-89fb-4384-bdae-fe8f2c5bea1a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b47d98e05bf473a933e0713431273d0'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:40:19.184200 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1214/2415] 10.222.0.117 () {58 vars in 1228 bytes} [Tue Jan 25 02:40:19 2022] DELETE /identity/v3/users/8b47d98e05bf473a933e0713431273d0 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:40:19.451625 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7fe0fa-35c9-4717-ae88-6641bd4ac6fc admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:40:19.453750 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-cd7fe0fa-35c9-4717-ae88-6641bd4ac6fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:40:19.467745 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7fe0fa-35c9-4717-ae88-6641bd4ac6fc admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:40:19.529808 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d81678-c4a8-4fd9-bb06-b488b480aaaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:40:19.530682 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d81678-c4a8-4fd9-bb06-b488b480aaaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:40:19.530969 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d81678-c4a8-4fd9-bb06-b488b480aaaa admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:40:19.531248 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d81678-c4a8-4fd9-bb06-b488b480aaaa admin admin] PATH_INFO: `/v3/projects/2f63d52f3bcd4a149b68ef8dd85ce183` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:40:19.532497 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d81678-c4a8-4fd9-bb06-b488b480aaaa admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f63d52f3bcd4a149b68ef8dd85ce183)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:40:19.534406 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d81678-c4a8-4fd9-bb06-b488b480aaaa admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:40:19.582113 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-d5d81678-c4a8-4fd9-bb06-b488b480aaaa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f63d52f3bcd4a149b68ef8dd85ce183', 'request_id': 'req-d5d81678-c4a8-4fd9-bb06-b488b480aaaa'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:40:19.588648 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-d5d81678-c4a8-4fd9-bb06-b488b480aaaa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f63d52f3bcd4a149b68ef8dd85ce183', 'request_id': 'req-d5d81678-c4a8-4fd9-bb06-b488b480aaaa'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:40:19.594977 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-d5d81678-c4a8-4fd9-bb06-b488b480aaaa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f63d52f3bcd4a149b68ef8dd85ce183', 'request_id': 'req-d5d81678-c4a8-4fd9-bb06-b488b480aaaa'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:40:19.608700 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-d5d81678-c4a8-4fd9-bb06-b488b480aaaa admin admin] The token cache is being invalidate because project 2f63d52f3bcd4a149b68ef8dd85ce183 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79120) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 25 02:40:19.608900 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-d5d81678-c4a8-4fd9-bb06-b488b480aaaa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:40:19.609519 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-d5d81678-c4a8-4fd9-bb06-b488b480aaaa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:40:19.611058 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1202/2416] 10.222.0.117 () {58 vars in 1237 bytes} [Tue Jan 25 02:40:19 2022] DELETE /identity/v3/projects/2f63d52f3bcd4a149b68ef8dd85ce183 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:40:19.616927 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ce69e2-4aa0-4d2d-9342-38954dbe6297 None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:40:19.617425 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ce69e2-4aa0-4d2d-9342-38954dbe6297 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:40:19.617425 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ce69e2-4aa0-4d2d-9342-38954dbe6297 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:40:19.638161 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-71ce69e2-4aa0-4d2d-9342-38954dbe6297 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:40:19.639374 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-71ce69e2-4aa0-4d2d-9342-38954dbe6297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:40:19.697235 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1215/2417] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:40:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:40:19.706475 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ec9241-4057-4723-84a4-eb75ca3cb2f9 None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:40:19.706765 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ec9241-4057-4723-84a4-eb75ca3cb2f9 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:40:19.707044 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ec9241-4057-4723-84a4-eb75ca3cb2f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:40:19.733476 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-f1ec9241-4057-4723-84a4-eb75ca3cb2f9 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:40:19.734744 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-f1ec9241-4057-4723-84a4-eb75ca3cb2f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:40:19.742872 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1203/2418] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:40:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:40:19.747072 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ce69e2-4aa0-4d2d-9342-38954dbe6297 None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:40:19.757839 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ce69e2-4aa0-4d2d-9342-38954dbe6297 None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:40:19.762572 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5357685c-fe55-4bea-b2ac-4a356b1d9c5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:40:19.763231 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5357685c-fe55-4bea-b2ac-4a356b1d9c5e admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:40:19.763513 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5357685c-fe55-4bea-b2ac-4a356b1d9c5e admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:40:19.763889 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5357685c-fe55-4bea-b2ac-4a356b1d9c5e admin admin] PATH_INFO: `/v3/domains` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:40:19.764632 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5357685c-fe55-4bea-b2ac-4a356b1d9c5e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:40:19.764939 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5357685c-fe55-4bea-b2ac-4a356b1d9c5e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:40:19.766552 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5357685c-fe55-4bea-b2ac-4a356b1d9c5e admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:40:19.778685 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1216/2419] 10.222.0.117 () {58 vars in 1157 bytes} [Tue Jan 25 02:40:19 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:40:19.783022 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ec9241-4057-4723-84a4-eb75ca3cb2f9 None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:40:19.792940 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ec9241-4057-4723-84a4-eb75ca3cb2f9 None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:40:19.797576 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa07150d-8721-4aac-bed3-dd0a1f66947d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:40:19.798219 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa07150d-8721-4aac-bed3-dd0a1f66947d admin admin] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:40:19.798502 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa07150d-8721-4aac-bed3-dd0a1f66947d admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:40:19.798774 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa07150d-8721-4aac-bed3-dd0a1f66947d admin admin] PATH_INFO: `/v3/projects` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:40:19.799463 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa07150d-8721-4aac-bed3-dd0a1f66947d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:40:19.801560 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa07150d-8721-4aac-bed3-dd0a1f66947d admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:40:19.827264 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1204/2420] 10.222.0.117 () {60 vars in 1157 bytes} [Tue Jan 25 02:40:19 2022] POST /identity/v3/projects => generated 378 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 02:40:19.830979 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5357685c-fe55-4bea-b2ac-4a356b1d9c5e admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:40:19.841257 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5357685c-fe55-4bea-b2ac-4a356b1d9c5e admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:40:19.897055 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9ae79d-13a4-4cac-958b-9349e0ae4458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:40:19.898303 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9ae79d-13a4-4cac-958b-9349e0ae4458 admin admin] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:40:19.898581 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9ae79d-13a4-4cac-958b-9349e0ae4458 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:40:19.898849 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9ae79d-13a4-4cac-958b-9349e0ae4458 admin admin] PATH_INFO: `/v3/users` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:40:19.899556 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9ae79d-13a4-4cac-958b-9349e0ae4458 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:40:19.901520 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9ae79d-13a4-4cac-958b-9349e0ae4458 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:40:19.921299 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1217/2421] 10.222.0.117 () {60 vars in 1148 bytes} [Tue Jan 25 02:40:19 2022] POST /identity/v3/users => generated 290 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 02:40:19.925392 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa07150d-8721-4aac-bed3-dd0a1f66947d admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:40:19.935866 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa07150d-8721-4aac-bed3-dd0a1f66947d admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:40:19.940738 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d353506-4810-4a74-9c4e-c88bded49c9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:40:19.941395 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d353506-4810-4a74-9c4e-c88bded49c9c admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:40:19.941679 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d353506-4810-4a74-9c4e-c88bded49c9c admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:40:19.942460 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d353506-4810-4a74-9c4e-c88bded49c9c admin admin] PATH_INFO: `/v3/roles` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:40:19.943192 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d353506-4810-4a74-9c4e-c88bded49c9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:40:19.944935 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d353506-4810-4a74-9c4e-c88bded49c9c admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:40:19.955302 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1205/2422] 10.222.0.117 () {58 vars in 1126 bytes} [Tue Jan 25 02:40:19 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 02:40:19.959983 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9ae79d-13a4-4cac-958b-9349e0ae4458 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:40:19.969901 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9ae79d-13a4-4cac-958b-9349e0ae4458 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:40:19.974759 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825feb12-dc45-420c-9d07-daa50cc8cbac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:40:19.975444 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825feb12-dc45-420c-9d07-daa50cc8cbac admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:40:19.975759 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825feb12-dc45-420c-9d07-daa50cc8cbac admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:40:19.976044 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825feb12-dc45-420c-9d07-daa50cc8cbac admin admin] PATH_INFO: `/v3/roles` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:40:19.976817 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825feb12-dc45-420c-9d07-daa50cc8cbac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:40:19.978420 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825feb12-dc45-420c-9d07-daa50cc8cbac admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:40:19.988130 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1218/2423] 10.222.0.117 () {58 vars in 1126 bytes} [Tue Jan 25 02:40:19 2022] GET /identity/v3/roles => generated 1427 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 02:40:19.992456 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d353506-4810-4a74-9c4e-c88bded49c9c admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:40:20.002201 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d353506-4810-4a74-9c4e-c88bded49c9c admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:40:20.007444 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5279a4-064a-40ff-831f-f8f21449e9ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:40:20.008352 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5279a4-064a-40ff-831f-f8f21449e9ec admin admin] REQUEST_METHOD: `PUT` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:40:20.008642 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5279a4-064a-40ff-831f-f8f21449e9ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:40:20.009041 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5279a4-064a-40ff-831f-f8f21449e9ec admin admin] PATH_INFO: `/v3/projects/19e048205eae41dc869543aca8cf6616/users/0c835bda697644a7bde37a72a0bcd74f/roles/33a8e87420ed423f9cb29e0084eab5d2` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:40:20.024552 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5279a4-064a-40ff-831f-f8f21449e9ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=19e048205eae41dc869543aca8cf6616, user_id=0c835bda697644a7bde37a72a0bcd74f, role_id=33a8e87420ed423f9cb29e0084eab5d2)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:40:20.027213 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5279a4-064a-40ff-831f-f8f21449e9ec admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:40:20.040110 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1206/2424] 10.222.0.117 () {60 vars in 1487 bytes} [Tue Jan 25 02:40:19 2022] PUT /identity/v3/projects/19e048205eae41dc869543aca8cf6616/users/0c835bda697644a7bde37a72a0bcd74f/roles/33a8e87420ed423f9cb29e0084eab5d2 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 25 02:40:20.050300 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2921f13-6a3d-4f16-b79c-29fc1641772f None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:40:20.050592 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2921f13-6a3d-4f16-b79c-29fc1641772f None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:40:20.050872 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2921f13-6a3d-4f16-b79c-29fc1641772f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:40:20.077247 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-d2921f13-6a3d-4f16-b79c-29fc1641772f None None] MFA Rules not processed for user `0c835bda697644a7bde37a72a0bcd74f`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:40:20.078453 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-d2921f13-6a3d-4f16-b79c-29fc1641772f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:40:20.139005 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1219/2425] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:40:20 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:40:20.143423 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5279a4-064a-40ff-831f-f8f21449e9ec admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:40:20.205395 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5279a4-064a-40ff-831f-f8f21449e9ec admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:40:20.210856 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4a2c2e-8cb1-4c97-bdc2-410d0c8adbf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:40:20.211544 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4a2c2e-8cb1-4c97-bdc2-410d0c8adbf1 admin admin] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:40:20.211862 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4a2c2e-8cb1-4c97-bdc2-410d0c8adbf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:40:20.212140 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4a2c2e-8cb1-4c97-bdc2-410d0c8adbf1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:40:20.212873 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4a2c2e-8cb1-4c97-bdc2-410d0c8adbf1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:40:20.214798 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4a2c2e-8cb1-4c97-bdc2-410d0c8adbf1 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:40:20.240154 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1207/2426] 10.222.0.117 () {60 vars in 1157 bytes} [Tue Jan 25 02:40:20 2022] POST /identity/v3/projects => generated 378 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 02:40:20.244340 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2921f13-6a3d-4f16-b79c-29fc1641772f None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:40:20.255670 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2921f13-6a3d-4f16-b79c-29fc1641772f None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:40:20.310576 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623b5024-7b8e-4fb0-88fd-a83db4a6d0b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:40:20.311242 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623b5024-7b8e-4fb0-88fd-a83db4a6d0b3 admin admin] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:40:20.311525 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623b5024-7b8e-4fb0-88fd-a83db4a6d0b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:40:20.311837 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623b5024-7b8e-4fb0-88fd-a83db4a6d0b3 admin admin] PATH_INFO: `/v3/users` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:40:20.312530 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623b5024-7b8e-4fb0-88fd-a83db4a6d0b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:40:20.314455 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623b5024-7b8e-4fb0-88fd-a83db4a6d0b3 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:40:20.335886 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1220/2427] 10.222.0.117 () {60 vars in 1148 bytes} [Tue Jan 25 02:40:20 2022] POST /identity/v3/users => generated 296 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 02:40:20.339823 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4a2c2e-8cb1-4c97-bdc2-410d0c8adbf1 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:40:20.350080 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4a2c2e-8cb1-4c97-bdc2-410d0c8adbf1 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:40:20.354603 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ed6c2e-44d4-4e18-847f-dd3141e61bda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:40:20.355250 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ed6c2e-44d4-4e18-847f-dd3141e61bda admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:40:20.355533 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ed6c2e-44d4-4e18-847f-dd3141e61bda admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:40:20.355876 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ed6c2e-44d4-4e18-847f-dd3141e61bda admin admin] PATH_INFO: `/v3/roles` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:40:20.356609 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ed6c2e-44d4-4e18-847f-dd3141e61bda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:40:20.358210 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ed6c2e-44d4-4e18-847f-dd3141e61bda admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:40:20.368619 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1208/2428] 10.222.0.117 () {58 vars in 1126 bytes} [Tue Jan 25 02:40:20 2022] GET /identity/v3/roles => generated 1427 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 02:40:20.372610 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623b5024-7b8e-4fb0-88fd-a83db4a6d0b3 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:40:20.384242 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623b5024-7b8e-4fb0-88fd-a83db4a6d0b3 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:40:20.388867 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04701a4c-ad57-413e-b0ef-103289491c39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:40:20.389749 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04701a4c-ad57-413e-b0ef-103289491c39 admin admin] REQUEST_METHOD: `PUT` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:40:20.390030 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04701a4c-ad57-413e-b0ef-103289491c39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:40:20.390307 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04701a4c-ad57-413e-b0ef-103289491c39 admin admin] PATH_INFO: `/v3/projects/9a671b4fe67b44f6bb78150fecf01369/users/f6fe42bd057d4415b1bb43df5c5e99a2/roles/d8dbc6d83d9d41d28c3feb8b3485b291` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:40:20.404779 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04701a4c-ad57-413e-b0ef-103289491c39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a671b4fe67b44f6bb78150fecf01369, user_id=f6fe42bd057d4415b1bb43df5c5e99a2, role_id=d8dbc6d83d9d41d28c3feb8b3485b291)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:40:20.407451 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04701a4c-ad57-413e-b0ef-103289491c39 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:40:20.419923 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1221/2429] 10.222.0.117 () {60 vars in 1487 bytes} [Tue Jan 25 02:40:20 2022] PUT /identity/v3/projects/9a671b4fe67b44f6bb78150fecf01369/users/f6fe42bd057d4415b1bb43df5c5e99a2/roles/d8dbc6d83d9d41d28c3feb8b3485b291 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 25 02:40:20.423870 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ed6c2e-44d4-4e18-847f-dd3141e61bda admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:40:20.434351 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ed6c2e-44d4-4e18-847f-dd3141e61bda admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:40:20.489643 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cffcef-9559-499a-bed7-e09c620a80fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:40:20.490298 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cffcef-9559-499a-bed7-e09c620a80fe admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:40:20.490587 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cffcef-9559-499a-bed7-e09c620a80fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:40:20.490867 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cffcef-9559-499a-bed7-e09c620a80fe admin admin] PATH_INFO: `/v3/roles` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:40:20.491606 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cffcef-9559-499a-bed7-e09c620a80fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:40:20.493225 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cffcef-9559-499a-bed7-e09c620a80fe admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:40:20.502542 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1209/2430] 10.222.0.117 () {58 vars in 1126 bytes} [Tue Jan 25 02:40:20 2022] GET /identity/v3/roles => generated 1427 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 02:40:20.507557 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04701a4c-ad57-413e-b0ef-103289491c39 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:40:20.517622 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04701a4c-ad57-413e-b0ef-103289491c39 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:40:20.522372 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471d56d9-1d7a-4153-87b2-98b7f341538f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:40:20.523242 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471d56d9-1d7a-4153-87b2-98b7f341538f admin admin] REQUEST_METHOD: `PUT` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:40:20.523525 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471d56d9-1d7a-4153-87b2-98b7f341538f admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:40:20.523831 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471d56d9-1d7a-4153-87b2-98b7f341538f admin admin] PATH_INFO: `/v3/projects/9a671b4fe67b44f6bb78150fecf01369/users/f6fe42bd057d4415b1bb43df5c5e99a2/roles/d8dbc6d83d9d41d28c3feb8b3485b291` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:40:20.525809 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471d56d9-1d7a-4153-87b2-98b7f341538f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a671b4fe67b44f6bb78150fecf01369, user_id=f6fe42bd057d4415b1bb43df5c5e99a2, role_id=d8dbc6d83d9d41d28c3feb8b3485b291)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:40:20.528488 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471d56d9-1d7a-4153-87b2-98b7f341538f admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:40:20.538978 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1222/2431] 10.222.0.117 () {60 vars in 1487 bytes} [Tue Jan 25 02:40:20 2022] PUT /identity/v3/projects/9a671b4fe67b44f6bb78150fecf01369/users/f6fe42bd057d4415b1bb43df5c5e99a2/roles/d8dbc6d83d9d41d28c3feb8b3485b291 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:40:20.550208 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3c270a-1a36-42b9-8cf1-868ddeaaab39 None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:40:20.550702 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3c270a-1a36-42b9-8cf1-868ddeaaab39 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:40:20.550799 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3c270a-1a36-42b9-8cf1-868ddeaaab39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:40:20.578127 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-eb3c270a-1a36-42b9-8cf1-868ddeaaab39 None None] MFA Rules not processed for user `f6fe42bd057d4415b1bb43df5c5e99a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:40:20.579621 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-eb3c270a-1a36-42b9-8cf1-868ddeaaab39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:40:20.647262 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1210/2432] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:40:20 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:40:20.657047 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471d56d9-1d7a-4153-87b2-98b7f341538f admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:40:20.658818 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-471d56d9-1d7a-4153-87b2-98b7f341538f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:40:20.718482 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471d56d9-1d7a-4153-87b2-98b7f341538f admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:40:20.721980 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e09202-248c-41b2-b998-a64c011d900e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cc5249aea09430080e232cf17757f86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:40:20.722615 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e09202-248c-41b2-b998-a64c011d900e service cinder] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:40:20.722896 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e09202-248c-41b2-b998-a64c011d900e service cinder] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:40:20.723196 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e09202-248c-41b2-b998-a64c011d900e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:40:20.779574 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e09202-248c-41b2-b998-a64c011d900e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:40:20.781060 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e09202-248c-41b2-b998-a64c011d900e service cinder] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:40:20.790033 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1223/2433] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:40:20 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:40:25.358657 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3c270a-1a36-42b9-8cf1-868ddeaaab39 None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:40:25.360089 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-eb3c270a-1a36-42b9-8cf1-868ddeaaab39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:40:25.420308 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3c270a-1a36-42b9-8cf1-868ddeaaab39 None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:40:25.423926 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffdeb50-264e-44f1-8deb-90705339a266 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca4071c5f8f4a31b5edb81fa66a43a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:40:25.424569 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffdeb50-264e-44f1-8deb-90705339a266 service neutron] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:40:25.424853 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffdeb50-264e-44f1-8deb-90705339a266 service neutron] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:40:25.425133 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffdeb50-264e-44f1-8deb-90705339a266 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:40:25.427630 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-dffdeb50-264e-44f1-8deb-90705339a266 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:40:25.495173 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffdeb50-264e-44f1-8deb-90705339a266 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:40:25.496647 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffdeb50-264e-44f1-8deb-90705339a266 service neutron] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:40:25.507471 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1211/2434] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:40:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:40:27.404858 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e09202-248c-41b2-b998-a64c011d900e service cinder] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:40:27.414389 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e09202-248c-41b2-b998-a64c011d900e service cinder] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:40:27.418071 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd9ae39-5e49-4012-b1d3-4755f3129ed6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cc5249aea09430080e232cf17757f86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:40:27.418700 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd9ae39-5e49-4012-b1d3-4755f3129ed6 service cinder] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:40:27.418982 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd9ae39-5e49-4012-b1d3-4755f3129ed6 service cinder] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:40:27.419253 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd9ae39-5e49-4012-b1d3-4755f3129ed6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:40:27.428914 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd9ae39-5e49-4012-b1d3-4755f3129ed6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:40:27.430358 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd9ae39-5e49-4012-b1d3-4755f3129ed6 service cinder] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:40:27.439606 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1224/2435] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:40:27 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:40:33.690376 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffdeb50-264e-44f1-8deb-90705339a266 service neutron] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:40:33.691860 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-dffdeb50-264e-44f1-8deb-90705339a266 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:40:33.706568 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffdeb50-264e-44f1-8deb-90705339a266 service neutron] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:40:33.714717 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c0bfd3-1b74-4264-90f6-355e6f1d6d12 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9ad6269900346458050063c12cac299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:40:33.715869 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c0bfd3-1b74-4264-90f6-355e6f1d6d12 service nova] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:40:33.716366 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c0bfd3-1b74-4264-90f6-355e6f1d6d12 service nova] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:40:33.716854 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c0bfd3-1b74-4264-90f6-355e6f1d6d12 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:40:33.719620 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-c2c0bfd3-1b74-4264-90f6-355e6f1d6d12 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:40:33.779435 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c0bfd3-1b74-4264-90f6-355e6f1d6d12 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:40:33.781321 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c0bfd3-1b74-4264-90f6-355e6f1d6d12 service nova] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:40:33.792170 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1212/2436] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:40:33 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:40:40.661294 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa2a9bf-cdba-4435-a72c-da8ebbd85f4d None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:40:40.661777 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa2a9bf-cdba-4435-a72c-da8ebbd85f4d None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:40:40.661888 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa2a9bf-cdba-4435-a72c-da8ebbd85f4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:40:40.680965 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-7fa2a9bf-cdba-4435-a72c-da8ebbd85f4d None None] MFA Rules not processed for user `5924414ee6e948a680b8b75c8797b466`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:40:40.682038 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-7fa2a9bf-cdba-4435-a72c-da8ebbd85f4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:40:40.738572 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1225/2437] 10.222.0.117 () {58 vars in 972 bytes} [Tue Jan 25 02:40:40 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:40:40.763317 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c0bfd3-1b74-4264-90f6-355e6f1d6d12 service nova] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:40:40.766662 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-c2c0bfd3-1b74-4264-90f6-355e6f1d6d12 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:40:40.838806 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c0bfd3-1b74-4264-90f6-355e6f1d6d12 service nova] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:40:40.843879 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1796b7-7bc7-4cfb-b424-b4c79ef5e870 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100f12ee56754f1c859106bf3e473df6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:40:40.844515 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1796b7-7bc7-4cfb-b424-b4c79ef5e870 service swift] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:40:40.844801 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1796b7-7bc7-4cfb-b424-b4c79ef5e870 service swift] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:40:40.845078 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1796b7-7bc7-4cfb-b424-b4c79ef5e870 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:40:40.853397 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1796b7-7bc7-4cfb-b424-b4c79ef5e870 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:40:40.854990 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1796b7-7bc7-4cfb-b424-b4c79ef5e870 service swift] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:40:40.863432 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1213/2438] 10.222.0.117 () {60 vars in 1389 bytes} [Tue Jan 25 02:40:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 25 02:40:57.184773 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa2a9bf-cdba-4435-a72c-da8ebbd85f4d None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:40:57.246746 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa2a9bf-cdba-4435-a72c-da8ebbd85f4d None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:40:57.251311 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dba55de-b8a7-4d2b-86ff-b4e29e7e74ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:40:57.252207 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dba55de-b8a7-4d2b-86ff-b4e29e7e74ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:40:57.252489 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dba55de-b8a7-4d2b-86ff-b4e29e7e74ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:40:57.252765 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dba55de-b8a7-4d2b-86ff-b4e29e7e74ee admin admin] PATH_INFO: `/v3/users/0c835bda697644a7bde37a72a0bcd74f` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:40:57.253955 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dba55de-b8a7-4d2b-86ff-b4e29e7e74ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c835bda697644a7bde37a72a0bcd74f)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:40:57.256539 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dba55de-b8a7-4d2b-86ff-b4e29e7e74ee admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:40:57.301841 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-3dba55de-b8a7-4d2b-86ff-b4e29e7e74ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c835bda697644a7bde37a72a0bcd74f'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:40:57.302544 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-3dba55de-b8a7-4d2b-86ff-b4e29e7e74ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c835bda697644a7bde37a72a0bcd74f'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:40:57.310229 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-3dba55de-b8a7-4d2b-86ff-b4e29e7e74ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c835bda697644a7bde37a72a0bcd74f'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:40:57.310867 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-3dba55de-b8a7-4d2b-86ff-b4e29e7e74ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c835bda697644a7bde37a72a0bcd74f'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:40:57.317608 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-3dba55de-b8a7-4d2b-86ff-b4e29e7e74ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c835bda697644a7bde37a72a0bcd74f'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:40:57.334439 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1226/2439] 10.222.0.117 () {58 vars in 1228 bytes} [Tue Jan 25 02:40:57 2022] DELETE /identity/v3/users/0c835bda697644a7bde37a72a0bcd74f => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:40:57.338997 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7561768f-c826-4272-88aa-3256d00166cc None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:40:57.339496 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7561768f-c826-4272-88aa-3256d00166cc None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:40:57.339783 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7561768f-c826-4272-88aa-3256d00166cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:40:57.357187 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-7561768f-c826-4272-88aa-3256d00166cc None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:40:57.358388 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-7561768f-c826-4272-88aa-3256d00166cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:40:57.416331 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1214/2440] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:40:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 25 02:40:57.425824 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dba55de-b8a7-4d2b-86ff-b4e29e7e74ee admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:40:57.427217 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-3dba55de-b8a7-4d2b-86ff-b4e29e7e74ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:40:57.482882 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dba55de-b8a7-4d2b-86ff-b4e29e7e74ee admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:40:57.486573 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08272da6-13e5-462b-9915-c48785d1881a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca4071c5f8f4a31b5edb81fa66a43a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:40:57.487213 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08272da6-13e5-462b-9915-c48785d1881a service neutron] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:40:57.487500 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08272da6-13e5-462b-9915-c48785d1881a service neutron] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:40:57.487816 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08272da6-13e5-462b-9915-c48785d1881a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:40:57.497578 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08272da6-13e5-462b-9915-c48785d1881a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:40:57.499856 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08272da6-13e5-462b-9915-c48785d1881a service neutron] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:40:57.509563 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1227/2441] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:40:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:40:57.763234 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7561768f-c826-4272-88aa-3256d00166cc None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:40:57.764728 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-7561768f-c826-4272-88aa-3256d00166cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:40:57.777313 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7561768f-c826-4272-88aa-3256d00166cc None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:40:57.782058 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a719f3-2ba0-474d-87d9-f11eef596105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:40:57.782921 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a719f3-2ba0-474d-87d9-f11eef596105 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:40:57.783208 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a719f3-2ba0-474d-87d9-f11eef596105 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:40:57.783488 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a719f3-2ba0-474d-87d9-f11eef596105 admin admin] PATH_INFO: `/v3/projects/19e048205eae41dc869543aca8cf6616` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:40:57.784735 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a719f3-2ba0-474d-87d9-f11eef596105 admin admin] RBAC: Authorizing `identity:delete_project(project_id=19e048205eae41dc869543aca8cf6616)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:40:57.786665 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a719f3-2ba0-474d-87d9-f11eef596105 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:40:57.833598 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-f5a719f3-2ba0-474d-87d9-f11eef596105 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19e048205eae41dc869543aca8cf6616', 'request_id': 'req-f5a719f3-2ba0-474d-87d9-f11eef596105'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:40:57.839920 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-f5a719f3-2ba0-474d-87d9-f11eef596105 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19e048205eae41dc869543aca8cf6616', 'request_id': 'req-f5a719f3-2ba0-474d-87d9-f11eef596105'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:40:57.846192 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-f5a719f3-2ba0-474d-87d9-f11eef596105 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19e048205eae41dc869543aca8cf6616', 'request_id': 'req-f5a719f3-2ba0-474d-87d9-f11eef596105'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:40:57.859379 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-f5a719f3-2ba0-474d-87d9-f11eef596105 admin admin] The token cache is being invalidate because project 19e048205eae41dc869543aca8cf6616 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79120) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 25 02:40:57.859720 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-f5a719f3-2ba0-474d-87d9-f11eef596105 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:40:57.860375 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-f5a719f3-2ba0-474d-87d9-f11eef596105 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:40:57.861942 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1215/2442] 10.222.0.117 () {58 vars in 1237 bytes} [Tue Jan 25 02:40:57 2022] DELETE /identity/v3/projects/19e048205eae41dc869543aca8cf6616 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:40:57.866198 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08272da6-13e5-462b-9915-c48785d1881a service neutron] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:40:57.875981 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08272da6-13e5-462b-9915-c48785d1881a service neutron] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:40:57.931049 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c2281d-77ea-481e-8833-1991c3fee8f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:40:57.931847 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c2281d-77ea-481e-8833-1991c3fee8f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:40:57.932133 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c2281d-77ea-481e-8833-1991c3fee8f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:40:57.932483 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c2281d-77ea-481e-8833-1991c3fee8f2 admin admin] PATH_INFO: `/v3/users/f6fe42bd057d4415b1bb43df5c5e99a2` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:40:57.933682 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c2281d-77ea-481e-8833-1991c3fee8f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6fe42bd057d4415b1bb43df5c5e99a2)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:40:57.935609 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c2281d-77ea-481e-8833-1991c3fee8f2 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:40:57.982596 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-41c2281d-77ea-481e-8833-1991c3fee8f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6fe42bd057d4415b1bb43df5c5e99a2'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:40:57.983246 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-41c2281d-77ea-481e-8833-1991c3fee8f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6fe42bd057d4415b1bb43df5c5e99a2'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:40:57.989811 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-41c2281d-77ea-481e-8833-1991c3fee8f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6fe42bd057d4415b1bb43df5c5e99a2'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:40:57.990981 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-41c2281d-77ea-481e-8833-1991c3fee8f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6fe42bd057d4415b1bb43df5c5e99a2'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:40:57.998286 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-41c2281d-77ea-481e-8833-1991c3fee8f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6fe42bd057d4415b1bb43df5c5e99a2'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:40:58.017250 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1228/2443] 10.222.0.117 () {58 vars in 1228 bytes} [Tue Jan 25 02:40:57 2022] DELETE /identity/v3/users/f6fe42bd057d4415b1bb43df5c5e99a2 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:40:58.288090 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a719f3-2ba0-474d-87d9-f11eef596105 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:40:58.289763 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-f5a719f3-2ba0-474d-87d9-f11eef596105 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:40:58.308214 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a719f3-2ba0-474d-87d9-f11eef596105 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:40:58.363187 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c713f5bd-72b6-45e3-bbfd-a6684f17efdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:40:58.364012 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c713f5bd-72b6-45e3-bbfd-a6684f17efdb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:40:58.364298 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c713f5bd-72b6-45e3-bbfd-a6684f17efdb admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:40:58.364576 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c713f5bd-72b6-45e3-bbfd-a6684f17efdb admin admin] PATH_INFO: `/v3/projects/9a671b4fe67b44f6bb78150fecf01369` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:40:58.366402 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c713f5bd-72b6-45e3-bbfd-a6684f17efdb admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a671b4fe67b44f6bb78150fecf01369)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:40:58.368363 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c713f5bd-72b6-45e3-bbfd-a6684f17efdb admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:40:58.413884 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-c713f5bd-72b6-45e3-bbfd-a6684f17efdb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a671b4fe67b44f6bb78150fecf01369', 'request_id': 'req-c713f5bd-72b6-45e3-bbfd-a6684f17efdb'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:40:58.419169 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-c713f5bd-72b6-45e3-bbfd-a6684f17efdb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a671b4fe67b44f6bb78150fecf01369', 'request_id': 'req-c713f5bd-72b6-45e3-bbfd-a6684f17efdb'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:40:58.425169 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-c713f5bd-72b6-45e3-bbfd-a6684f17efdb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a671b4fe67b44f6bb78150fecf01369', 'request_id': 'req-c713f5bd-72b6-45e3-bbfd-a6684f17efdb'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:40:58.437002 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-c713f5bd-72b6-45e3-bbfd-a6684f17efdb admin admin] The token cache is being invalidate because project 9a671b4fe67b44f6bb78150fecf01369 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79120) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 25 02:40:58.437297 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-c713f5bd-72b6-45e3-bbfd-a6684f17efdb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:40:58.438036 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-c713f5bd-72b6-45e3-bbfd-a6684f17efdb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:40:58.439564 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1216/2444] 10.222.0.117 () {58 vars in 1237 bytes} [Tue Jan 25 02:40:58 2022] DELETE /identity/v3/projects/9a671b4fe67b44f6bb78150fecf01369 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:40:58.445925 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b3f413-fe3e-4ba1-8242-4157094aee01 None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:40:58.446412 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b3f413-fe3e-4ba1-8242-4157094aee01 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:40:58.446518 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b3f413-fe3e-4ba1-8242-4157094aee01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:40:58.465007 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-40b3f413-fe3e-4ba1-8242-4157094aee01 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:40:58.466130 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-40b3f413-fe3e-4ba1-8242-4157094aee01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:40:58.523945 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1229/2445] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:40:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:40:58.531751 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397f5b74-26bb-4550-89a1-f53399b539f3 None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:40:58.532053 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397f5b74-26bb-4550-89a1-f53399b539f3 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:40:58.532335 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397f5b74-26bb-4550-89a1-f53399b539f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:40:58.552480 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-397f5b74-26bb-4550-89a1-f53399b539f3 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:40:58.553917 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-397f5b74-26bb-4550-89a1-f53399b539f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:40:58.562016 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1217/2446] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:40:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:40:58.566079 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b3f413-fe3e-4ba1-8242-4157094aee01 None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:40:58.575665 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b3f413-fe3e-4ba1-8242-4157094aee01 None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:40:58.580568 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4247094-fd92-4ded-9898-68df23477f0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:40:58.581218 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4247094-fd92-4ded-9898-68df23477f0a admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:40:58.581503 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4247094-fd92-4ded-9898-68df23477f0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:40:58.581780 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4247094-fd92-4ded-9898-68df23477f0a admin admin] PATH_INFO: `/v3/domains` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:40:58.582512 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4247094-fd92-4ded-9898-68df23477f0a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:40:58.582817 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4247094-fd92-4ded-9898-68df23477f0a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:40:58.585028 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4247094-fd92-4ded-9898-68df23477f0a admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:40:58.597464 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1230/2447] 10.222.0.117 () {58 vars in 1157 bytes} [Tue Jan 25 02:40:58 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:40:58.602507 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397f5b74-26bb-4550-89a1-f53399b539f3 None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:40:58.611476 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397f5b74-26bb-4550-89a1-f53399b539f3 None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:40:58.616299 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5128e780-38c5-409e-b246-6238ecb28a8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:40:58.616961 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5128e780-38c5-409e-b246-6238ecb28a8a admin admin] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:40:58.617249 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5128e780-38c5-409e-b246-6238ecb28a8a admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:40:58.617528 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5128e780-38c5-409e-b246-6238ecb28a8a admin admin] PATH_INFO: `/v3/projects` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:40:58.618230 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5128e780-38c5-409e-b246-6238ecb28a8a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:40:58.620221 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5128e780-38c5-409e-b246-6238ecb28a8a admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:40:58.644907 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1218/2448] 10.222.0.117 () {60 vars in 1157 bytes} [Tue Jan 25 02:40:58 2022] POST /identity/v3/projects => generated 382 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 25 02:40:58.649551 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4247094-fd92-4ded-9898-68df23477f0a admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:40:58.659486 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4247094-fd92-4ded-9898-68df23477f0a admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:40:58.715453 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb0d93a-e7c2-4b21-b467-841dbe248cee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:40:58.716087 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb0d93a-e7c2-4b21-b467-841dbe248cee admin admin] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:40:58.716377 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb0d93a-e7c2-4b21-b467-841dbe248cee admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:40:58.716656 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb0d93a-e7c2-4b21-b467-841dbe248cee admin admin] PATH_INFO: `/v3/users` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:40:58.717355 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb0d93a-e7c2-4b21-b467-841dbe248cee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:40:58.719469 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb0d93a-e7c2-4b21-b467-841dbe248cee admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:40:58.742033 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1231/2449] 10.222.0.117 () {60 vars in 1148 bytes} [Tue Jan 25 02:40:58 2022] POST /identity/v3/users => generated 292 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 02:40:58.746287 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5128e780-38c5-409e-b246-6238ecb28a8a admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:40:58.756732 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5128e780-38c5-409e-b246-6238ecb28a8a admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:40:58.761346 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c4201f-a70a-4814-865b-c4c057f8ab71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:40:58.761993 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c4201f-a70a-4814-865b-c4c057f8ab71 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:40:58.762275 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c4201f-a70a-4814-865b-c4c057f8ab71 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:40:58.762551 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c4201f-a70a-4814-865b-c4c057f8ab71 admin admin] PATH_INFO: `/v3/roles` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:40:58.763279 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c4201f-a70a-4814-865b-c4c057f8ab71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:40:58.764972 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c4201f-a70a-4814-865b-c4c057f8ab71 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:40:58.775656 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1219/2450] 10.222.0.117 () {58 vars in 1126 bytes} [Tue Jan 25 02:40:58 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 02:40:58.779458 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb0d93a-e7c2-4b21-b467-841dbe248cee admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:40:58.790170 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb0d93a-e7c2-4b21-b467-841dbe248cee admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:40:58.794859 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def59e94-c4ba-4a08-b4c6-13ee9a2d3b59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:40:58.795512 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def59e94-c4ba-4a08-b4c6-13ee9a2d3b59 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:40:58.795827 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def59e94-c4ba-4a08-b4c6-13ee9a2d3b59 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:40:58.796098 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def59e94-c4ba-4a08-b4c6-13ee9a2d3b59 admin admin] PATH_INFO: `/v3/roles` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:40:58.796843 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def59e94-c4ba-4a08-b4c6-13ee9a2d3b59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:40:58.798445 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def59e94-c4ba-4a08-b4c6-13ee9a2d3b59 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:40:58.808464 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1232/2451] 10.222.0.117 () {58 vars in 1126 bytes} [Tue Jan 25 02:40:58 2022] GET /identity/v3/roles => generated 1427 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 02:40:58.812612 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c4201f-a70a-4814-865b-c4c057f8ab71 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:40:58.823246 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c4201f-a70a-4814-865b-c4c057f8ab71 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:40:58.828129 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af110313-cbd1-4d9c-bf44-ac6476bb063a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:40:58.829002 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af110313-cbd1-4d9c-bf44-ac6476bb063a admin admin] REQUEST_METHOD: `PUT` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:40:58.829285 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af110313-cbd1-4d9c-bf44-ac6476bb063a admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:40:58.829563 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af110313-cbd1-4d9c-bf44-ac6476bb063a admin admin] PATH_INFO: `/v3/projects/2ef7f80fc40f420d987ce2ba1203edfb/users/02eb5846c660460196252921850562a9/roles/33a8e87420ed423f9cb29e0084eab5d2` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:40:58.843994 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af110313-cbd1-4d9c-bf44-ac6476bb063a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ef7f80fc40f420d987ce2ba1203edfb, user_id=02eb5846c660460196252921850562a9, role_id=33a8e87420ed423f9cb29e0084eab5d2)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:40:58.846633 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af110313-cbd1-4d9c-bf44-ac6476bb063a admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:40:58.859532 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1220/2452] 10.222.0.117 () {60 vars in 1487 bytes} [Tue Jan 25 02:40:58 2022] PUT /identity/v3/projects/2ef7f80fc40f420d987ce2ba1203edfb/users/02eb5846c660460196252921850562a9/roles/33a8e87420ed423f9cb29e0084eab5d2 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 25 02:40:58.871080 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b27b101-6388-4d1c-be90-12c48369dfd4 None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:40:58.871395 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b27b101-6388-4d1c-be90-12c48369dfd4 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:40:58.871674 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b27b101-6388-4d1c-be90-12c48369dfd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:40:58.899626 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-8b27b101-6388-4d1c-be90-12c48369dfd4 None None] MFA Rules not processed for user `02eb5846c660460196252921850562a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:40:58.900861 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-8b27b101-6388-4d1c-be90-12c48369dfd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:40:58.967861 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1233/2453] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:40:58 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 25 02:40:58.970068 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af110313-cbd1-4d9c-bf44-ac6476bb063a admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:40:59.034678 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af110313-cbd1-4d9c-bf44-ac6476bb063a admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:40:59.039970 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc02775-7d12-48ea-9cb4-533deac3483c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:40:59.040659 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc02775-7d12-48ea-9cb4-533deac3483c admin admin] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:40:59.040976 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc02775-7d12-48ea-9cb4-533deac3483c admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:40:59.041257 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc02775-7d12-48ea-9cb4-533deac3483c admin admin] PATH_INFO: `/v3/projects` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:40:59.041976 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc02775-7d12-48ea-9cb4-533deac3483c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:40:59.043937 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc02775-7d12-48ea-9cb4-533deac3483c admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:40:59.068970 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1221/2454] 10.222.0.117 () {60 vars in 1157 bytes} [Tue Jan 25 02:40:58 2022] POST /identity/v3/projects => generated 380 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 02:40:59.073114 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b27b101-6388-4d1c-be90-12c48369dfd4 None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:40:59.083645 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b27b101-6388-4d1c-be90-12c48369dfd4 None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:40:59.140868 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2088c7e6-2c46-4b56-9518-032d70cc0fb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:40:59.141541 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2088c7e6-2c46-4b56-9518-032d70cc0fb5 admin admin] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:40:59.141828 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2088c7e6-2c46-4b56-9518-032d70cc0fb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:40:59.142105 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2088c7e6-2c46-4b56-9518-032d70cc0fb5 admin admin] PATH_INFO: `/v3/users` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:40:59.142815 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2088c7e6-2c46-4b56-9518-032d70cc0fb5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:40:59.144798 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2088c7e6-2c46-4b56-9518-032d70cc0fb5 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:40:59.165788 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1234/2455] 10.222.0.117 () {60 vars in 1148 bytes} [Tue Jan 25 02:40:59 2022] POST /identity/v3/users => generated 297 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 25 02:40:59.169909 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc02775-7d12-48ea-9cb4-533deac3483c admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:40:59.180098 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc02775-7d12-48ea-9cb4-533deac3483c admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:40:59.184701 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b820c832-1914-48f7-9028-92ce0ca8a6e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:40:59.185352 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b820c832-1914-48f7-9028-92ce0ca8a6e2 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:40:59.185636 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b820c832-1914-48f7-9028-92ce0ca8a6e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:40:59.185910 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b820c832-1914-48f7-9028-92ce0ca8a6e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:40:59.186644 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b820c832-1914-48f7-9028-92ce0ca8a6e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:40:59.188268 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b820c832-1914-48f7-9028-92ce0ca8a6e2 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:40:59.198547 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1222/2456] 10.222.0.117 () {58 vars in 1126 bytes} [Tue Jan 25 02:40:59 2022] GET /identity/v3/roles => generated 1427 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 25 02:40:59.203094 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2088c7e6-2c46-4b56-9518-032d70cc0fb5 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:40:59.214345 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2088c7e6-2c46-4b56-9518-032d70cc0fb5 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:40:59.219014 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51d64f3-7fb7-4d57-b66a-389baa866246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:40:59.219861 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51d64f3-7fb7-4d57-b66a-389baa866246 admin admin] REQUEST_METHOD: `PUT` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:40:59.220142 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51d64f3-7fb7-4d57-b66a-389baa866246 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:40:59.220415 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51d64f3-7fb7-4d57-b66a-389baa866246 admin admin] PATH_INFO: `/v3/projects/6fc83554cf554dc9af9ae689baa3a077/users/ef9a429310da4a19bc60f183749dd06e/roles/d8dbc6d83d9d41d28c3feb8b3485b291` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:40:59.235733 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51d64f3-7fb7-4d57-b66a-389baa866246 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fc83554cf554dc9af9ae689baa3a077, user_id=ef9a429310da4a19bc60f183749dd06e, role_id=d8dbc6d83d9d41d28c3feb8b3485b291)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:40:59.238364 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51d64f3-7fb7-4d57-b66a-389baa866246 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:40:59.251029 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1235/2457] 10.222.0.117 () {60 vars in 1487 bytes} [Tue Jan 25 02:40:59 2022] PUT /identity/v3/projects/6fc83554cf554dc9af9ae689baa3a077/users/ef9a429310da4a19bc60f183749dd06e/roles/d8dbc6d83d9d41d28c3feb8b3485b291 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:40:59.254973 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b820c832-1914-48f7-9028-92ce0ca8a6e2 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:40:59.264835 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b820c832-1914-48f7-9028-92ce0ca8a6e2 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:40:59.325645 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39bf068-8457-46fa-b62c-4ad2ec1a4807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:40:59.326602 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39bf068-8457-46fa-b62c-4ad2ec1a4807 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:40:59.327017 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39bf068-8457-46fa-b62c-4ad2ec1a4807 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:40:59.327419 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39bf068-8457-46fa-b62c-4ad2ec1a4807 admin admin] PATH_INFO: `/v3/roles` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:40:59.328831 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39bf068-8457-46fa-b62c-4ad2ec1a4807 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:40:59.331328 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39bf068-8457-46fa-b62c-4ad2ec1a4807 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:40:59.344714 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1223/2458] 10.222.0.117 () {58 vars in 1126 bytes} [Tue Jan 25 02:40:59 2022] GET /identity/v3/roles => generated 1427 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 02:40:59.349028 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51d64f3-7fb7-4d57-b66a-389baa866246 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:40:59.361731 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51d64f3-7fb7-4d57-b66a-389baa866246 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:40:59.368077 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dfacb8-311f-441d-b769-ddfea4d6aada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:40:59.369500 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dfacb8-311f-441d-b769-ddfea4d6aada admin admin] REQUEST_METHOD: `PUT` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:40:59.369793 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dfacb8-311f-441d-b769-ddfea4d6aada admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:40:59.370076 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dfacb8-311f-441d-b769-ddfea4d6aada admin admin] PATH_INFO: `/v3/projects/6fc83554cf554dc9af9ae689baa3a077/users/ef9a429310da4a19bc60f183749dd06e/roles/d8dbc6d83d9d41d28c3feb8b3485b291` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:40:59.372198 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dfacb8-311f-441d-b769-ddfea4d6aada admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fc83554cf554dc9af9ae689baa3a077, user_id=ef9a429310da4a19bc60f183749dd06e, role_id=d8dbc6d83d9d41d28c3feb8b3485b291)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:40:59.376177 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dfacb8-311f-441d-b769-ddfea4d6aada admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:40:59.386730 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1236/2459] 10.222.0.117 () {60 vars in 1487 bytes} [Tue Jan 25 02:40:59 2022] PUT /identity/v3/projects/6fc83554cf554dc9af9ae689baa3a077/users/ef9a429310da4a19bc60f183749dd06e/roles/d8dbc6d83d9d41d28c3feb8b3485b291 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:40:59.397336 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d988604f-fdc5-4691-8b24-747b133714e5 None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:40:59.397813 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d988604f-fdc5-4691-8b24-747b133714e5 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:40:59.397909 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d988604f-fdc5-4691-8b24-747b133714e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:40:59.424809 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-d988604f-fdc5-4691-8b24-747b133714e5 None None] MFA Rules not processed for user `ef9a429310da4a19bc60f183749dd06e`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:40:59.426012 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-d988604f-fdc5-4691-8b24-747b133714e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:40:59.492146 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1224/2460] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:40:59 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:40:59.502790 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dfacb8-311f-441d-b769-ddfea4d6aada admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:40:59.504564 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-a2dfacb8-311f-441d-b769-ddfea4d6aada admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:40:59.560500 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dfacb8-311f-441d-b769-ddfea4d6aada admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:40:59.564324 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb925dfa-9432-4175-9d95-b1be1435ab18 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cc5249aea09430080e232cf17757f86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:40:59.564959 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb925dfa-9432-4175-9d95-b1be1435ab18 service cinder] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:40:59.565243 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb925dfa-9432-4175-9d95-b1be1435ab18 service cinder] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:40:59.565516 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb925dfa-9432-4175-9d95-b1be1435ab18 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:40:59.574832 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb925dfa-9432-4175-9d95-b1be1435ab18 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:40:59.576315 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb925dfa-9432-4175-9d95-b1be1435ab18 service cinder] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:40:59.586421 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1237/2461] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:40:59 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:40:59.876273 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d988604f-fdc5-4691-8b24-747b133714e5 None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:40:59.885474 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d988604f-fdc5-4691-8b24-747b133714e5 None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:40:59.890105 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f85556-4921-4a79-9cba-8a7f50f040fb tempest-VolumeQuotaClassesTest-255425916 tempest-VolumeQuotaClassesTest-255425916-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef9a429310da4a19bc60f183749dd06e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6fc83554cf554dc9af9ae689baa3a077', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:40:59.890754 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f85556-4921-4a79-9cba-8a7f50f040fb tempest-VolumeQuotaClassesTest-255425916 tempest-VolumeQuotaClassesTest-255425916-project-admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:40:59.891044 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f85556-4921-4a79-9cba-8a7f50f040fb tempest-VolumeQuotaClassesTest-255425916 tempest-VolumeQuotaClassesTest-255425916-project-admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:40:59.891328 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f85556-4921-4a79-9cba-8a7f50f040fb tempest-VolumeQuotaClassesTest-255425916 tempest-VolumeQuotaClassesTest-255425916-project-admin] PATH_INFO: `/v3/domains` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:40:59.892101 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f85556-4921-4a79-9cba-8a7f50f040fb tempest-VolumeQuotaClassesTest-255425916 tempest-VolumeQuotaClassesTest-255425916-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:40:59.892412 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f85556-4921-4a79-9cba-8a7f50f040fb tempest-VolumeQuotaClassesTest-255425916 tempest-VolumeQuotaClassesTest-255425916-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:40:59.894004 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f85556-4921-4a79-9cba-8a7f50f040fb tempest-VolumeQuotaClassesTest-255425916 tempest-VolumeQuotaClassesTest-255425916-project-admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:40:59.907495 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1225/2462] 10.222.0.117 () {58 vars in 1157 bytes} [Tue Jan 25 02:40:59 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:40:59.911015 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb925dfa-9432-4175-9d95-b1be1435ab18 service cinder] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:40:59.923373 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb925dfa-9432-4175-9d95-b1be1435ab18 service cinder] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:40:59.928565 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a4da40-f004-4a14-9406-5a60f9dce05c tempest-VolumeQuotaClassesTest-255425916 tempest-VolumeQuotaClassesTest-255425916-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef9a429310da4a19bc60f183749dd06e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6fc83554cf554dc9af9ae689baa3a077', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:40:59.929233 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a4da40-f004-4a14-9406-5a60f9dce05c tempest-VolumeQuotaClassesTest-255425916 tempest-VolumeQuotaClassesTest-255425916-project-admin] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:40:59.929525 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a4da40-f004-4a14-9406-5a60f9dce05c tempest-VolumeQuotaClassesTest-255425916 tempest-VolumeQuotaClassesTest-255425916-project-admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:40:59.929811 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a4da40-f004-4a14-9406-5a60f9dce05c tempest-VolumeQuotaClassesTest-255425916 tempest-VolumeQuotaClassesTest-255425916-project-admin] PATH_INFO: `/v3/projects` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:40:59.930525 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a4da40-f004-4a14-9406-5a60f9dce05c tempest-VolumeQuotaClassesTest-255425916 tempest-VolumeQuotaClassesTest-255425916-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:40:59.932477 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a4da40-f004-4a14-9406-5a60f9dce05c tempest-VolumeQuotaClassesTest-255425916 tempest-VolumeQuotaClassesTest-255425916-project-admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:40:59.958397 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1238/2463] 10.222.0.117 () {60 vars in 1157 bytes} [Tue Jan 25 02:40:59 2022] POST /identity/v3/projects => generated 356 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 02:40:59.963476 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f85556-4921-4a79-9cba-8a7f50f040fb tempest-VolumeQuotaClassesTest-255425916 tempest-VolumeQuotaClassesTest-255425916-project-admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:40:59.973218 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f85556-4921-4a79-9cba-8a7f50f040fb tempest-VolumeQuotaClassesTest-255425916 tempest-VolumeQuotaClassesTest-255425916-project-admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:41:00.028499 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b263dbdd-9669-4ba7-a8da-628c48752f7f tempest-VolumeQuotaClassesTest-255425916 tempest-VolumeQuotaClassesTest-255425916-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef9a429310da4a19bc60f183749dd06e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6fc83554cf554dc9af9ae689baa3a077', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:41:00.029155 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b263dbdd-9669-4ba7-a8da-628c48752f7f tempest-VolumeQuotaClassesTest-255425916 tempest-VolumeQuotaClassesTest-255425916-project-admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:41:00.029443 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b263dbdd-9669-4ba7-a8da-628c48752f7f tempest-VolumeQuotaClassesTest-255425916 tempest-VolumeQuotaClassesTest-255425916-project-admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:41:00.029723 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b263dbdd-9669-4ba7-a8da-628c48752f7f tempest-VolumeQuotaClassesTest-255425916 tempest-VolumeQuotaClassesTest-255425916-project-admin] PATH_INFO: `/v3/domains` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:41:00.030454 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b263dbdd-9669-4ba7-a8da-628c48752f7f tempest-VolumeQuotaClassesTest-255425916 tempest-VolumeQuotaClassesTest-255425916-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:41:00.030761 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b263dbdd-9669-4ba7-a8da-628c48752f7f tempest-VolumeQuotaClassesTest-255425916 tempest-VolumeQuotaClassesTest-255425916-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:41:00.032395 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b263dbdd-9669-4ba7-a8da-628c48752f7f tempest-VolumeQuotaClassesTest-255425916 tempest-VolumeQuotaClassesTest-255425916-project-admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:41:00.044178 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1226/2464] 10.222.0.117 () {58 vars in 1157 bytes} [Tue Jan 25 02:40:59 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:41:00.076744 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a4da40-f004-4a14-9406-5a60f9dce05c tempest-VolumeQuotaClassesTest-255425916 tempest-VolumeQuotaClassesTest-255425916-project-admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:41:00.087589 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a4da40-f004-4a14-9406-5a60f9dce05c tempest-VolumeQuotaClassesTest-255425916 tempest-VolumeQuotaClassesTest-255425916-project-admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:41:00.092337 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f073227b-078c-473b-9b46-386d48335509 tempest-VolumeQuotaClassesTest-255425916 tempest-VolumeQuotaClassesTest-255425916-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef9a429310da4a19bc60f183749dd06e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6fc83554cf554dc9af9ae689baa3a077', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:41:00.093119 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f073227b-078c-473b-9b46-386d48335509 tempest-VolumeQuotaClassesTest-255425916 tempest-VolumeQuotaClassesTest-255425916-project-admin] REQUEST_METHOD: `DELETE` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:41:00.093407 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f073227b-078c-473b-9b46-386d48335509 tempest-VolumeQuotaClassesTest-255425916 tempest-VolumeQuotaClassesTest-255425916-project-admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:41:00.093684 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f073227b-078c-473b-9b46-386d48335509 tempest-VolumeQuotaClassesTest-255425916 tempest-VolumeQuotaClassesTest-255425916-project-admin] PATH_INFO: `/v3/projects/8de0d1e52e8e4657a309ba9da3946e06` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:41:00.094973 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f073227b-078c-473b-9b46-386d48335509 tempest-VolumeQuotaClassesTest-255425916 tempest-VolumeQuotaClassesTest-255425916-project-admin] RBAC: Authorizing `identity:delete_project(project_id=8de0d1e52e8e4657a309ba9da3946e06)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:41:00.096947 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f073227b-078c-473b-9b46-386d48335509 tempest-VolumeQuotaClassesTest-255425916 tempest-VolumeQuotaClassesTest-255425916-project-admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:41:00.144458 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-f073227b-078c-473b-9b46-386d48335509 tempest-VolumeQuotaClassesTest-255425916 tempest-VolumeQuotaClassesTest-255425916-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8de0d1e52e8e4657a309ba9da3946e06', 'request_id': 'req-f073227b-078c-473b-9b46-386d48335509'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:41:00.151273 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-f073227b-078c-473b-9b46-386d48335509 tempest-VolumeQuotaClassesTest-255425916 tempest-VolumeQuotaClassesTest-255425916-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8de0d1e52e8e4657a309ba9da3946e06', 'request_id': 'req-f073227b-078c-473b-9b46-386d48335509'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:41:00.159323 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-f073227b-078c-473b-9b46-386d48335509 tempest-VolumeQuotaClassesTest-255425916 tempest-VolumeQuotaClassesTest-255425916-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8de0d1e52e8e4657a309ba9da3946e06', 'request_id': 'req-f073227b-078c-473b-9b46-386d48335509'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:41:00.171618 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-f073227b-078c-473b-9b46-386d48335509 tempest-VolumeQuotaClassesTest-255425916 tempest-VolumeQuotaClassesTest-255425916-project-admin] The token cache is being invalidate because project 8de0d1e52e8e4657a309ba9da3946e06 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79121) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 25 02:41:00.171946 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-f073227b-078c-473b-9b46-386d48335509 tempest-VolumeQuotaClassesTest-255425916 tempest-VolumeQuotaClassesTest-255425916-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:41:00.172579 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-f073227b-078c-473b-9b46-386d48335509 tempest-VolumeQuotaClassesTest-255425916 tempest-VolumeQuotaClassesTest-255425916-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:41:00.174136 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1239/2465] 10.222.0.117 () {58 vars in 1237 bytes} [Tue Jan 25 02:41:00 2022] DELETE /identity/v3/projects/8de0d1e52e8e4657a309ba9da3946e06 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:41:00.354082 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b263dbdd-9669-4ba7-a8da-628c48752f7f tempest-VolumeQuotaClassesTest-255425916 tempest-VolumeQuotaClassesTest-255425916-project-admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:41:00.355810 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-b263dbdd-9669-4ba7-a8da-628c48752f7f tempest-VolumeQuotaClassesTest-255425916 tempest-VolumeQuotaClassesTest-255425916-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:41:00.420262 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b263dbdd-9669-4ba7-a8da-628c48752f7f tempest-VolumeQuotaClassesTest-255425916 tempest-VolumeQuotaClassesTest-255425916-project-admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:41:00.474577 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fe22cf-3d6e-4199-99b7-75c053f132bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:41:00.475451 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fe22cf-3d6e-4199-99b7-75c053f132bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:41:00.475772 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fe22cf-3d6e-4199-99b7-75c053f132bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:41:00.476052 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fe22cf-3d6e-4199-99b7-75c053f132bf admin admin] PATH_INFO: `/v3/users/02eb5846c660460196252921850562a9` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:41:00.477309 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fe22cf-3d6e-4199-99b7-75c053f132bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=02eb5846c660460196252921850562a9)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:41:00.479228 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fe22cf-3d6e-4199-99b7-75c053f132bf admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:41:00.523111 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-34fe22cf-3d6e-4199-99b7-75c053f132bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02eb5846c660460196252921850562a9'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:41:00.529646 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-34fe22cf-3d6e-4199-99b7-75c053f132bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02eb5846c660460196252921850562a9'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:41:00.530385 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-34fe22cf-3d6e-4199-99b7-75c053f132bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02eb5846c660460196252921850562a9'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:41:00.531061 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-34fe22cf-3d6e-4199-99b7-75c053f132bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02eb5846c660460196252921850562a9'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:41:00.542542 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-34fe22cf-3d6e-4199-99b7-75c053f132bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02eb5846c660460196252921850562a9'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:41:00.554329 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1227/2466] 10.222.0.117 () {58 vars in 1228 bytes} [Tue Jan 25 02:41:00 2022] DELETE /identity/v3/users/02eb5846c660460196252921850562a9 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:41:00.559021 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c1c72f-2ef6-4992-abc8-4ca57bb67f88 None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:41:00.559517 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c1c72f-2ef6-4992-abc8-4ca57bb67f88 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:41:00.559683 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c1c72f-2ef6-4992-abc8-4ca57bb67f88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:41:00.577045 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-c5c1c72f-2ef6-4992-abc8-4ca57bb67f88 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:41:00.578506 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-c5c1c72f-2ef6-4992-abc8-4ca57bb67f88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:41:00.635497 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1240/2467] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:41:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 25 02:41:00.645034 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fe22cf-3d6e-4199-99b7-75c053f132bf admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:41:00.647032 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-34fe22cf-3d6e-4199-99b7-75c053f132bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:41:00.704659 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fe22cf-3d6e-4199-99b7-75c053f132bf admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:41:00.708467 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aeeb49d-674f-45d8-9b9f-fde7debe9e17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca4071c5f8f4a31b5edb81fa66a43a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:41:00.709685 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeeb49d-674f-45d8-9b9f-fde7debe9e17 service neutron] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:41:00.709984 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeeb49d-674f-45d8-9b9f-fde7debe9e17 service neutron] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:41:00.710284 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeeb49d-674f-45d8-9b9f-fde7debe9e17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:41:00.719332 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aeeb49d-674f-45d8-9b9f-fde7debe9e17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:41:00.720839 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aeeb49d-674f-45d8-9b9f-fde7debe9e17 service neutron] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:41:00.730712 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1228/2468] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:41:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:41:00.992133 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c1c72f-2ef6-4992-abc8-4ca57bb67f88 None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:41:00.993628 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-c5c1c72f-2ef6-4992-abc8-4ca57bb67f88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:41:01.005998 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c1c72f-2ef6-4992-abc8-4ca57bb67f88 None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:41:01.011524 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9f0de4-b76d-4595-9d7f-816b365853e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:41:01.012504 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9f0de4-b76d-4595-9d7f-816b365853e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:41:01.012796 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9f0de4-b76d-4595-9d7f-816b365853e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:41:01.013105 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9f0de4-b76d-4595-9d7f-816b365853e2 admin admin] PATH_INFO: `/v3/projects/2ef7f80fc40f420d987ce2ba1203edfb` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:41:01.015244 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9f0de4-b76d-4595-9d7f-816b365853e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ef7f80fc40f420d987ce2ba1203edfb)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:41:01.017706 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9f0de4-b76d-4595-9d7f-816b365853e2 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:41:01.064312 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-bc9f0de4-b76d-4595-9d7f-816b365853e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ef7f80fc40f420d987ce2ba1203edfb', 'request_id': 'req-bc9f0de4-b76d-4595-9d7f-816b365853e2'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:41:01.070379 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-bc9f0de4-b76d-4595-9d7f-816b365853e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ef7f80fc40f420d987ce2ba1203edfb', 'request_id': 'req-bc9f0de4-b76d-4595-9d7f-816b365853e2'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:41:01.077320 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-bc9f0de4-b76d-4595-9d7f-816b365853e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ef7f80fc40f420d987ce2ba1203edfb', 'request_id': 'req-bc9f0de4-b76d-4595-9d7f-816b365853e2'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:41:01.089038 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-bc9f0de4-b76d-4595-9d7f-816b365853e2 admin admin] The token cache is being invalidate because project 2ef7f80fc40f420d987ce2ba1203edfb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79121) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 25 02:41:01.089328 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-bc9f0de4-b76d-4595-9d7f-816b365853e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:41:01.089988 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-bc9f0de4-b76d-4595-9d7f-816b365853e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:41:01.091517 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1241/2469] 10.222.0.117 () {58 vars in 1237 bytes} [Tue Jan 25 02:41:00 2022] DELETE /identity/v3/projects/2ef7f80fc40f420d987ce2ba1203edfb => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:41:01.095507 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aeeb49d-674f-45d8-9b9f-fde7debe9e17 service neutron] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:41:01.105354 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aeeb49d-674f-45d8-9b9f-fde7debe9e17 service neutron] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:41:01.164047 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85255086-943d-4b0f-bc6c-811edaad879e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:41:01.165100 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85255086-943d-4b0f-bc6c-811edaad879e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:41:01.165658 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85255086-943d-4b0f-bc6c-811edaad879e admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:41:01.165996 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85255086-943d-4b0f-bc6c-811edaad879e admin admin] PATH_INFO: `/v3/users/ef9a429310da4a19bc60f183749dd06e` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:41:01.167341 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85255086-943d-4b0f-bc6c-811edaad879e admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef9a429310da4a19bc60f183749dd06e)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:41:01.169482 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85255086-943d-4b0f-bc6c-811edaad879e admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:41:01.215352 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-85255086-943d-4b0f-bc6c-811edaad879e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef9a429310da4a19bc60f183749dd06e'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:41:01.222765 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-85255086-943d-4b0f-bc6c-811edaad879e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef9a429310da4a19bc60f183749dd06e'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:41:01.223356 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-85255086-943d-4b0f-bc6c-811edaad879e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef9a429310da4a19bc60f183749dd06e'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:41:01.223990 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-85255086-943d-4b0f-bc6c-811edaad879e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef9a429310da4a19bc60f183749dd06e'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:41:01.235887 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-85255086-943d-4b0f-bc6c-811edaad879e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef9a429310da4a19bc60f183749dd06e'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:41:01.250273 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1229/2470] 10.222.0.117 () {58 vars in 1228 bytes} [Tue Jan 25 02:41:01 2022] DELETE /identity/v3/users/ef9a429310da4a19bc60f183749dd06e => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:41:01.517047 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9f0de4-b76d-4595-9d7f-816b365853e2 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:41:01.518935 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-bc9f0de4-b76d-4595-9d7f-816b365853e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:41:01.532613 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9f0de4-b76d-4595-9d7f-816b365853e2 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:41:01.589628 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acbc69f-88b2-4a66-90cf-8b569212b60f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:41:01.590542 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acbc69f-88b2-4a66-90cf-8b569212b60f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:41:01.590827 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acbc69f-88b2-4a66-90cf-8b569212b60f admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:41:01.591106 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acbc69f-88b2-4a66-90cf-8b569212b60f admin admin] PATH_INFO: `/v3/projects/6fc83554cf554dc9af9ae689baa3a077` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:41:01.592339 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acbc69f-88b2-4a66-90cf-8b569212b60f admin admin] RBAC: Authorizing `identity:delete_project(project_id=6fc83554cf554dc9af9ae689baa3a077)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:41:01.594250 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acbc69f-88b2-4a66-90cf-8b569212b60f admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:41:01.643934 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-2acbc69f-88b2-4a66-90cf-8b569212b60f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6fc83554cf554dc9af9ae689baa3a077', 'request_id': 'req-2acbc69f-88b2-4a66-90cf-8b569212b60f'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:41:01.649224 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-2acbc69f-88b2-4a66-90cf-8b569212b60f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6fc83554cf554dc9af9ae689baa3a077', 'request_id': 'req-2acbc69f-88b2-4a66-90cf-8b569212b60f'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:41:01.656200 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-2acbc69f-88b2-4a66-90cf-8b569212b60f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6fc83554cf554dc9af9ae689baa3a077', 'request_id': 'req-2acbc69f-88b2-4a66-90cf-8b569212b60f'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:41:01.667443 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-2acbc69f-88b2-4a66-90cf-8b569212b60f admin admin] The token cache is being invalidate because project 6fc83554cf554dc9af9ae689baa3a077 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79121) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 25 02:41:01.667757 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-2acbc69f-88b2-4a66-90cf-8b569212b60f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:41:01.668382 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-2acbc69f-88b2-4a66-90cf-8b569212b60f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:41:01.669907 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1242/2471] 10.222.0.117 () {58 vars in 1237 bytes} [Tue Jan 25 02:41:01 2022] DELETE /identity/v3/projects/6fc83554cf554dc9af9ae689baa3a077 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 25 02:41:01.675929 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fef370a-d76a-474a-baae-5da3bb8c8261 None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:41:01.676404 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fef370a-d76a-474a-baae-5da3bb8c8261 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:41:01.676501 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fef370a-d76a-474a-baae-5da3bb8c8261 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:41:01.696189 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-2fef370a-d76a-474a-baae-5da3bb8c8261 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:41:01.697315 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-2fef370a-d76a-474a-baae-5da3bb8c8261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:41:01.754204 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1230/2472] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:41:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:41:01.762931 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785fc25d-02de-40df-8af6-15ba6bef8c3a None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:41:01.763222 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785fc25d-02de-40df-8af6-15ba6bef8c3a None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:41:01.763501 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785fc25d-02de-40df-8af6-15ba6bef8c3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:41:01.781429 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-785fc25d-02de-40df-8af6-15ba6bef8c3a None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:41:01.782611 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-785fc25d-02de-40df-8af6-15ba6bef8c3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:41:01.790995 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1243/2473] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:41:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:41:01.795162 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fef370a-d76a-474a-baae-5da3bb8c8261 None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:41:01.805145 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fef370a-d76a-474a-baae-5da3bb8c8261 None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:41:01.809784 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8802db1b-324e-48e7-909f-a250f6773b92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:41:01.810446 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8802db1b-324e-48e7-909f-a250f6773b92 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:41:01.810730 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8802db1b-324e-48e7-909f-a250f6773b92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:41:01.811001 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8802db1b-324e-48e7-909f-a250f6773b92 admin admin] PATH_INFO: `/v3/domains` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:41:01.811767 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8802db1b-324e-48e7-909f-a250f6773b92 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:41:01.812075 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8802db1b-324e-48e7-909f-a250f6773b92 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:41:01.813686 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8802db1b-324e-48e7-909f-a250f6773b92 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:41:01.824978 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1231/2474] 10.222.0.117 () {58 vars in 1157 bytes} [Tue Jan 25 02:41:01 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:41:01.829337 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785fc25d-02de-40df-8af6-15ba6bef8c3a None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:41:01.838613 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785fc25d-02de-40df-8af6-15ba6bef8c3a None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:41:01.843805 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13213550-2381-40a7-84eb-db04bf68ce87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:41:01.844447 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13213550-2381-40a7-84eb-db04bf68ce87 admin admin] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:41:01.844730 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13213550-2381-40a7-84eb-db04bf68ce87 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:41:01.845005 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13213550-2381-40a7-84eb-db04bf68ce87 admin admin] PATH_INFO: `/v3/projects` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:41:01.845701 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13213550-2381-40a7-84eb-db04bf68ce87 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:41:01.847610 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13213550-2381-40a7-84eb-db04bf68ce87 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:41:01.873103 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1244/2475] 10.222.0.117 () {60 vars in 1157 bytes} [Tue Jan 25 02:41:01 2022] POST /identity/v3/projects => generated 394 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 25 02:41:01.877227 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8802db1b-324e-48e7-909f-a250f6773b92 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:41:01.887427 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8802db1b-324e-48e7-909f-a250f6773b92 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:41:01.945455 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c413e314-24a1-4651-89eb-e1d7c37cd038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:41:01.946118 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c413e314-24a1-4651-89eb-e1d7c37cd038 admin admin] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:41:01.946470 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c413e314-24a1-4651-89eb-e1d7c37cd038 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:41:01.946674 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c413e314-24a1-4651-89eb-e1d7c37cd038 admin admin] PATH_INFO: `/v3/users` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:41:01.947387 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c413e314-24a1-4651-89eb-e1d7c37cd038 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:41:01.950643 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c413e314-24a1-4651-89eb-e1d7c37cd038 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:41:01.974415 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1232/2476] 10.222.0.117 () {60 vars in 1148 bytes} [Tue Jan 25 02:41:01 2022] POST /identity/v3/users => generated 298 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 25 02:41:01.979420 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13213550-2381-40a7-84eb-db04bf68ce87 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:41:01.989928 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13213550-2381-40a7-84eb-db04bf68ce87 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:41:01.995380 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33afec59-b014-408d-a3f3-398c132dd629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:41:01.996075 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33afec59-b014-408d-a3f3-398c132dd629 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:41:01.996365 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33afec59-b014-408d-a3f3-398c132dd629 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:41:01.996647 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33afec59-b014-408d-a3f3-398c132dd629 admin admin] PATH_INFO: `/v3/roles` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:41:01.997422 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33afec59-b014-408d-a3f3-398c132dd629 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:41:01.999041 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33afec59-b014-408d-a3f3-398c132dd629 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:41:02.011129 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1245/2477] 10.222.0.117 () {58 vars in 1126 bytes} [Tue Jan 25 02:41:01 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 25 02:41:02.015343 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c413e314-24a1-4651-89eb-e1d7c37cd038 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:41:02.025377 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c413e314-24a1-4651-89eb-e1d7c37cd038 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:41:02.029915 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f57aec2-fa9a-44a9-9b6d-abaa1c74d421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:41:02.030569 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f57aec2-fa9a-44a9-9b6d-abaa1c74d421 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:41:02.030853 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f57aec2-fa9a-44a9-9b6d-abaa1c74d421 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:41:02.031131 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f57aec2-fa9a-44a9-9b6d-abaa1c74d421 admin admin] PATH_INFO: `/v3/roles` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:41:02.031913 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f57aec2-fa9a-44a9-9b6d-abaa1c74d421 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:41:02.033503 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f57aec2-fa9a-44a9-9b6d-abaa1c74d421 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:41:02.043597 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1233/2478] 10.222.0.117 () {58 vars in 1126 bytes} [Tue Jan 25 02:41:02 2022] GET /identity/v3/roles => generated 1427 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 02:41:02.047683 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33afec59-b014-408d-a3f3-398c132dd629 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:41:02.058066 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33afec59-b014-408d-a3f3-398c132dd629 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:41:02.062925 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8095873-a85c-4d03-9d3a-231a51e5191e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:41:02.063829 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8095873-a85c-4d03-9d3a-231a51e5191e admin admin] REQUEST_METHOD: `PUT` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:41:02.064109 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8095873-a85c-4d03-9d3a-231a51e5191e admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:41:02.064381 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8095873-a85c-4d03-9d3a-231a51e5191e admin admin] PATH_INFO: `/v3/projects/51381e5dbee34264bb4be454cb3e0607/users/5bd8a4a5fc3c4f1aa8cfb8a30adf24d7/roles/33a8e87420ed423f9cb29e0084eab5d2` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:41:02.079011 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8095873-a85c-4d03-9d3a-231a51e5191e admin admin] RBAC: Authorizing `identity:create_grant(project_id=51381e5dbee34264bb4be454cb3e0607, user_id=5bd8a4a5fc3c4f1aa8cfb8a30adf24d7, role_id=33a8e87420ed423f9cb29e0084eab5d2)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:41:02.081680 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8095873-a85c-4d03-9d3a-231a51e5191e admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:41:02.094470 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1246/2479] 10.222.0.117 () {60 vars in 1487 bytes} [Tue Jan 25 02:41:02 2022] PUT /identity/v3/projects/51381e5dbee34264bb4be454cb3e0607/users/5bd8a4a5fc3c4f1aa8cfb8a30adf24d7/roles/33a8e87420ed423f9cb29e0084eab5d2 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:41:02.106261 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd3957c-1a0a-4fda-804c-eba2d1990ad6 None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:41:02.106549 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd3957c-1a0a-4fda-804c-eba2d1990ad6 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:41:02.106823 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd3957c-1a0a-4fda-804c-eba2d1990ad6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:41:02.133498 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-bcd3957c-1a0a-4fda-804c-eba2d1990ad6 None None] MFA Rules not processed for user `5bd8a4a5fc3c4f1aa8cfb8a30adf24d7`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:41:02.134739 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-bcd3957c-1a0a-4fda-804c-eba2d1990ad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:41:02.195659 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1234/2480] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:41:02 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:41:02.200136 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8095873-a85c-4d03-9d3a-231a51e5191e admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:41:02.262330 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8095873-a85c-4d03-9d3a-231a51e5191e admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:41:02.267005 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93c56f8-11d1-47a2-b238-4491df1a9dcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:41:02.267654 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93c56f8-11d1-47a2-b238-4491df1a9dcd admin admin] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:41:02.267969 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93c56f8-11d1-47a2-b238-4491df1a9dcd admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:41:02.268248 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93c56f8-11d1-47a2-b238-4491df1a9dcd admin admin] PATH_INFO: `/v3/projects` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:41:02.268948 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93c56f8-11d1-47a2-b238-4491df1a9dcd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:41:02.270857 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93c56f8-11d1-47a2-b238-4491df1a9dcd admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:41:02.296186 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1247/2481] 10.222.0.117 () {60 vars in 1157 bytes} [Tue Jan 25 02:41:02 2022] POST /identity/v3/projects => generated 394 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 02:41:02.300236 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd3957c-1a0a-4fda-804c-eba2d1990ad6 None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:41:02.310714 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd3957c-1a0a-4fda-804c-eba2d1990ad6 None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:41:02.367144 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35f5769-d74f-4410-b679-aa7a374c6fde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:41:02.367936 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35f5769-d74f-4410-b679-aa7a374c6fde admin admin] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:41:02.368219 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35f5769-d74f-4410-b679-aa7a374c6fde admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:41:02.368489 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35f5769-d74f-4410-b679-aa7a374c6fde admin admin] PATH_INFO: `/v3/users` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:41:02.369184 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35f5769-d74f-4410-b679-aa7a374c6fde admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:41:02.371090 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35f5769-d74f-4410-b679-aa7a374c6fde admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:41:02.391248 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1235/2482] 10.222.0.117 () {60 vars in 1148 bytes} [Tue Jan 25 02:41:02 2022] POST /identity/v3/users => generated 304 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 02:41:02.395195 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93c56f8-11d1-47a2-b238-4491df1a9dcd admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:41:02.406058 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93c56f8-11d1-47a2-b238-4491df1a9dcd admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:41:02.410893 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308e2db0-5ef4-4cd9-81df-d9a9edcc54df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:41:02.411547 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308e2db0-5ef4-4cd9-81df-d9a9edcc54df admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:41:02.411864 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308e2db0-5ef4-4cd9-81df-d9a9edcc54df admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:41:02.412139 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308e2db0-5ef4-4cd9-81df-d9a9edcc54df admin admin] PATH_INFO: `/v3/roles` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:41:02.413998 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308e2db0-5ef4-4cd9-81df-d9a9edcc54df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:41:02.415635 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308e2db0-5ef4-4cd9-81df-d9a9edcc54df admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:41:02.425887 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1248/2483] 10.222.0.117 () {58 vars in 1126 bytes} [Tue Jan 25 02:41:02 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 02:41:02.430379 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35f5769-d74f-4410-b679-aa7a374c6fde admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:41:02.440130 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35f5769-d74f-4410-b679-aa7a374c6fde admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:41:02.445039 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca52803-a073-4fb7-8083-9e46cd35d0a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:41:02.445915 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca52803-a073-4fb7-8083-9e46cd35d0a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:41:02.446200 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca52803-a073-4fb7-8083-9e46cd35d0a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:41:02.446475 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca52803-a073-4fb7-8083-9e46cd35d0a5 admin admin] PATH_INFO: `/v3/projects/5e1dba932ed24648bb3a2d55a6198d3d/users/e0b0bf724f6e4f1b9e19dfdf11346cbe/roles/d8dbc6d83d9d41d28c3feb8b3485b291` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:41:02.462772 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca52803-a073-4fb7-8083-9e46cd35d0a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e1dba932ed24648bb3a2d55a6198d3d, user_id=e0b0bf724f6e4f1b9e19dfdf11346cbe, role_id=d8dbc6d83d9d41d28c3feb8b3485b291)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:41:02.465439 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca52803-a073-4fb7-8083-9e46cd35d0a5 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:41:02.478937 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1236/2484] 10.222.0.117 () {60 vars in 1487 bytes} [Tue Jan 25 02:41:02 2022] PUT /identity/v3/projects/5e1dba932ed24648bb3a2d55a6198d3d/users/e0b0bf724f6e4f1b9e19dfdf11346cbe/roles/d8dbc6d83d9d41d28c3feb8b3485b291 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:41:02.482876 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308e2db0-5ef4-4cd9-81df-d9a9edcc54df admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:41:02.493346 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308e2db0-5ef4-4cd9-81df-d9a9edcc54df admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:41:02.548680 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3cfab8-94f6-4528-af15-b46cec31a6ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:41:02.549341 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3cfab8-94f6-4528-af15-b46cec31a6ba admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:41:02.549628 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3cfab8-94f6-4528-af15-b46cec31a6ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:41:02.549908 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3cfab8-94f6-4528-af15-b46cec31a6ba admin admin] PATH_INFO: `/v3/roles` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:41:02.550640 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3cfab8-94f6-4528-af15-b46cec31a6ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:41:02.552278 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3cfab8-94f6-4528-af15-b46cec31a6ba admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:41:02.561936 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1249/2485] 10.222.0.117 () {58 vars in 1126 bytes} [Tue Jan 25 02:41:02 2022] GET /identity/v3/roles => generated 1427 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 02:41:02.566142 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca52803-a073-4fb7-8083-9e46cd35d0a5 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:41:02.577212 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca52803-a073-4fb7-8083-9e46cd35d0a5 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:41:02.581972 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e999a05-c834-49bd-859b-e3388cf0cc89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:41:02.582834 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e999a05-c834-49bd-859b-e3388cf0cc89 admin admin] REQUEST_METHOD: `PUT` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:41:02.583112 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e999a05-c834-49bd-859b-e3388cf0cc89 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:41:02.583381 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e999a05-c834-49bd-859b-e3388cf0cc89 admin admin] PATH_INFO: `/v3/projects/5e1dba932ed24648bb3a2d55a6198d3d/users/e0b0bf724f6e4f1b9e19dfdf11346cbe/roles/d8dbc6d83d9d41d28c3feb8b3485b291` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:41:02.586342 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e999a05-c834-49bd-859b-e3388cf0cc89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e1dba932ed24648bb3a2d55a6198d3d, user_id=e0b0bf724f6e4f1b9e19dfdf11346cbe, role_id=d8dbc6d83d9d41d28c3feb8b3485b291)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:41:02.588997 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e999a05-c834-49bd-859b-e3388cf0cc89 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:41:02.599191 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1237/2486] 10.222.0.117 () {60 vars in 1487 bytes} [Tue Jan 25 02:41:02 2022] PUT /identity/v3/projects/5e1dba932ed24648bb3a2d55a6198d3d/users/e0b0bf724f6e4f1b9e19dfdf11346cbe/roles/d8dbc6d83d9d41d28c3feb8b3485b291 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:41:02.609620 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a003b895-100f-4a24-a57d-a79b13923dfe None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:41:02.610123 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a003b895-100f-4a24-a57d-a79b13923dfe None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:41:02.610221 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a003b895-100f-4a24-a57d-a79b13923dfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:41:02.636668 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-a003b895-100f-4a24-a57d-a79b13923dfe None None] MFA Rules not processed for user `e0b0bf724f6e4f1b9e19dfdf11346cbe`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:41:02.637870 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-a003b895-100f-4a24-a57d-a79b13923dfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:41:02.703474 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1250/2487] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:41:02 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:41:02.713705 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e999a05-c834-49bd-859b-e3388cf0cc89 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:41:02.715401 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-9e999a05-c834-49bd-859b-e3388cf0cc89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:41:02.770499 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e999a05-c834-49bd-859b-e3388cf0cc89 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:41:02.775031 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e090a02c-d4b1-480f-a5b5-6461d9ab8c06 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cc5249aea09430080e232cf17757f86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:41:02.775678 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e090a02c-d4b1-480f-a5b5-6461d9ab8c06 service cinder] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:41:02.775971 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e090a02c-d4b1-480f-a5b5-6461d9ab8c06 service cinder] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:41:02.776243 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e090a02c-d4b1-480f-a5b5-6461d9ab8c06 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:41:02.784913 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e090a02c-d4b1-480f-a5b5-6461d9ab8c06 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:41:02.786327 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e090a02c-d4b1-480f-a5b5-6461d9ab8c06 service cinder] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:41:02.796625 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1238/2488] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:41:02 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:41:02.838240 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a003b895-100f-4a24-a57d-a79b13923dfe None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:41:02.839755 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-a003b895-100f-4a24-a57d-a79b13923dfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:41:02.852132 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a003b895-100f-4a24-a57d-a79b13923dfe None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:41:02.855806 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7527696e-6431-48c3-b7d7-a7ee68779dbc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cc5249aea09430080e232cf17757f86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:41:02.856449 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7527696e-6431-48c3-b7d7-a7ee68779dbc service cinder] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:41:02.856735 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7527696e-6431-48c3-b7d7-a7ee68779dbc service cinder] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:41:02.857015 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7527696e-6431-48c3-b7d7-a7ee68779dbc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:41:02.914003 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7527696e-6431-48c3-b7d7-a7ee68779dbc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:41:02.915453 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7527696e-6431-48c3-b7d7-a7ee68779dbc service cinder] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:41:02.924211 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1251/2489] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:41:02 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:41:06.087606 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e090a02c-d4b1-480f-a5b5-6461d9ab8c06 service cinder] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:41:06.147847 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e090a02c-d4b1-480f-a5b5-6461d9ab8c06 service cinder] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:41:06.152488 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c36368-01b7-472f-a687-ecc1b93d4e82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:41:06.153345 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c36368-01b7-472f-a687-ecc1b93d4e82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:41:06.153626 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c36368-01b7-472f-a687-ecc1b93d4e82 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:41:06.153901 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c36368-01b7-472f-a687-ecc1b93d4e82 admin admin] PATH_INFO: `/v3/users/5bd8a4a5fc3c4f1aa8cfb8a30adf24d7` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:41:06.155091 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c36368-01b7-472f-a687-ecc1b93d4e82 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5bd8a4a5fc3c4f1aa8cfb8a30adf24d7)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:41:06.157064 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c36368-01b7-472f-a687-ecc1b93d4e82 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:41:06.201683 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-f5c36368-01b7-472f-a687-ecc1b93d4e82 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5bd8a4a5fc3c4f1aa8cfb8a30adf24d7'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:41:06.209116 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-f5c36368-01b7-472f-a687-ecc1b93d4e82 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5bd8a4a5fc3c4f1aa8cfb8a30adf24d7'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:41:06.210058 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-f5c36368-01b7-472f-a687-ecc1b93d4e82 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5bd8a4a5fc3c4f1aa8cfb8a30adf24d7'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:41:06.210670 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-f5c36368-01b7-472f-a687-ecc1b93d4e82 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5bd8a4a5fc3c4f1aa8cfb8a30adf24d7'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:41:06.222530 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-f5c36368-01b7-472f-a687-ecc1b93d4e82 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5bd8a4a5fc3c4f1aa8cfb8a30adf24d7'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:41:06.234640 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1239/2490] 10.222.0.117 () {58 vars in 1228 bytes} [Tue Jan 25 02:41:06 2022] DELETE /identity/v3/users/5bd8a4a5fc3c4f1aa8cfb8a30adf24d7 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:41:06.239295 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae99bd9-9bbb-49a4-bdf8-6ec5c5280c08 None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:41:06.239778 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae99bd9-9bbb-49a4-bdf8-6ec5c5280c08 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:41:06.239877 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae99bd9-9bbb-49a4-bdf8-6ec5c5280c08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:41:06.258272 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-6ae99bd9-9bbb-49a4-bdf8-6ec5c5280c08 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:41:06.259826 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-6ae99bd9-9bbb-49a4-bdf8-6ec5c5280c08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:41:06.318586 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1252/2491] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:41:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:41:06.329801 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c36368-01b7-472f-a687-ecc1b93d4e82 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:41:06.331225 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-f5c36368-01b7-472f-a687-ecc1b93d4e82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:41:06.388201 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c36368-01b7-472f-a687-ecc1b93d4e82 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:41:06.391845 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e0e160-8129-450b-a9a7-54d08101c46d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca4071c5f8f4a31b5edb81fa66a43a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:41:06.392484 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e0e160-8129-450b-a9a7-54d08101c46d service neutron] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:41:06.392768 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e0e160-8129-450b-a9a7-54d08101c46d service neutron] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:41:06.393045 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e0e160-8129-450b-a9a7-54d08101c46d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:41:06.401845 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e0e160-8129-450b-a9a7-54d08101c46d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:41:06.403280 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e0e160-8129-450b-a9a7-54d08101c46d service neutron] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:41:06.412420 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1240/2492] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:41:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 25 02:41:06.667632 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae99bd9-9bbb-49a4-bdf8-6ec5c5280c08 None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:41:06.669102 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-6ae99bd9-9bbb-49a4-bdf8-6ec5c5280c08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:41:06.681180 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae99bd9-9bbb-49a4-bdf8-6ec5c5280c08 None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:41:06.686397 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae1c039-9aa2-40a9-99b9-bf937fd3c202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:41:06.687266 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae1c039-9aa2-40a9-99b9-bf937fd3c202 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:41:06.687554 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae1c039-9aa2-40a9-99b9-bf937fd3c202 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:41:06.687877 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae1c039-9aa2-40a9-99b9-bf937fd3c202 admin admin] PATH_INFO: `/v3/projects/51381e5dbee34264bb4be454cb3e0607` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:41:06.689086 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae1c039-9aa2-40a9-99b9-bf937fd3c202 admin admin] RBAC: Authorizing `identity:delete_project(project_id=51381e5dbee34264bb4be454cb3e0607)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:41:06.691010 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae1c039-9aa2-40a9-99b9-bf937fd3c202 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:41:06.738111 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-6ae1c039-9aa2-40a9-99b9-bf937fd3c202 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51381e5dbee34264bb4be454cb3e0607', 'request_id': 'req-6ae1c039-9aa2-40a9-99b9-bf937fd3c202'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:41:06.743626 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-6ae1c039-9aa2-40a9-99b9-bf937fd3c202 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51381e5dbee34264bb4be454cb3e0607', 'request_id': 'req-6ae1c039-9aa2-40a9-99b9-bf937fd3c202'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:41:06.750762 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-6ae1c039-9aa2-40a9-99b9-bf937fd3c202 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51381e5dbee34264bb4be454cb3e0607', 'request_id': 'req-6ae1c039-9aa2-40a9-99b9-bf937fd3c202'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:41:06.761632 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-6ae1c039-9aa2-40a9-99b9-bf937fd3c202 admin admin] The token cache is being invalidate because project 51381e5dbee34264bb4be454cb3e0607 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79121) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 25 02:41:06.761915 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-6ae1c039-9aa2-40a9-99b9-bf937fd3c202 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:41:06.762540 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-6ae1c039-9aa2-40a9-99b9-bf937fd3c202 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:41:06.764145 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1253/2493] 10.222.0.117 () {58 vars in 1237 bytes} [Tue Jan 25 02:41:06 2022] DELETE /identity/v3/projects/51381e5dbee34264bb4be454cb3e0607 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:41:06.768067 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e0e160-8129-450b-a9a7-54d08101c46d service neutron] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:41:06.778107 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e0e160-8129-450b-a9a7-54d08101c46d service neutron] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:41:06.833393 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aba341e-e17b-43ee-b4f0-6d8fe649fa7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:41:06.834268 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aba341e-e17b-43ee-b4f0-6d8fe649fa7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:41:06.835139 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aba341e-e17b-43ee-b4f0-6d8fe649fa7a admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:41:06.835417 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aba341e-e17b-43ee-b4f0-6d8fe649fa7a admin admin] PATH_INFO: `/v3/users/e0b0bf724f6e4f1b9e19dfdf11346cbe` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:41:06.836660 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aba341e-e17b-43ee-b4f0-6d8fe649fa7a admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0b0bf724f6e4f1b9e19dfdf11346cbe)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:41:06.838605 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aba341e-e17b-43ee-b4f0-6d8fe649fa7a admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:41:06.881966 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-3aba341e-e17b-43ee-b4f0-6d8fe649fa7a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0b0bf724f6e4f1b9e19dfdf11346cbe'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:41:06.888410 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-3aba341e-e17b-43ee-b4f0-6d8fe649fa7a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0b0bf724f6e4f1b9e19dfdf11346cbe'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:41:06.889087 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-3aba341e-e17b-43ee-b4f0-6d8fe649fa7a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0b0bf724f6e4f1b9e19dfdf11346cbe'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:41:06.889724 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-3aba341e-e17b-43ee-b4f0-6d8fe649fa7a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0b0bf724f6e4f1b9e19dfdf11346cbe'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:41:06.902089 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-3aba341e-e17b-43ee-b4f0-6d8fe649fa7a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0b0bf724f6e4f1b9e19dfdf11346cbe'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:41:06.914405 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1241/2494] 10.222.0.117 () {58 vars in 1228 bytes} [Tue Jan 25 02:41:06 2022] DELETE /identity/v3/users/e0b0bf724f6e4f1b9e19dfdf11346cbe => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:41:07.175515 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae1c039-9aa2-40a9-99b9-bf937fd3c202 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:41:07.176967 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-6ae1c039-9aa2-40a9-99b9-bf937fd3c202 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:41:07.190466 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae1c039-9aa2-40a9-99b9-bf937fd3c202 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:41:07.248385 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334332ac-baa3-4cda-b7a0-e34b9c089dd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:41:07.249240 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334332ac-baa3-4cda-b7a0-e34b9c089dd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:41:07.249527 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334332ac-baa3-4cda-b7a0-e34b9c089dd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:41:07.249807 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334332ac-baa3-4cda-b7a0-e34b9c089dd7 admin admin] PATH_INFO: `/v3/projects/5e1dba932ed24648bb3a2d55a6198d3d` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:41:07.250999 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334332ac-baa3-4cda-b7a0-e34b9c089dd7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e1dba932ed24648bb3a2d55a6198d3d)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:41:07.253025 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334332ac-baa3-4cda-b7a0-e34b9c089dd7 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:41:07.297517 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-334332ac-baa3-4cda-b7a0-e34b9c089dd7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e1dba932ed24648bb3a2d55a6198d3d', 'request_id': 'req-334332ac-baa3-4cda-b7a0-e34b9c089dd7'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:41:07.302691 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-334332ac-baa3-4cda-b7a0-e34b9c089dd7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e1dba932ed24648bb3a2d55a6198d3d', 'request_id': 'req-334332ac-baa3-4cda-b7a0-e34b9c089dd7'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:41:07.310159 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-334332ac-baa3-4cda-b7a0-e34b9c089dd7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e1dba932ed24648bb3a2d55a6198d3d', 'request_id': 'req-334332ac-baa3-4cda-b7a0-e34b9c089dd7'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:41:07.321164 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-334332ac-baa3-4cda-b7a0-e34b9c089dd7 admin admin] The token cache is being invalidate because project 5e1dba932ed24648bb3a2d55a6198d3d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79121) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 25 02:41:07.321461 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-334332ac-baa3-4cda-b7a0-e34b9c089dd7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:41:07.322099 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-334332ac-baa3-4cda-b7a0-e34b9c089dd7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:41:07.323621 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1254/2495] 10.222.0.117 () {58 vars in 1237 bytes} [Tue Jan 25 02:41:07 2022] DELETE /identity/v3/projects/5e1dba932ed24648bb3a2d55a6198d3d => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:41:07.330002 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76995544-4d77-4ac5-bb4e-fd60dc89e7c7 None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:41:07.330486 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76995544-4d77-4ac5-bb4e-fd60dc89e7c7 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:41:07.330606 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76995544-4d77-4ac5-bb4e-fd60dc89e7c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:41:07.348677 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-76995544-4d77-4ac5-bb4e-fd60dc89e7c7 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:41:07.349865 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-76995544-4d77-4ac5-bb4e-fd60dc89e7c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:41:07.406926 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1242/2496] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:41:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:41:07.415537 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1aa219-7c19-441a-aaed-ce84c0a2e5c3 None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:41:07.415856 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1aa219-7c19-441a-aaed-ce84c0a2e5c3 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:41:07.416134 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1aa219-7c19-441a-aaed-ce84c0a2e5c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:41:07.435824 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-2e1aa219-7c19-441a-aaed-ce84c0a2e5c3 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:41:07.437058 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-2e1aa219-7c19-441a-aaed-ce84c0a2e5c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:41:07.445056 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1255/2497] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:41:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:41:07.449353 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76995544-4d77-4ac5-bb4e-fd60dc89e7c7 None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:41:07.458940 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76995544-4d77-4ac5-bb4e-fd60dc89e7c7 None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:41:07.464486 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1f5269-3ef4-4715-86d8-711943bf75d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:41:07.465128 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1f5269-3ef4-4715-86d8-711943bf75d7 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:41:07.465406 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1f5269-3ef4-4715-86d8-711943bf75d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:41:07.465679 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1f5269-3ef4-4715-86d8-711943bf75d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:41:07.466410 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1f5269-3ef4-4715-86d8-711943bf75d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:41:07.466713 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1f5269-3ef4-4715-86d8-711943bf75d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:41:07.468336 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1f5269-3ef4-4715-86d8-711943bf75d7 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:41:07.480275 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1243/2498] 10.222.0.117 () {58 vars in 1157 bytes} [Tue Jan 25 02:41:07 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:41:07.484468 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1aa219-7c19-441a-aaed-ce84c0a2e5c3 None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:41:07.493717 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1aa219-7c19-441a-aaed-ce84c0a2e5c3 None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:41:07.498413 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79de31bb-c9c4-4770-81e8-13b9857273be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:41:07.499062 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79de31bb-c9c4-4770-81e8-13b9857273be admin admin] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:41:07.499346 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79de31bb-c9c4-4770-81e8-13b9857273be admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:41:07.499624 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79de31bb-c9c4-4770-81e8-13b9857273be admin admin] PATH_INFO: `/v3/projects` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:41:07.500362 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79de31bb-c9c4-4770-81e8-13b9857273be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:41:07.502270 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79de31bb-c9c4-4770-81e8-13b9857273be admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:41:07.527725 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1256/2499] 10.222.0.117 () {60 vars in 1157 bytes} [Tue Jan 25 02:41:07 2022] POST /identity/v3/projects => generated 368 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 02:41:07.531804 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1f5269-3ef4-4715-86d8-711943bf75d7 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:41:07.542464 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1f5269-3ef4-4715-86d8-711943bf75d7 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:41:07.596771 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2862053c-7261-4b89-b22c-70124aa1007a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:41:07.597364 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2862053c-7261-4b89-b22c-70124aa1007a admin admin] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:41:07.597642 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2862053c-7261-4b89-b22c-70124aa1007a admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:41:07.597912 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2862053c-7261-4b89-b22c-70124aa1007a admin admin] PATH_INFO: `/v3/users` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:41:07.598618 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2862053c-7261-4b89-b22c-70124aa1007a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:41:07.601171 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2862053c-7261-4b89-b22c-70124aa1007a admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:41:07.620259 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1244/2500] 10.222.0.117 () {60 vars in 1148 bytes} [Tue Jan 25 02:41:07 2022] POST /identity/v3/users => generated 285 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 25 02:41:07.624351 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79de31bb-c9c4-4770-81e8-13b9857273be admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:41:07.634586 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79de31bb-c9c4-4770-81e8-13b9857273be admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:41:07.639212 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495bdf80-6700-4804-a0f2-f7261e0ea31e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:41:07.639901 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495bdf80-6700-4804-a0f2-f7261e0ea31e admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:41:07.640190 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495bdf80-6700-4804-a0f2-f7261e0ea31e admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:41:07.640467 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495bdf80-6700-4804-a0f2-f7261e0ea31e admin admin] PATH_INFO: `/v3/roles` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:41:07.641238 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495bdf80-6700-4804-a0f2-f7261e0ea31e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:41:07.642835 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495bdf80-6700-4804-a0f2-f7261e0ea31e admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:41:07.653752 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1257/2501] 10.222.0.117 () {58 vars in 1126 bytes} [Tue Jan 25 02:41:07 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 02:41:07.657504 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2862053c-7261-4b89-b22c-70124aa1007a admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:41:07.668198 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2862053c-7261-4b89-b22c-70124aa1007a admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:41:07.673032 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8056130c-ecfe-4140-b387-99dcd1f55dc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:41:07.673689 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8056130c-ecfe-4140-b387-99dcd1f55dc0 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:41:07.673971 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8056130c-ecfe-4140-b387-99dcd1f55dc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:41:07.674251 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8056130c-ecfe-4140-b387-99dcd1f55dc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:41:07.675024 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8056130c-ecfe-4140-b387-99dcd1f55dc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:41:07.676724 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8056130c-ecfe-4140-b387-99dcd1f55dc0 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:41:07.686666 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1245/2502] 10.222.0.117 () {58 vars in 1126 bytes} [Tue Jan 25 02:41:07 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 02:41:07.690882 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495bdf80-6700-4804-a0f2-f7261e0ea31e admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:41:07.700822 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495bdf80-6700-4804-a0f2-f7261e0ea31e admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:41:07.705744 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5edc3f-67d3-42d5-ae93-fd1abb2ec302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:41:07.706617 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5edc3f-67d3-42d5-ae93-fd1abb2ec302 admin admin] REQUEST_METHOD: `PUT` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:41:07.706901 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5edc3f-67d3-42d5-ae93-fd1abb2ec302 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:41:07.707179 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5edc3f-67d3-42d5-ae93-fd1abb2ec302 admin admin] PATH_INFO: `/v3/projects/45c59b93c43f456dbdddb8ebecb2d46b/users/e56f59f8c9f94e4aa4e3e70c7035a888/roles/33a8e87420ed423f9cb29e0084eab5d2` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:41:07.721794 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5edc3f-67d3-42d5-ae93-fd1abb2ec302 admin admin] RBAC: Authorizing `identity:create_grant(project_id=45c59b93c43f456dbdddb8ebecb2d46b, user_id=e56f59f8c9f94e4aa4e3e70c7035a888, role_id=33a8e87420ed423f9cb29e0084eab5d2)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:41:07.724477 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5edc3f-67d3-42d5-ae93-fd1abb2ec302 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:41:07.737833 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1258/2503] 10.222.0.117 () {60 vars in 1487 bytes} [Tue Jan 25 02:41:07 2022] PUT /identity/v3/projects/45c59b93c43f456dbdddb8ebecb2d46b/users/e56f59f8c9f94e4aa4e3e70c7035a888/roles/33a8e87420ed423f9cb29e0084eab5d2 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:41:07.749070 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e6457c-03c7-4680-964c-7a482a035f13 None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:41:07.749348 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e6457c-03c7-4680-964c-7a482a035f13 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:41:07.749655 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e6457c-03c7-4680-964c-7a482a035f13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:41:07.776590 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-e0e6457c-03c7-4680-964c-7a482a035f13 None None] MFA Rules not processed for user `e56f59f8c9f94e4aa4e3e70c7035a888`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:41:07.777797 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-e0e6457c-03c7-4680-964c-7a482a035f13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:41:07.840193 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1246/2504] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:41:07 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:41:07.844964 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5edc3f-67d3-42d5-ae93-fd1abb2ec302 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:41:07.903933 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5edc3f-67d3-42d5-ae93-fd1abb2ec302 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:41:07.908526 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9ec6e5-9ea2-49eb-802d-c7b4d9b6c458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:41:07.909170 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9ec6e5-9ea2-49eb-802d-c7b4d9b6c458 admin admin] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:41:07.909456 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9ec6e5-9ea2-49eb-802d-c7b4d9b6c458 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:41:07.909732 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9ec6e5-9ea2-49eb-802d-c7b4d9b6c458 admin admin] PATH_INFO: `/v3/projects` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:41:07.910426 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9ec6e5-9ea2-49eb-802d-c7b4d9b6c458 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:41:07.912380 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9ec6e5-9ea2-49eb-802d-c7b4d9b6c458 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:41:07.939878 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1259/2505] 10.222.0.117 () {60 vars in 1157 bytes} [Tue Jan 25 02:41:07 2022] POST /identity/v3/projects => generated 364 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 02:41:07.941006 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e6457c-03c7-4680-964c-7a482a035f13 None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:41:07.951995 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e6457c-03c7-4680-964c-7a482a035f13 None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:41:08.005217 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416d47bd-8760-469e-ae43-0e070d5e351b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:41:08.005882 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416d47bd-8760-469e-ae43-0e070d5e351b admin admin] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:41:08.006167 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416d47bd-8760-469e-ae43-0e070d5e351b admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:41:08.006969 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416d47bd-8760-469e-ae43-0e070d5e351b admin admin] PATH_INFO: `/v3/users` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:41:08.007676 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416d47bd-8760-469e-ae43-0e070d5e351b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:41:08.009626 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416d47bd-8760-469e-ae43-0e070d5e351b admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:41:08.029496 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1247/2506] 10.222.0.117 () {60 vars in 1148 bytes} [Tue Jan 25 02:41:07 2022] POST /identity/v3/users => generated 289 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 02:41:08.033450 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9ec6e5-9ea2-49eb-802d-c7b4d9b6c458 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:41:08.043599 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9ec6e5-9ea2-49eb-802d-c7b4d9b6c458 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:41:08.048213 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b357099f-0dc2-4564-a432-80f191306fb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:41:08.048860 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b357099f-0dc2-4564-a432-80f191306fb4 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:41:08.049145 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b357099f-0dc2-4564-a432-80f191306fb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:41:08.049445 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b357099f-0dc2-4564-a432-80f191306fb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:41:08.050175 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b357099f-0dc2-4564-a432-80f191306fb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:41:08.051814 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b357099f-0dc2-4564-a432-80f191306fb4 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:41:08.062342 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1260/2507] 10.222.0.117 () {58 vars in 1126 bytes} [Tue Jan 25 02:41:08 2022] GET /identity/v3/roles => generated 1427 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 02:41:08.066398 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416d47bd-8760-469e-ae43-0e070d5e351b admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:41:08.076757 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416d47bd-8760-469e-ae43-0e070d5e351b admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:41:08.081688 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdc534e-e297-48c2-9290-1cb8a5c9c40a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:41:08.082566 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdc534e-e297-48c2-9290-1cb8a5c9c40a admin admin] REQUEST_METHOD: `PUT` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:41:08.082849 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdc534e-e297-48c2-9290-1cb8a5c9c40a admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:41:08.083127 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdc534e-e297-48c2-9290-1cb8a5c9c40a admin admin] PATH_INFO: `/v3/projects/3b9e704b196d4ac3b755a3a921d0365e/users/847179e065474eaba93810c325902ba1/roles/d8dbc6d83d9d41d28c3feb8b3485b291` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:41:08.099292 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdc534e-e297-48c2-9290-1cb8a5c9c40a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b9e704b196d4ac3b755a3a921d0365e, user_id=847179e065474eaba93810c325902ba1, role_id=d8dbc6d83d9d41d28c3feb8b3485b291)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:41:08.102864 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdc534e-e297-48c2-9290-1cb8a5c9c40a admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:41:08.116067 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1248/2508] 10.222.0.117 () {60 vars in 1487 bytes} [Tue Jan 25 02:41:08 2022] PUT /identity/v3/projects/3b9e704b196d4ac3b755a3a921d0365e/users/847179e065474eaba93810c325902ba1/roles/d8dbc6d83d9d41d28c3feb8b3485b291 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:41:08.120264 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b357099f-0dc2-4564-a432-80f191306fb4 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:41:08.130078 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b357099f-0dc2-4564-a432-80f191306fb4 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:41:08.185124 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a9070e-d1f2-45e8-b46c-633e2162fabf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:41:08.185796 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a9070e-d1f2-45e8-b46c-633e2162fabf admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:41:08.186083 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a9070e-d1f2-45e8-b46c-633e2162fabf admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:41:08.186362 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a9070e-d1f2-45e8-b46c-633e2162fabf admin admin] PATH_INFO: `/v3/roles` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:41:08.187107 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a9070e-d1f2-45e8-b46c-633e2162fabf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:41:08.188742 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a9070e-d1f2-45e8-b46c-633e2162fabf admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:41:08.199047 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1261/2509] 10.222.0.117 () {58 vars in 1126 bytes} [Tue Jan 25 02:41:08 2022] GET /identity/v3/roles => generated 1427 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 02:41:08.203373 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdc534e-e297-48c2-9290-1cb8a5c9c40a admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:41:08.213525 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdc534e-e297-48c2-9290-1cb8a5c9c40a admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:41:08.218124 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74c7e94-ff0f-4d19-b19e-a2d9c9e8f3b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:41:08.219004 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74c7e94-ff0f-4d19-b19e-a2d9c9e8f3b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:41:08.219289 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74c7e94-ff0f-4d19-b19e-a2d9c9e8f3b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:41:08.219569 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74c7e94-ff0f-4d19-b19e-a2d9c9e8f3b6 admin admin] PATH_INFO: `/v3/projects/3b9e704b196d4ac3b755a3a921d0365e/users/847179e065474eaba93810c325902ba1/roles/d8dbc6d83d9d41d28c3feb8b3485b291` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:41:08.221569 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74c7e94-ff0f-4d19-b19e-a2d9c9e8f3b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b9e704b196d4ac3b755a3a921d0365e, user_id=847179e065474eaba93810c325902ba1, role_id=d8dbc6d83d9d41d28c3feb8b3485b291)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:41:08.224291 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74c7e94-ff0f-4d19-b19e-a2d9c9e8f3b6 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:41:08.234430 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1249/2510] 10.222.0.117 () {60 vars in 1487 bytes} [Tue Jan 25 02:41:08 2022] PUT /identity/v3/projects/3b9e704b196d4ac3b755a3a921d0365e/users/847179e065474eaba93810c325902ba1/roles/d8dbc6d83d9d41d28c3feb8b3485b291 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:41:08.245105 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511240f4-79ee-42b4-9c31-5e21402cf5b2 None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:41:08.245401 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511240f4-79ee-42b4-9c31-5e21402cf5b2 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:41:08.245683 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511240f4-79ee-42b4-9c31-5e21402cf5b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:41:08.271680 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-511240f4-79ee-42b4-9c31-5e21402cf5b2 None None] MFA Rules not processed for user `847179e065474eaba93810c325902ba1`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:41:08.273122 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-511240f4-79ee-42b4-9c31-5e21402cf5b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:41:08.342499 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1262/2511] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:41:08 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:41:08.352743 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74c7e94-ff0f-4d19-b19e-a2d9c9e8f3b6 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:41:08.354439 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-a74c7e94-ff0f-4d19-b19e-a2d9c9e8f3b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:41:08.416415 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74c7e94-ff0f-4d19-b19e-a2d9c9e8f3b6 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:41:08.420982 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5d2199-319b-46de-a02e-49e92265d646 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cc5249aea09430080e232cf17757f86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:41:08.422229 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5d2199-319b-46de-a02e-49e92265d646 service cinder] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:41:08.422512 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5d2199-319b-46de-a02e-49e92265d646 service cinder] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:41:08.422787 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5d2199-319b-46de-a02e-49e92265d646 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:41:08.432339 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5d2199-319b-46de-a02e-49e92265d646 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:41:08.433767 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5d2199-319b-46de-a02e-49e92265d646 service cinder] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:41:08.443116 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1250/2512] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:41:08 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:41:08.522100 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511240f4-79ee-42b4-9c31-5e21402cf5b2 None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:41:08.531796 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511240f4-79ee-42b4-9c31-5e21402cf5b2 None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:41:08.535355 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0301f7d-584e-4971-a1a1-dd79e16cb7e4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cc5249aea09430080e232cf17757f86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:41:08.536019 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0301f7d-584e-4971-a1a1-dd79e16cb7e4 service cinder] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:41:08.536301 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0301f7d-584e-4971-a1a1-dd79e16cb7e4 service cinder] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:41:08.536574 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0301f7d-584e-4971-a1a1-dd79e16cb7e4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:41:08.592014 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0301f7d-584e-4971-a1a1-dd79e16cb7e4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:41:08.594774 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0301f7d-584e-4971-a1a1-dd79e16cb7e4 service cinder] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:41:08.604956 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1263/2513] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:41:08 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:41:13.157736 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5d2199-319b-46de-a02e-49e92265d646 service cinder] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:41:13.218815 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5d2199-319b-46de-a02e-49e92265d646 service cinder] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:41:13.223442 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c0d3fe-cd19-4dcb-99fe-7ef28c7c0980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:41:13.224337 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c0d3fe-cd19-4dcb-99fe-7ef28c7c0980 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:41:13.224623 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c0d3fe-cd19-4dcb-99fe-7ef28c7c0980 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:41:13.224899 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c0d3fe-cd19-4dcb-99fe-7ef28c7c0980 admin admin] PATH_INFO: `/v3/users/e56f59f8c9f94e4aa4e3e70c7035a888` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:41:13.226095 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c0d3fe-cd19-4dcb-99fe-7ef28c7c0980 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e56f59f8c9f94e4aa4e3e70c7035a888)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:41:13.228588 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c0d3fe-cd19-4dcb-99fe-7ef28c7c0980 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:41:13.272710 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-a1c0d3fe-cd19-4dcb-99fe-7ef28c7c0980 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e56f59f8c9f94e4aa4e3e70c7035a888'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:41:13.280082 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-a1c0d3fe-cd19-4dcb-99fe-7ef28c7c0980 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e56f59f8c9f94e4aa4e3e70c7035a888'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:41:13.280691 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-a1c0d3fe-cd19-4dcb-99fe-7ef28c7c0980 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e56f59f8c9f94e4aa4e3e70c7035a888'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:41:13.281294 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-a1c0d3fe-cd19-4dcb-99fe-7ef28c7c0980 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e56f59f8c9f94e4aa4e3e70c7035a888'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:41:13.292707 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-a1c0d3fe-cd19-4dcb-99fe-7ef28c7c0980 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e56f59f8c9f94e4aa4e3e70c7035a888'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:41:13.304262 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1251/2514] 10.222.0.117 () {58 vars in 1228 bytes} [Tue Jan 25 02:41:13 2022] DELETE /identity/v3/users/e56f59f8c9f94e4aa4e3e70c7035a888 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:41:13.309426 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ed566a-3666-4eaa-a785-53799d9bf2b5 None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:41:13.309912 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ed566a-3666-4eaa-a785-53799d9bf2b5 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:41:13.310117 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ed566a-3666-4eaa-a785-53799d9bf2b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:41:13.329409 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-75ed566a-3666-4eaa-a785-53799d9bf2b5 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:41:13.330614 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-75ed566a-3666-4eaa-a785-53799d9bf2b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:41:13.387228 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1264/2515] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:41:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:41:13.397189 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c0d3fe-cd19-4dcb-99fe-7ef28c7c0980 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:41:13.398899 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-a1c0d3fe-cd19-4dcb-99fe-7ef28c7c0980 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:41:13.455511 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c0d3fe-cd19-4dcb-99fe-7ef28c7c0980 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:41:13.459158 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5feeb5-4e95-416d-be05-6d3df76161b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca4071c5f8f4a31b5edb81fa66a43a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:41:13.459827 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5feeb5-4e95-416d-be05-6d3df76161b0 service neutron] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:41:13.460111 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5feeb5-4e95-416d-be05-6d3df76161b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:41:13.460387 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5feeb5-4e95-416d-be05-6d3df76161b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:41:13.469434 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5feeb5-4e95-416d-be05-6d3df76161b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:41:13.470856 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5feeb5-4e95-416d-be05-6d3df76161b0 service neutron] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:41:13.479948 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1252/2516] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:41:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:41:13.736751 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ed566a-3666-4eaa-a785-53799d9bf2b5 None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:41:13.738437 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-75ed566a-3666-4eaa-a785-53799d9bf2b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:41:13.750899 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ed566a-3666-4eaa-a785-53799d9bf2b5 None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:41:13.755650 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10008623-fd95-4044-9d6e-f5fa565790d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:41:13.756533 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10008623-fd95-4044-9d6e-f5fa565790d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:41:13.756819 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10008623-fd95-4044-9d6e-f5fa565790d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:41:13.757098 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10008623-fd95-4044-9d6e-f5fa565790d2 admin admin] PATH_INFO: `/v3/projects/45c59b93c43f456dbdddb8ebecb2d46b` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:41:13.758332 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10008623-fd95-4044-9d6e-f5fa565790d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=45c59b93c43f456dbdddb8ebecb2d46b)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:41:13.760839 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10008623-fd95-4044-9d6e-f5fa565790d2 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:41:13.806882 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-10008623-fd95-4044-9d6e-f5fa565790d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45c59b93c43f456dbdddb8ebecb2d46b', 'request_id': 'req-10008623-fd95-4044-9d6e-f5fa565790d2'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:41:13.812158 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-10008623-fd95-4044-9d6e-f5fa565790d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45c59b93c43f456dbdddb8ebecb2d46b', 'request_id': 'req-10008623-fd95-4044-9d6e-f5fa565790d2'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:41:13.819336 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-10008623-fd95-4044-9d6e-f5fa565790d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45c59b93c43f456dbdddb8ebecb2d46b', 'request_id': 'req-10008623-fd95-4044-9d6e-f5fa565790d2'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:41:13.831246 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-10008623-fd95-4044-9d6e-f5fa565790d2 admin admin] The token cache is being invalidate because project 45c59b93c43f456dbdddb8ebecb2d46b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79121) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 25 02:41:13.831578 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-10008623-fd95-4044-9d6e-f5fa565790d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:41:13.832230 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-10008623-fd95-4044-9d6e-f5fa565790d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:41:13.833752 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1265/2517] 10.222.0.117 () {58 vars in 1237 bytes} [Tue Jan 25 02:41:13 2022] DELETE /identity/v3/projects/45c59b93c43f456dbdddb8ebecb2d46b => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:41:13.838472 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5feeb5-4e95-416d-be05-6d3df76161b0 service neutron] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:41:13.847844 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5feeb5-4e95-416d-be05-6d3df76161b0 service neutron] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:41:13.901341 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84079f1-e887-4f0f-ad89-41c66bc65702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:41:13.902196 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84079f1-e887-4f0f-ad89-41c66bc65702 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:41:13.902479 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84079f1-e887-4f0f-ad89-41c66bc65702 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:41:13.902751 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84079f1-e887-4f0f-ad89-41c66bc65702 admin admin] PATH_INFO: `/v3/users/847179e065474eaba93810c325902ba1` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:41:13.903976 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84079f1-e887-4f0f-ad89-41c66bc65702 admin admin] RBAC: Authorizing `identity:delete_user(user_id=847179e065474eaba93810c325902ba1)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:41:13.905896 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84079f1-e887-4f0f-ad89-41c66bc65702 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:41:13.949938 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-a84079f1-e887-4f0f-ad89-41c66bc65702 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '847179e065474eaba93810c325902ba1'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:41:13.956398 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-a84079f1-e887-4f0f-ad89-41c66bc65702 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '847179e065474eaba93810c325902ba1'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:41:13.957001 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-a84079f1-e887-4f0f-ad89-41c66bc65702 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '847179e065474eaba93810c325902ba1'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:41:13.957620 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-a84079f1-e887-4f0f-ad89-41c66bc65702 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '847179e065474eaba93810c325902ba1'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:41:13.969566 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-a84079f1-e887-4f0f-ad89-41c66bc65702 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '847179e065474eaba93810c325902ba1'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:41:13.981414 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1253/2518] 10.222.0.117 () {58 vars in 1228 bytes} [Tue Jan 25 02:41:13 2022] DELETE /identity/v3/users/847179e065474eaba93810c325902ba1 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:41:14.241713 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10008623-fd95-4044-9d6e-f5fa565790d2 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:41:14.243153 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-10008623-fd95-4044-9d6e-f5fa565790d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:41:14.256371 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10008623-fd95-4044-9d6e-f5fa565790d2 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:41:14.311571 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4c758e-ef28-425f-b14f-1319eb358193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:41:14.312470 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4c758e-ef28-425f-b14f-1319eb358193 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:41:14.312754 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4c758e-ef28-425f-b14f-1319eb358193 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:41:14.313036 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4c758e-ef28-425f-b14f-1319eb358193 admin admin] PATH_INFO: `/v3/projects/3b9e704b196d4ac3b755a3a921d0365e` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:41:14.314220 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4c758e-ef28-425f-b14f-1319eb358193 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b9e704b196d4ac3b755a3a921d0365e)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:41:14.316180 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4c758e-ef28-425f-b14f-1319eb358193 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:41:14.364051 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-6a4c758e-ef28-425f-b14f-1319eb358193 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b9e704b196d4ac3b755a3a921d0365e', 'request_id': 'req-6a4c758e-ef28-425f-b14f-1319eb358193'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:41:14.369677 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-6a4c758e-ef28-425f-b14f-1319eb358193 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b9e704b196d4ac3b755a3a921d0365e', 'request_id': 'req-6a4c758e-ef28-425f-b14f-1319eb358193'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:41:14.377158 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-6a4c758e-ef28-425f-b14f-1319eb358193 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b9e704b196d4ac3b755a3a921d0365e', 'request_id': 'req-6a4c758e-ef28-425f-b14f-1319eb358193'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:41:14.388463 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-6a4c758e-ef28-425f-b14f-1319eb358193 admin admin] The token cache is being invalidate because project 3b9e704b196d4ac3b755a3a921d0365e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79121) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 25 02:41:14.388748 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-6a4c758e-ef28-425f-b14f-1319eb358193 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:41:14.389382 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-6a4c758e-ef28-425f-b14f-1319eb358193 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:41:14.390901 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1266/2519] 10.222.0.117 () {58 vars in 1237 bytes} [Tue Jan 25 02:41:14 2022] DELETE /identity/v3/projects/3b9e704b196d4ac3b755a3a921d0365e => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:41:14.397133 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c393c6-b9f4-4252-90d5-9a3b4d7ec310 None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:41:14.397598 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c393c6-b9f4-4252-90d5-9a3b4d7ec310 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:41:14.397697 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c393c6-b9f4-4252-90d5-9a3b4d7ec310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:41:14.417447 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-00c393c6-b9f4-4252-90d5-9a3b4d7ec310 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:41:14.418676 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-00c393c6-b9f4-4252-90d5-9a3b4d7ec310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:41:14.480922 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1254/2520] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:41:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:41:14.489489 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485b887d-927d-4fcf-b661-7012e2199498 None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:41:14.489798 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485b887d-927d-4fcf-b661-7012e2199498 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:41:14.490099 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485b887d-927d-4fcf-b661-7012e2199498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:41:14.508047 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-485b887d-927d-4fcf-b661-7012e2199498 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:41:14.509786 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-485b887d-927d-4fcf-b661-7012e2199498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:41:14.517868 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1267/2521] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:41:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:41:14.522109 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c393c6-b9f4-4252-90d5-9a3b4d7ec310 None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:41:14.532389 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c393c6-b9f4-4252-90d5-9a3b4d7ec310 None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:41:14.536997 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913c950e-64da-4fbf-b797-66c425fbd4f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:41:14.537646 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913c950e-64da-4fbf-b797-66c425fbd4f9 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:41:14.537931 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913c950e-64da-4fbf-b797-66c425fbd4f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:41:14.538208 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913c950e-64da-4fbf-b797-66c425fbd4f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:41:14.538947 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913c950e-64da-4fbf-b797-66c425fbd4f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:41:14.539254 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913c950e-64da-4fbf-b797-66c425fbd4f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:41:14.540896 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913c950e-64da-4fbf-b797-66c425fbd4f9 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:41:14.552229 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1255/2522] 10.222.0.117 () {58 vars in 1157 bytes} [Tue Jan 25 02:41:14 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 02:41:14.556586 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485b887d-927d-4fcf-b661-7012e2199498 None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:41:14.565607 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485b887d-927d-4fcf-b661-7012e2199498 None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:41:14.570237 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a8b7a4-c1c9-48fc-bc9d-fcfa21416a4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:41:14.570879 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a8b7a4-c1c9-48fc-bc9d-fcfa21416a4a admin admin] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:41:14.571161 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a8b7a4-c1c9-48fc-bc9d-fcfa21416a4a admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:41:14.571435 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a8b7a4-c1c9-48fc-bc9d-fcfa21416a4a admin admin] PATH_INFO: `/v3/projects` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:41:14.572782 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a8b7a4-c1c9-48fc-bc9d-fcfa21416a4a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:41:14.574692 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a8b7a4-c1c9-48fc-bc9d-fcfa21416a4a admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:41:14.602229 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1268/2523] 10.222.0.117 () {60 vars in 1157 bytes} [Tue Jan 25 02:41:14 2022] POST /identity/v3/projects => generated 376 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 02:41:14.606332 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913c950e-64da-4fbf-b797-66c425fbd4f9 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:41:14.616129 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913c950e-64da-4fbf-b797-66c425fbd4f9 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:41:14.670521 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359753a3-841f-4588-bc2f-a82cd5bbfeb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:41:14.671182 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359753a3-841f-4588-bc2f-a82cd5bbfeb1 admin admin] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:41:14.671466 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359753a3-841f-4588-bc2f-a82cd5bbfeb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:41:14.671772 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359753a3-841f-4588-bc2f-a82cd5bbfeb1 admin admin] PATH_INFO: `/v3/users` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:41:14.672475 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359753a3-841f-4588-bc2f-a82cd5bbfeb1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:41:14.674402 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359753a3-841f-4588-bc2f-a82cd5bbfeb1 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:41:14.694404 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1256/2524] 10.222.0.117 () {60 vars in 1148 bytes} [Tue Jan 25 02:41:14 2022] POST /identity/v3/users => generated 289 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 02:41:14.699025 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a8b7a4-c1c9-48fc-bc9d-fcfa21416a4a admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:41:14.709547 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a8b7a4-c1c9-48fc-bc9d-fcfa21416a4a admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:41:14.714922 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6fae82-3e82-4d98-854b-a1ffafab4bb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:41:14.715570 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6fae82-3e82-4d98-854b-a1ffafab4bb4 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:41:14.715901 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6fae82-3e82-4d98-854b-a1ffafab4bb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:41:14.716177 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6fae82-3e82-4d98-854b-a1ffafab4bb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:41:14.716945 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6fae82-3e82-4d98-854b-a1ffafab4bb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:41:14.718549 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6fae82-3e82-4d98-854b-a1ffafab4bb4 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:41:14.729015 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1269/2525] 10.222.0.117 () {58 vars in 1126 bytes} [Tue Jan 25 02:41:14 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 02:41:14.732898 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359753a3-841f-4588-bc2f-a82cd5bbfeb1 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:41:14.742634 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359753a3-841f-4588-bc2f-a82cd5bbfeb1 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:41:14.750055 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62abbee5-ea19-4a0a-843e-dac5f756a3f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:41:14.750728 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62abbee5-ea19-4a0a-843e-dac5f756a3f1 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:41:14.751017 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62abbee5-ea19-4a0a-843e-dac5f756a3f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:41:14.751462 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62abbee5-ea19-4a0a-843e-dac5f756a3f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:41:14.753338 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62abbee5-ea19-4a0a-843e-dac5f756a3f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:41:14.756066 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62abbee5-ea19-4a0a-843e-dac5f756a3f1 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:41:14.769694 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1257/2526] 10.222.0.117 () {58 vars in 1126 bytes} [Tue Jan 25 02:41:14 2022] GET /identity/v3/roles => generated 1427 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 02:41:14.774020 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6fae82-3e82-4d98-854b-a1ffafab4bb4 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:41:14.789355 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6fae82-3e82-4d98-854b-a1ffafab4bb4 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:41:14.796568 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9490b40-1800-4dab-a4d8-9a9444b9c273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:41:14.797937 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9490b40-1800-4dab-a4d8-9a9444b9c273 admin admin] REQUEST_METHOD: `PUT` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:41:14.798360 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9490b40-1800-4dab-a4d8-9a9444b9c273 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:41:14.798782 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9490b40-1800-4dab-a4d8-9a9444b9c273 admin admin] PATH_INFO: `/v3/projects/f3a83375fdd7476e993b7f8bcfb6164c/users/aec56060fc2d43f4aacad8184a202ef0/roles/33a8e87420ed423f9cb29e0084eab5d2` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:41:14.818602 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9490b40-1800-4dab-a4d8-9a9444b9c273 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3a83375fdd7476e993b7f8bcfb6164c, user_id=aec56060fc2d43f4aacad8184a202ef0, role_id=33a8e87420ed423f9cb29e0084eab5d2)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:41:14.822969 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9490b40-1800-4dab-a4d8-9a9444b9c273 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:41:14.838416 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1270/2527] 10.222.0.117 () {60 vars in 1487 bytes} [Tue Jan 25 02:41:14 2022] PUT /identity/v3/projects/f3a83375fdd7476e993b7f8bcfb6164c/users/aec56060fc2d43f4aacad8184a202ef0/roles/33a8e87420ed423f9cb29e0084eab5d2 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 25 02:41:14.852169 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb9a5c6-67db-4ae7-8b89-1de3d1826770 None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:41:14.852464 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb9a5c6-67db-4ae7-8b89-1de3d1826770 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:41:14.852745 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb9a5c6-67db-4ae7-8b89-1de3d1826770 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:41:14.880345 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-3cb9a5c6-67db-4ae7-8b89-1de3d1826770 None None] MFA Rules not processed for user `aec56060fc2d43f4aacad8184a202ef0`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:41:14.881483 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-3cb9a5c6-67db-4ae7-8b89-1de3d1826770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:41:14.944029 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1258/2528] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:41:14 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:41:14.949034 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9490b40-1800-4dab-a4d8-9a9444b9c273 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:41:15.007587 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9490b40-1800-4dab-a4d8-9a9444b9c273 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:41:15.012871 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4517f9b-204e-4510-8765-6fce3646b4b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:41:15.013520 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4517f9b-204e-4510-8765-6fce3646b4b1 admin admin] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:41:15.013808 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4517f9b-204e-4510-8765-6fce3646b4b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:41:15.014087 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4517f9b-204e-4510-8765-6fce3646b4b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:41:15.014837 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4517f9b-204e-4510-8765-6fce3646b4b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:41:15.016860 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4517f9b-204e-4510-8765-6fce3646b4b1 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:41:15.041170 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1271/2529] 10.222.0.117 () {60 vars in 1157 bytes} [Tue Jan 25 02:41:14 2022] POST /identity/v3/projects => generated 376 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 02:41:15.045301 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb9a5c6-67db-4ae7-8b89-1de3d1826770 None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:41:15.056736 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb9a5c6-67db-4ae7-8b89-1de3d1826770 None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:41:15.112931 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c542a571-d883-40ec-aaaa-4b0ce6d581ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:41:15.113593 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c542a571-d883-40ec-aaaa-4b0ce6d581ea admin admin] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:41:15.113908 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c542a571-d883-40ec-aaaa-4b0ce6d581ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:41:15.114181 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c542a571-d883-40ec-aaaa-4b0ce6d581ea admin admin] PATH_INFO: `/v3/users` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:41:15.114874 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c542a571-d883-40ec-aaaa-4b0ce6d581ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:41:15.116844 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c542a571-d883-40ec-aaaa-4b0ce6d581ea admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:41:15.139649 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1259/2530] 10.222.0.117 () {60 vars in 1148 bytes} [Tue Jan 25 02:41:15 2022] POST /identity/v3/users => generated 289 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 02:41:15.143600 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4517f9b-204e-4510-8765-6fce3646b4b1 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:41:15.154436 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4517f9b-204e-4510-8765-6fce3646b4b1 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:41:15.159181 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d8b814-e144-49b0-9093-9bdf7d0cb8ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:41:15.160118 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d8b814-e144-49b0-9093-9bdf7d0cb8ff admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:41:15.160631 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d8b814-e144-49b0-9093-9bdf7d0cb8ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:41:15.161183 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d8b814-e144-49b0-9093-9bdf7d0cb8ff admin admin] PATH_INFO: `/v3/roles` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:41:15.162098 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d8b814-e144-49b0-9093-9bdf7d0cb8ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:41:15.163749 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d8b814-e144-49b0-9093-9bdf7d0cb8ff admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:41:15.175497 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1272/2531] 10.222.0.117 () {58 vars in 1126 bytes} [Tue Jan 25 02:41:15 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 02:41:15.179924 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c542a571-d883-40ec-aaaa-4b0ce6d581ea admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:41:15.191134 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c542a571-d883-40ec-aaaa-4b0ce6d581ea admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:41:15.195924 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a792b679-0dbb-46d8-994d-a5c61da9438c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:41:15.196614 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a792b679-0dbb-46d8-994d-a5c61da9438c admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:41:15.197054 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a792b679-0dbb-46d8-994d-a5c61da9438c admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:41:15.197447 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a792b679-0dbb-46d8-994d-a5c61da9438c admin admin] PATH_INFO: `/v3/roles` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:41:15.198170 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a792b679-0dbb-46d8-994d-a5c61da9438c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:41:15.199807 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a792b679-0dbb-46d8-994d-a5c61da9438c admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:41:15.210182 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1260/2532] 10.222.0.117 () {58 vars in 1126 bytes} [Tue Jan 25 02:41:15 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 02:41:15.215012 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d8b814-e144-49b0-9093-9bdf7d0cb8ff admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:41:15.224802 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d8b814-e144-49b0-9093-9bdf7d0cb8ff admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:41:15.230450 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b743a42-f68c-4782-813d-0e475424b47b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:41:15.231314 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b743a42-f68c-4782-813d-0e475424b47b admin admin] REQUEST_METHOD: `PUT` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:41:15.231593 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b743a42-f68c-4782-813d-0e475424b47b admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:41:15.231890 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b743a42-f68c-4782-813d-0e475424b47b admin admin] PATH_INFO: `/v3/projects/e4cca671d7f84653bc53b06a35e6b30b/users/a11c6169eb444bb1bd0f8de5275b32d9/roles/33a8e87420ed423f9cb29e0084eab5d2` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:41:15.247170 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b743a42-f68c-4782-813d-0e475424b47b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4cca671d7f84653bc53b06a35e6b30b, user_id=a11c6169eb444bb1bd0f8de5275b32d9, role_id=33a8e87420ed423f9cb29e0084eab5d2)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:41:15.250004 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b743a42-f68c-4782-813d-0e475424b47b admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:41:15.262430 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1273/2533] 10.222.0.117 () {60 vars in 1487 bytes} [Tue Jan 25 02:41:15 2022] PUT /identity/v3/projects/e4cca671d7f84653bc53b06a35e6b30b/users/a11c6169eb444bb1bd0f8de5275b32d9/roles/33a8e87420ed423f9cb29e0084eab5d2 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:41:15.272675 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607f420e-c579-424c-a726-547d8f159222 None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:41:15.273000 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607f420e-c579-424c-a726-547d8f159222 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:41:15.273278 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607f420e-c579-424c-a726-547d8f159222 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:41:15.300540 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-607f420e-c579-424c-a726-547d8f159222 None None] MFA Rules not processed for user `a11c6169eb444bb1bd0f8de5275b32d9`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:41:15.301746 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-607f420e-c579-424c-a726-547d8f159222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:41:15.364858 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1261/2534] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:41:15 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:41:15.369998 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b743a42-f68c-4782-813d-0e475424b47b admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:41:15.431930 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b743a42-f68c-4782-813d-0e475424b47b admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:41:15.436623 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a328f4d1-d051-4842-891e-e7c91eabf352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:41:15.437281 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a328f4d1-d051-4842-891e-e7c91eabf352 admin admin] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:41:15.437582 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a328f4d1-d051-4842-891e-e7c91eabf352 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:41:15.437843 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a328f4d1-d051-4842-891e-e7c91eabf352 admin admin] PATH_INFO: `/v3/projects` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:41:15.438547 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a328f4d1-d051-4842-891e-e7c91eabf352 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:41:15.440501 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a328f4d1-d051-4842-891e-e7c91eabf352 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:41:15.468186 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1274/2535] 10.222.0.117 () {60 vars in 1157 bytes} [Tue Jan 25 02:41:15 2022] POST /identity/v3/projects => generated 376 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 02:41:15.472250 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607f420e-c579-424c-a726-547d8f159222 None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:41:15.483241 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607f420e-c579-424c-a726-547d8f159222 None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:41:15.538200 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f248385a-a433-4510-9dad-5e8ad97f0ba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:41:15.538877 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f248385a-a433-4510-9dad-5e8ad97f0ba3 admin admin] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:41:15.539155 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f248385a-a433-4510-9dad-5e8ad97f0ba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:41:15.539424 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f248385a-a433-4510-9dad-5e8ad97f0ba3 admin admin] PATH_INFO: `/v3/users` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:41:15.540539 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f248385a-a433-4510-9dad-5e8ad97f0ba3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:41:15.543906 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f248385a-a433-4510-9dad-5e8ad97f0ba3 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:41:15.563683 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1262/2536] 10.222.0.117 () {60 vars in 1148 bytes} [Tue Jan 25 02:41:15 2022] POST /identity/v3/users => generated 295 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 02:41:15.567614 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a328f4d1-d051-4842-891e-e7c91eabf352 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:41:15.578728 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a328f4d1-d051-4842-891e-e7c91eabf352 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:41:15.583363 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3bfff3-0edb-41ec-bc0c-994f22d0289f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:41:15.584068 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3bfff3-0edb-41ec-bc0c-994f22d0289f admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:41:15.584356 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3bfff3-0edb-41ec-bc0c-994f22d0289f admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:41:15.584634 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3bfff3-0edb-41ec-bc0c-994f22d0289f admin admin] PATH_INFO: `/v3/roles` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:41:15.585403 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3bfff3-0edb-41ec-bc0c-994f22d0289f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:41:15.587050 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3bfff3-0edb-41ec-bc0c-994f22d0289f admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:41:15.597626 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1275/2537] 10.222.0.117 () {58 vars in 1126 bytes} [Tue Jan 25 02:41:15 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 02:41:15.601792 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f248385a-a433-4510-9dad-5e8ad97f0ba3 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:41:15.611940 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f248385a-a433-4510-9dad-5e8ad97f0ba3 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:41:15.616519 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d6f12f-ff22-4cd9-b102-bae8ff7d9627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:41:15.617374 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d6f12f-ff22-4cd9-b102-bae8ff7d9627 admin admin] REQUEST_METHOD: `PUT` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:41:15.617658 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d6f12f-ff22-4cd9-b102-bae8ff7d9627 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:41:15.617928 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d6f12f-ff22-4cd9-b102-bae8ff7d9627 admin admin] PATH_INFO: `/v3/projects/ced79171ab874ca1b6d3c7c8c0045c1d/users/9446fb26e9dd422e8d2e803206bffc19/roles/d8dbc6d83d9d41d28c3feb8b3485b291` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:41:15.633802 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d6f12f-ff22-4cd9-b102-bae8ff7d9627 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ced79171ab874ca1b6d3c7c8c0045c1d, user_id=9446fb26e9dd422e8d2e803206bffc19, role_id=d8dbc6d83d9d41d28c3feb8b3485b291)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:41:15.637204 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d6f12f-ff22-4cd9-b102-bae8ff7d9627 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:41:15.649559 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1263/2538] 10.222.0.117 () {60 vars in 1487 bytes} [Tue Jan 25 02:41:15 2022] PUT /identity/v3/projects/ced79171ab874ca1b6d3c7c8c0045c1d/users/9446fb26e9dd422e8d2e803206bffc19/roles/d8dbc6d83d9d41d28c3feb8b3485b291 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:41:15.653529 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3bfff3-0edb-41ec-bc0c-994f22d0289f admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:41:15.663232 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3bfff3-0edb-41ec-bc0c-994f22d0289f admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:41:15.718505 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ee3a52-d498-48ba-b9d9-01ba90e5b683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:41:15.719172 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ee3a52-d498-48ba-b9d9-01ba90e5b683 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:41:15.719460 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ee3a52-d498-48ba-b9d9-01ba90e5b683 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:41:15.719774 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ee3a52-d498-48ba-b9d9-01ba90e5b683 admin admin] PATH_INFO: `/v3/roles` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:41:15.720509 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ee3a52-d498-48ba-b9d9-01ba90e5b683 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:41:15.722116 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ee3a52-d498-48ba-b9d9-01ba90e5b683 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:41:15.731654 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1276/2539] 10.222.0.117 () {58 vars in 1126 bytes} [Tue Jan 25 02:41:15 2022] GET /identity/v3/roles => generated 1427 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 02:41:15.735905 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d6f12f-ff22-4cd9-b102-bae8ff7d9627 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:41:15.747016 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d6f12f-ff22-4cd9-b102-bae8ff7d9627 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:41:15.751608 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979e366f-4e45-4e27-923c-480e63a121e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:41:15.752505 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979e366f-4e45-4e27-923c-480e63a121e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:41:15.752785 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979e366f-4e45-4e27-923c-480e63a121e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:41:15.753058 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979e366f-4e45-4e27-923c-480e63a121e6 admin admin] PATH_INFO: `/v3/projects/ced79171ab874ca1b6d3c7c8c0045c1d/users/9446fb26e9dd422e8d2e803206bffc19/roles/d8dbc6d83d9d41d28c3feb8b3485b291` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:41:15.755016 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979e366f-4e45-4e27-923c-480e63a121e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ced79171ab874ca1b6d3c7c8c0045c1d, user_id=9446fb26e9dd422e8d2e803206bffc19, role_id=d8dbc6d83d9d41d28c3feb8b3485b291)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:41:15.757691 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979e366f-4e45-4e27-923c-480e63a121e6 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:41:15.768198 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1264/2540] 10.222.0.117 () {60 vars in 1487 bytes} [Tue Jan 25 02:41:15 2022] PUT /identity/v3/projects/ced79171ab874ca1b6d3c7c8c0045c1d/users/9446fb26e9dd422e8d2e803206bffc19/roles/d8dbc6d83d9d41d28c3feb8b3485b291 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:41:15.779136 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0448bc-9f71-4548-8c40-790a0a80874b None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:41:15.779454 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0448bc-9f71-4548-8c40-790a0a80874b None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:41:15.779765 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0448bc-9f71-4548-8c40-790a0a80874b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:41:15.805602 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-cc0448bc-9f71-4548-8c40-790a0a80874b None None] MFA Rules not processed for user `9446fb26e9dd422e8d2e803206bffc19`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:41:15.807382 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-cc0448bc-9f71-4548-8c40-790a0a80874b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:41:15.874239 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1277/2541] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:41:15 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:41:15.884438 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979e366f-4e45-4e27-923c-480e63a121e6 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:41:15.886993 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-979e366f-4e45-4e27-923c-480e63a121e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:41:15.944033 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979e366f-4e45-4e27-923c-480e63a121e6 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:41:15.947955 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c327f2-1b63-4bee-bd60-84f0cda583d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cc5249aea09430080e232cf17757f86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:41:15.948590 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c327f2-1b63-4bee-bd60-84f0cda583d3 service cinder] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:41:15.948871 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c327f2-1b63-4bee-bd60-84f0cda583d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:41:15.949144 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c327f2-1b63-4bee-bd60-84f0cda583d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:41:16.004270 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c327f2-1b63-4bee-bd60-84f0cda583d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:41:16.005728 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c327f2-1b63-4bee-bd60-84f0cda583d3 service cinder] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:41:16.014361 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1265/2542] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:41:15 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 25 02:41:17.483418 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0448bc-9f71-4548-8c40-790a0a80874b None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:41:17.484869 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-cc0448bc-9f71-4548-8c40-790a0a80874b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:41:17.497309 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0448bc-9f71-4548-8c40-790a0a80874b None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:41:17.500834 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f92f5d-3f02-457e-b40d-510234e6660b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cc5249aea09430080e232cf17757f86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:41:17.501465 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f92f5d-3f02-457e-b40d-510234e6660b service cinder] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:41:17.501750 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f92f5d-3f02-457e-b40d-510234e6660b service cinder] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:41:17.502028 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f92f5d-3f02-457e-b40d-510234e6660b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:41:17.557025 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f92f5d-3f02-457e-b40d-510234e6660b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:41:17.558417 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f92f5d-3f02-457e-b40d-510234e6660b service cinder] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:41:17.567201 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1278/2543] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:41:17 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:41:18.060434 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c327f2-1b63-4bee-bd60-84f0cda583d3 service cinder] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:41:18.068632 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c327f2-1b63-4bee-bd60-84f0cda583d3 service cinder] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:41:18.072626 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e68b9f-1f7f-4831-bd51-741a99c7295a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cc5249aea09430080e232cf17757f86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:41:18.073258 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e68b9f-1f7f-4831-bd51-741a99c7295a service cinder] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:41:18.073543 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e68b9f-1f7f-4831-bd51-741a99c7295a service cinder] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:41:18.073860 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e68b9f-1f7f-4831-bd51-741a99c7295a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:41:18.082644 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e68b9f-1f7f-4831-bd51-741a99c7295a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:41:18.084148 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e68b9f-1f7f-4831-bd51-741a99c7295a service cinder] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:41:18.096007 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1266/2544] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:41:18 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:41:21.922598 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f92f5d-3f02-457e-b40d-510234e6660b service cinder] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:41:21.986856 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f92f5d-3f02-457e-b40d-510234e6660b service cinder] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:41:21.991249 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e5a6c3-e8db-4e83-8d62-0bc9d67f1f73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:41:21.992126 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e5a6c3-e8db-4e83-8d62-0bc9d67f1f73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:41:21.992405 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e5a6c3-e8db-4e83-8d62-0bc9d67f1f73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:41:21.992676 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e5a6c3-e8db-4e83-8d62-0bc9d67f1f73 admin admin] PATH_INFO: `/v3/users/aec56060fc2d43f4aacad8184a202ef0` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:41:21.993843 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e5a6c3-e8db-4e83-8d62-0bc9d67f1f73 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aec56060fc2d43f4aacad8184a202ef0)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:41:21.996717 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e5a6c3-e8db-4e83-8d62-0bc9d67f1f73 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:41:22.040454 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-a2e5a6c3-e8db-4e83-8d62-0bc9d67f1f73 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aec56060fc2d43f4aacad8184a202ef0'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:41:22.041098 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-a2e5a6c3-e8db-4e83-8d62-0bc9d67f1f73 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aec56060fc2d43f4aacad8184a202ef0'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:41:22.048645 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-a2e5a6c3-e8db-4e83-8d62-0bc9d67f1f73 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aec56060fc2d43f4aacad8184a202ef0'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:41:22.049310 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-a2e5a6c3-e8db-4e83-8d62-0bc9d67f1f73 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aec56060fc2d43f4aacad8184a202ef0'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:41:22.057830 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-a2e5a6c3-e8db-4e83-8d62-0bc9d67f1f73 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aec56060fc2d43f4aacad8184a202ef0'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:41:22.074542 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1279/2545] 10.222.0.117 () {58 vars in 1228 bytes} [Tue Jan 25 02:41:21 2022] DELETE /identity/v3/users/aec56060fc2d43f4aacad8184a202ef0 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:41:22.079263 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29989e4b-7c11-4652-bbaf-acd05a39758d None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:41:22.079766 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29989e4b-7c11-4652-bbaf-acd05a39758d None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:41:22.079885 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29989e4b-7c11-4652-bbaf-acd05a39758d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:41:22.096322 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-29989e4b-7c11-4652-bbaf-acd05a39758d None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:41:22.097543 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-29989e4b-7c11-4652-bbaf-acd05a39758d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:41:22.153816 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1267/2546] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:41:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:41:22.163425 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e5a6c3-e8db-4e83-8d62-0bc9d67f1f73 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:41:22.164857 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-a2e5a6c3-e8db-4e83-8d62-0bc9d67f1f73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:41:22.220602 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e5a6c3-e8db-4e83-8d62-0bc9d67f1f73 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:41:22.224280 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9ebd72-6f92-4aae-b594-f18307b08bb9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca4071c5f8f4a31b5edb81fa66a43a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:41:22.224921 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9ebd72-6f92-4aae-b594-f18307b08bb9 service neutron] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:41:22.225210 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9ebd72-6f92-4aae-b594-f18307b08bb9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:41:22.225492 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9ebd72-6f92-4aae-b594-f18307b08bb9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:41:22.234805 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9ebd72-6f92-4aae-b594-f18307b08bb9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:41:22.236304 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9ebd72-6f92-4aae-b594-f18307b08bb9 service neutron] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:41:22.246158 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1280/2547] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:41:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:41:22.502342 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29989e4b-7c11-4652-bbaf-acd05a39758d None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:41:22.503812 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-29989e4b-7c11-4652-bbaf-acd05a39758d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:41:22.518277 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29989e4b-7c11-4652-bbaf-acd05a39758d None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:41:22.523251 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86db64e-2c86-4b79-80fc-d98b6d54d313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:41:22.524154 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86db64e-2c86-4b79-80fc-d98b6d54d313 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:41:22.524441 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86db64e-2c86-4b79-80fc-d98b6d54d313 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:41:22.524786 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86db64e-2c86-4b79-80fc-d98b6d54d313 admin admin] PATH_INFO: `/v3/projects/f3a83375fdd7476e993b7f8bcfb6164c` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:41:22.526607 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86db64e-2c86-4b79-80fc-d98b6d54d313 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3a83375fdd7476e993b7f8bcfb6164c)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:41:22.528896 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86db64e-2c86-4b79-80fc-d98b6d54d313 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:41:22.575676 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-f86db64e-2c86-4b79-80fc-d98b6d54d313 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3a83375fdd7476e993b7f8bcfb6164c', 'request_id': 'req-f86db64e-2c86-4b79-80fc-d98b6d54d313'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:41:22.581327 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-f86db64e-2c86-4b79-80fc-d98b6d54d313 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3a83375fdd7476e993b7f8bcfb6164c', 'request_id': 'req-f86db64e-2c86-4b79-80fc-d98b6d54d313'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:41:22.587325 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-f86db64e-2c86-4b79-80fc-d98b6d54d313 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3a83375fdd7476e993b7f8bcfb6164c', 'request_id': 'req-f86db64e-2c86-4b79-80fc-d98b6d54d313'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:41:22.601781 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-f86db64e-2c86-4b79-80fc-d98b6d54d313 admin admin] The token cache is being invalidate because project f3a83375fdd7476e993b7f8bcfb6164c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79120) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 25 02:41:22.602076 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-f86db64e-2c86-4b79-80fc-d98b6d54d313 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:41:22.602700 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-f86db64e-2c86-4b79-80fc-d98b6d54d313 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:41:22.604775 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1268/2548] 10.222.0.117 () {58 vars in 1237 bytes} [Tue Jan 25 02:41:22 2022] DELETE /identity/v3/projects/f3a83375fdd7476e993b7f8bcfb6164c => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:41:22.608661 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9ebd72-6f92-4aae-b594-f18307b08bb9 service neutron] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:41:22.618078 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9ebd72-6f92-4aae-b594-f18307b08bb9 service neutron] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:41:22.673154 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb60b12-78e2-486d-977d-d7c58247cc3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:41:22.674025 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb60b12-78e2-486d-977d-d7c58247cc3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:41:22.674304 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb60b12-78e2-486d-977d-d7c58247cc3f admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:41:22.674577 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb60b12-78e2-486d-977d-d7c58247cc3f admin admin] PATH_INFO: `/v3/users/a11c6169eb444bb1bd0f8de5275b32d9` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:41:22.675989 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb60b12-78e2-486d-977d-d7c58247cc3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=a11c6169eb444bb1bd0f8de5275b32d9)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:41:22.677870 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb60b12-78e2-486d-977d-d7c58247cc3f admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:41:22.726797 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-8fb60b12-78e2-486d-977d-d7c58247cc3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a11c6169eb444bb1bd0f8de5275b32d9'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:41:22.727469 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-8fb60b12-78e2-486d-977d-d7c58247cc3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a11c6169eb444bb1bd0f8de5275b32d9'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:41:22.734692 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-8fb60b12-78e2-486d-977d-d7c58247cc3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a11c6169eb444bb1bd0f8de5275b32d9'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:41:22.735334 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-8fb60b12-78e2-486d-977d-d7c58247cc3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a11c6169eb444bb1bd0f8de5275b32d9'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:41:22.742496 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-8fb60b12-78e2-486d-977d-d7c58247cc3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a11c6169eb444bb1bd0f8de5275b32d9'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:41:22.759878 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1281/2549] 10.222.0.117 () {58 vars in 1228 bytes} [Tue Jan 25 02:41:22 2022] DELETE /identity/v3/users/a11c6169eb444bb1bd0f8de5275b32d9 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:41:23.017363 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86db64e-2c86-4b79-80fc-d98b6d54d313 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:41:23.019159 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-f86db64e-2c86-4b79-80fc-d98b6d54d313 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:41:23.033424 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86db64e-2c86-4b79-80fc-d98b6d54d313 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:41:23.090945 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622aad8a-d3d2-4684-82c7-afc78c9ba98e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:41:23.091837 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622aad8a-d3d2-4684-82c7-afc78c9ba98e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:41:23.092127 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622aad8a-d3d2-4684-82c7-afc78c9ba98e admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:41:23.092403 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622aad8a-d3d2-4684-82c7-afc78c9ba98e admin admin] PATH_INFO: `/v3/projects/e4cca671d7f84653bc53b06a35e6b30b` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:41:23.093589 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622aad8a-d3d2-4684-82c7-afc78c9ba98e admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4cca671d7f84653bc53b06a35e6b30b)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:41:23.095489 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622aad8a-d3d2-4684-82c7-afc78c9ba98e admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:41:23.141534 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-622aad8a-d3d2-4684-82c7-afc78c9ba98e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4cca671d7f84653bc53b06a35e6b30b', 'request_id': 'req-622aad8a-d3d2-4684-82c7-afc78c9ba98e'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:41:23.146651 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-622aad8a-d3d2-4684-82c7-afc78c9ba98e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4cca671d7f84653bc53b06a35e6b30b', 'request_id': 'req-622aad8a-d3d2-4684-82c7-afc78c9ba98e'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:41:23.153557 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-622aad8a-d3d2-4684-82c7-afc78c9ba98e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4cca671d7f84653bc53b06a35e6b30b', 'request_id': 'req-622aad8a-d3d2-4684-82c7-afc78c9ba98e'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:41:23.165020 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-622aad8a-d3d2-4684-82c7-afc78c9ba98e admin admin] The token cache is being invalidate because project e4cca671d7f84653bc53b06a35e6b30b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79120) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 25 02:41:23.165303 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-622aad8a-d3d2-4684-82c7-afc78c9ba98e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:41:23.165913 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-622aad8a-d3d2-4684-82c7-afc78c9ba98e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:41:23.168544 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1269/2550] 10.222.0.117 () {58 vars in 1237 bytes} [Tue Jan 25 02:41:23 2022] DELETE /identity/v3/projects/e4cca671d7f84653bc53b06a35e6b30b => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:41:23.172621 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb60b12-78e2-486d-977d-d7c58247cc3f admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:41:23.174028 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-8fb60b12-78e2-486d-977d-d7c58247cc3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:41:23.186616 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb60b12-78e2-486d-977d-d7c58247cc3f admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:41:23.242948 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bdeccd-c1d8-4d6f-a430-7f9377b88845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:41:23.243851 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bdeccd-c1d8-4d6f-a430-7f9377b88845 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:41:23.244128 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bdeccd-c1d8-4d6f-a430-7f9377b88845 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:41:23.244393 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bdeccd-c1d8-4d6f-a430-7f9377b88845 admin admin] PATH_INFO: `/v3/users/9446fb26e9dd422e8d2e803206bffc19` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:41:23.246090 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bdeccd-c1d8-4d6f-a430-7f9377b88845 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9446fb26e9dd422e8d2e803206bffc19)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:41:23.248069 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bdeccd-c1d8-4d6f-a430-7f9377b88845 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:41:23.293873 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-a3bdeccd-c1d8-4d6f-a430-7f9377b88845 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9446fb26e9dd422e8d2e803206bffc19'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:41:23.294587 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-a3bdeccd-c1d8-4d6f-a430-7f9377b88845 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9446fb26e9dd422e8d2e803206bffc19'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:41:23.301458 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-a3bdeccd-c1d8-4d6f-a430-7f9377b88845 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9446fb26e9dd422e8d2e803206bffc19'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:41:23.302091 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-a3bdeccd-c1d8-4d6f-a430-7f9377b88845 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9446fb26e9dd422e8d2e803206bffc19'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:41:23.309290 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-a3bdeccd-c1d8-4d6f-a430-7f9377b88845 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9446fb26e9dd422e8d2e803206bffc19'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:41:23.326644 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1282/2551] 10.222.0.117 () {58 vars in 1228 bytes} [Tue Jan 25 02:41:23 2022] DELETE /identity/v3/users/9446fb26e9dd422e8d2e803206bffc19 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:41:23.586749 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622aad8a-d3d2-4684-82c7-afc78c9ba98e admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:41:23.593079 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-622aad8a-d3d2-4684-82c7-afc78c9ba98e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:41:23.606149 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622aad8a-d3d2-4684-82c7-afc78c9ba98e admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:41:23.663203 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc95b094-1054-4b80-a3c6-f119a184ace2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:41:23.664080 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc95b094-1054-4b80-a3c6-f119a184ace2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:41:23.664368 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc95b094-1054-4b80-a3c6-f119a184ace2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:41:23.664644 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc95b094-1054-4b80-a3c6-f119a184ace2 admin admin] PATH_INFO: `/v3/projects/ced79171ab874ca1b6d3c7c8c0045c1d` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:41:23.665822 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc95b094-1054-4b80-a3c6-f119a184ace2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ced79171ab874ca1b6d3c7c8c0045c1d)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:41:23.667768 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc95b094-1054-4b80-a3c6-f119a184ace2 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:41:23.712906 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-dc95b094-1054-4b80-a3c6-f119a184ace2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ced79171ab874ca1b6d3c7c8c0045c1d', 'request_id': 'req-dc95b094-1054-4b80-a3c6-f119a184ace2'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:41:23.719311 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-dc95b094-1054-4b80-a3c6-f119a184ace2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ced79171ab874ca1b6d3c7c8c0045c1d', 'request_id': 'req-dc95b094-1054-4b80-a3c6-f119a184ace2'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:41:23.725479 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-dc95b094-1054-4b80-a3c6-f119a184ace2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ced79171ab874ca1b6d3c7c8c0045c1d', 'request_id': 'req-dc95b094-1054-4b80-a3c6-f119a184ace2'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:41:23.738713 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-dc95b094-1054-4b80-a3c6-f119a184ace2 admin admin] The token cache is being invalidate because project ced79171ab874ca1b6d3c7c8c0045c1d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79120) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 25 02:41:23.739006 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-dc95b094-1054-4b80-a3c6-f119a184ace2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:41:23.739651 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-dc95b094-1054-4b80-a3c6-f119a184ace2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:41:23.741226 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1270/2552] 10.222.0.117 () {58 vars in 1237 bytes} [Tue Jan 25 02:41:23 2022] DELETE /identity/v3/projects/ced79171ab874ca1b6d3c7c8c0045c1d => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:41:23.747091 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabc0e8b-b725-42d4-9eed-578dc4fc2008 None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:41:23.747388 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabc0e8b-b725-42d4-9eed-578dc4fc2008 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:41:23.747672 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabc0e8b-b725-42d4-9eed-578dc4fc2008 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:41:23.766858 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-cabc0e8b-b725-42d4-9eed-578dc4fc2008 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:41:23.768095 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-cabc0e8b-b725-42d4-9eed-578dc4fc2008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:41:23.825333 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1283/2553] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:41:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:41:23.833459 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96230a5a-2d40-460e-a04e-662ca25ff994 None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:41:23.833772 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96230a5a-2d40-460e-a04e-662ca25ff994 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:41:23.834055 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96230a5a-2d40-460e-a04e-662ca25ff994 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:41:23.851908 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-96230a5a-2d40-460e-a04e-662ca25ff994 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:41:23.853112 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-96230a5a-2d40-460e-a04e-662ca25ff994 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:41:23.861234 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1271/2554] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:41:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:41:23.865322 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabc0e8b-b725-42d4-9eed-578dc4fc2008 None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:41:23.875316 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabc0e8b-b725-42d4-9eed-578dc4fc2008 None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:41:23.879986 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04085093-2b3b-4ddc-83fe-72b6df2fa09b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:41:23.880630 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04085093-2b3b-4ddc-83fe-72b6df2fa09b admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:41:23.880910 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04085093-2b3b-4ddc-83fe-72b6df2fa09b admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:41:23.881183 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04085093-2b3b-4ddc-83fe-72b6df2fa09b admin admin] PATH_INFO: `/v3/domains` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:41:23.881914 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04085093-2b3b-4ddc-83fe-72b6df2fa09b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:41:23.882218 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04085093-2b3b-4ddc-83fe-72b6df2fa09b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:41:23.883848 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04085093-2b3b-4ddc-83fe-72b6df2fa09b admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:41:23.896343 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1284/2555] 10.222.0.117 () {58 vars in 1157 bytes} [Tue Jan 25 02:41:23 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:41:23.900514 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96230a5a-2d40-460e-a04e-662ca25ff994 None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:41:23.914253 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96230a5a-2d40-460e-a04e-662ca25ff994 None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:41:23.922377 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f8024b-ca10-48ff-a810-10f2486a5a50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:41:23.923029 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f8024b-ca10-48ff-a810-10f2486a5a50 admin admin] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:41:23.923316 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f8024b-ca10-48ff-a810-10f2486a5a50 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:41:23.923592 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f8024b-ca10-48ff-a810-10f2486a5a50 admin admin] PATH_INFO: `/v3/projects` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:41:23.924964 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f8024b-ca10-48ff-a810-10f2486a5a50 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:41:23.926278 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f8024b-ca10-48ff-a810-10f2486a5a50 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:41:23.951920 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1272/2556] 10.222.0.117 () {60 vars in 1157 bytes} [Tue Jan 25 02:41:23 2022] POST /identity/v3/projects => generated 384 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 25 02:41:23.956512 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04085093-2b3b-4ddc-83fe-72b6df2fa09b admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:41:23.966682 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04085093-2b3b-4ddc-83fe-72b6df2fa09b admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:41:24.021035 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c505b6-386a-4958-8a75-11144f8b12eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:41:24.021892 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c505b6-386a-4958-8a75-11144f8b12eb admin admin] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:41:24.022391 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c505b6-386a-4958-8a75-11144f8b12eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:41:24.022730 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c505b6-386a-4958-8a75-11144f8b12eb admin admin] PATH_INFO: `/v3/users` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:41:24.023445 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c505b6-386a-4958-8a75-11144f8b12eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:41:24.025427 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c505b6-386a-4958-8a75-11144f8b12eb admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:41:24.046329 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1285/2557] 10.222.0.117 () {60 vars in 1148 bytes} [Tue Jan 25 02:41:23 2022] POST /identity/v3/users => generated 293 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 02:41:24.050397 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f8024b-ca10-48ff-a810-10f2486a5a50 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:41:24.061376 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f8024b-ca10-48ff-a810-10f2486a5a50 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:41:24.066075 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993c9b9d-2e9d-4d07-a8eb-ee15849ebd64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:41:24.066723 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993c9b9d-2e9d-4d07-a8eb-ee15849ebd64 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:41:24.067005 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993c9b9d-2e9d-4d07-a8eb-ee15849ebd64 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:41:24.067306 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993c9b9d-2e9d-4d07-a8eb-ee15849ebd64 admin admin] PATH_INFO: `/v3/roles` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:41:24.068085 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993c9b9d-2e9d-4d07-a8eb-ee15849ebd64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:41:24.069679 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993c9b9d-2e9d-4d07-a8eb-ee15849ebd64 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:41:24.081119 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1273/2558] 10.222.0.117 () {58 vars in 1126 bytes} [Tue Jan 25 02:41:24 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 02:41:24.084965 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c505b6-386a-4958-8a75-11144f8b12eb admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:41:24.095019 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c505b6-386a-4958-8a75-11144f8b12eb admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:41:24.099813 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e428c22c-f680-497d-a198-4edeeeddf2ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:41:24.100468 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e428c22c-f680-497d-a198-4edeeeddf2ec admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:41:24.100754 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e428c22c-f680-497d-a198-4edeeeddf2ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:41:24.101029 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e428c22c-f680-497d-a198-4edeeeddf2ec admin admin] PATH_INFO: `/v3/roles` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:41:24.101771 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e428c22c-f680-497d-a198-4edeeeddf2ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:41:24.103391 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e428c22c-f680-497d-a198-4edeeeddf2ec admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:41:24.114214 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1286/2559] 10.222.0.117 () {58 vars in 1126 bytes} [Tue Jan 25 02:41:24 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 02:41:24.118468 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993c9b9d-2e9d-4d07-a8eb-ee15849ebd64 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:41:24.129707 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993c9b9d-2e9d-4d07-a8eb-ee15849ebd64 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:41:24.134388 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8082a32c-f248-41e5-b9fb-01ef70b7dcbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:41:24.136034 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8082a32c-f248-41e5-b9fb-01ef70b7dcbb admin admin] REQUEST_METHOD: `PUT` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:41:24.136473 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8082a32c-f248-41e5-b9fb-01ef70b7dcbb admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:41:24.136934 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8082a32c-f248-41e5-b9fb-01ef70b7dcbb admin admin] PATH_INFO: `/v3/projects/917ede0b8b0f45628bb3d610f324ffeb/users/b0bf2e17bf06453a8775711a193e3a74/roles/33a8e87420ed423f9cb29e0084eab5d2` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:41:24.152342 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8082a32c-f248-41e5-b9fb-01ef70b7dcbb admin admin] RBAC: Authorizing `identity:create_grant(project_id=917ede0b8b0f45628bb3d610f324ffeb, user_id=b0bf2e17bf06453a8775711a193e3a74, role_id=33a8e87420ed423f9cb29e0084eab5d2)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:41:24.155046 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8082a32c-f248-41e5-b9fb-01ef70b7dcbb admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:41:24.168880 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1274/2560] 10.222.0.117 () {60 vars in 1487 bytes} [Tue Jan 25 02:41:24 2022] PUT /identity/v3/projects/917ede0b8b0f45628bb3d610f324ffeb/users/b0bf2e17bf06453a8775711a193e3a74/roles/33a8e87420ed423f9cb29e0084eab5d2 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:41:24.239223 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8635c38-f36a-41ae-9ee4-6e1d4145adc6 None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:41:24.239897 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8635c38-f36a-41ae-9ee4-6e1d4145adc6 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:41:24.240008 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8635c38-f36a-41ae-9ee4-6e1d4145adc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:41:24.271113 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-a8635c38-f36a-41ae-9ee4-6e1d4145adc6 None None] MFA Rules not processed for user `b0bf2e17bf06453a8775711a193e3a74`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:41:24.272302 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-a8635c38-f36a-41ae-9ee4-6e1d4145adc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:41:24.337562 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1287/2561] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:41:24 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:41:24.342079 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8082a32c-f248-41e5-b9fb-01ef70b7dcbb admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:41:24.402691 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8082a32c-f248-41e5-b9fb-01ef70b7dcbb admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:41:24.407509 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372ce052-ee26-4547-a0d0-e7e117b6e3cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:41:24.408203 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372ce052-ee26-4547-a0d0-e7e117b6e3cb admin admin] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:41:24.408490 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372ce052-ee26-4547-a0d0-e7e117b6e3cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:41:24.408765 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372ce052-ee26-4547-a0d0-e7e117b6e3cb admin admin] PATH_INFO: `/v3/projects` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:41:24.409468 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372ce052-ee26-4547-a0d0-e7e117b6e3cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:41:24.411393 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372ce052-ee26-4547-a0d0-e7e117b6e3cb admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:41:24.439264 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1275/2562] 10.222.0.117 () {60 vars in 1157 bytes} [Tue Jan 25 02:41:24 2022] POST /identity/v3/projects => generated 384 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 02:41:24.443193 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8635c38-f36a-41ae-9ee4-6e1d4145adc6 None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:41:24.454943 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8635c38-f36a-41ae-9ee4-6e1d4145adc6 None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:41:24.513948 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b653a7c3-4857-409f-9f5e-24c99a009299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:41:24.514779 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b653a7c3-4857-409f-9f5e-24c99a009299 admin admin] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:41:24.515159 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b653a7c3-4857-409f-9f5e-24c99a009299 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:41:24.515537 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b653a7c3-4857-409f-9f5e-24c99a009299 admin admin] PATH_INFO: `/v3/users` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:41:24.516536 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b653a7c3-4857-409f-9f5e-24c99a009299 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:41:24.518527 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b653a7c3-4857-409f-9f5e-24c99a009299 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:41:24.541393 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1288/2563] 10.222.0.117 () {60 vars in 1148 bytes} [Tue Jan 25 02:41:24 2022] POST /identity/v3/users => generated 293 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 02:41:24.545312 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372ce052-ee26-4547-a0d0-e7e117b6e3cb admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:41:24.557479 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372ce052-ee26-4547-a0d0-e7e117b6e3cb admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:41:24.563951 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fdcd75-36ee-4eff-bd97-351fb4fe56ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:41:24.564873 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fdcd75-36ee-4eff-bd97-351fb4fe56ee admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:41:24.565350 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fdcd75-36ee-4eff-bd97-351fb4fe56ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:41:24.565801 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fdcd75-36ee-4eff-bd97-351fb4fe56ee admin admin] PATH_INFO: `/v3/roles` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:41:24.567052 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fdcd75-36ee-4eff-bd97-351fb4fe56ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:41:24.569752 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fdcd75-36ee-4eff-bd97-351fb4fe56ee admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:41:24.592041 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1276/2564] 10.222.0.117 () {58 vars in 1126 bytes} [Tue Jan 25 02:41:24 2022] GET /identity/v3/roles => generated 1427 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 02:41:24.593475 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b653a7c3-4857-409f-9f5e-24c99a009299 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:41:24.604764 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b653a7c3-4857-409f-9f5e-24c99a009299 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:41:24.611299 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6198c9-28ea-4fb9-99b5-252135fc0a9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:41:24.612189 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6198c9-28ea-4fb9-99b5-252135fc0a9d admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:41:24.612984 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6198c9-28ea-4fb9-99b5-252135fc0a9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:41:24.613328 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6198c9-28ea-4fb9-99b5-252135fc0a9d admin admin] PATH_INFO: `/v3/roles` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:41:24.614152 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6198c9-28ea-4fb9-99b5-252135fc0a9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:41:24.616026 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6198c9-28ea-4fb9-99b5-252135fc0a9d admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:41:24.629882 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1289/2565] 10.222.0.117 () {58 vars in 1126 bytes} [Tue Jan 25 02:41:24 2022] GET /identity/v3/roles => generated 1427 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 02:41:24.631077 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fdcd75-36ee-4eff-bd97-351fb4fe56ee admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:41:24.641354 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fdcd75-36ee-4eff-bd97-351fb4fe56ee admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:41:24.661789 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ad9c22-6f0c-4901-bd31-985a87a819c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:41:24.662685 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ad9c22-6f0c-4901-bd31-985a87a819c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:41:24.662969 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ad9c22-6f0c-4901-bd31-985a87a819c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:41:24.663249 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ad9c22-6f0c-4901-bd31-985a87a819c5 admin admin] PATH_INFO: `/v3/projects/cd072a2c1fdf4a0680a9708c776ebc2e/users/87313f5e4f684c78be0398d39acfc770/roles/33a8e87420ed423f9cb29e0084eab5d2` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:41:24.675675 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6198c9-28ea-4fb9-99b5-252135fc0a9d admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:41:24.678429 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-7d6198c9-28ea-4fb9-99b5-252135fc0a9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:41:24.693549 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ad9c22-6f0c-4901-bd31-985a87a819c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd072a2c1fdf4a0680a9708c776ebc2e, user_id=87313f5e4f684c78be0398d39acfc770, role_id=33a8e87420ed423f9cb29e0084eab5d2)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:41:24.696295 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ad9c22-6f0c-4901-bd31-985a87a819c5 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:41:24.718675 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1277/2566] 10.222.0.117 () {60 vars in 1487 bytes} [Tue Jan 25 02:41:24 2022] PUT /identity/v3/projects/cd072a2c1fdf4a0680a9708c776ebc2e/users/87313f5e4f684c78be0398d39acfc770/roles/33a8e87420ed423f9cb29e0084eab5d2 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:41:24.730711 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dc955a-f6b2-4b60-8f17-fcebe38e9ac4 None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:41:24.731279 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dc955a-f6b2-4b60-8f17-fcebe38e9ac4 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:41:24.731983 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dc955a-f6b2-4b60-8f17-fcebe38e9ac4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:41:24.786214 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-a5dc955a-f6b2-4b60-8f17-fcebe38e9ac4 None None] MFA Rules not processed for user `87313f5e4f684c78be0398d39acfc770`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:41:24.787477 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-a5dc955a-f6b2-4b60-8f17-fcebe38e9ac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:41:24.818887 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6198c9-28ea-4fb9-99b5-252135fc0a9d admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:41:24.930413 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1278/2567] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:41:24 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 25 02:41:24.936139 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40fd420-31c7-4536-ba76-bb38adee5f3b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9ad6269900346458050063c12cac299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:41:24.937035 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40fd420-31c7-4536-ba76-bb38adee5f3b service nova] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:41:24.938180 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40fd420-31c7-4536-ba76-bb38adee5f3b service nova] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:41:24.938698 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40fd420-31c7-4536-ba76-bb38adee5f3b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:41:24.945558 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-d40fd420-31c7-4536-ba76-bb38adee5f3b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:41:24.955201 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dc955a-f6b2-4b60-8f17-fcebe38e9ac4 None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:41:24.962142 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40fd420-31c7-4536-ba76-bb38adee5f3b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:41:24.966340 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40fd420-31c7-4536-ba76-bb38adee5f3b service nova] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:41:24.980791 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1290/2568] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:41:24 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:41:25.061749 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dc955a-f6b2-4b60-8f17-fcebe38e9ac4 None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:41:25.076623 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c830deaa-e08f-4ed1-a238-51a060211d64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:41:25.077940 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c830deaa-e08f-4ed1-a238-51a060211d64 admin admin] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:41:25.078450 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c830deaa-e08f-4ed1-a238-51a060211d64 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:41:25.078566 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c830deaa-e08f-4ed1-a238-51a060211d64 admin admin] PATH_INFO: `/v3/projects` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:41:25.079802 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c830deaa-e08f-4ed1-a238-51a060211d64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:41:25.082457 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c830deaa-e08f-4ed1-a238-51a060211d64 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:41:25.094249 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40fd420-31c7-4536-ba76-bb38adee5f3b service nova] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:41:25.095593 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-d40fd420-31c7-4536-ba76-bb38adee5f3b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:41:25.124280 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1279/2569] 10.222.0.117 () {60 vars in 1157 bytes} [Tue Jan 25 02:41:24 2022] POST /identity/v3/projects => generated 386 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 02:41:25.128195 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c830deaa-e08f-4ed1-a238-51a060211d64 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:41:25.170743 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40fd420-31c7-4536-ba76-bb38adee5f3b service nova] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:41:25.204619 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c830deaa-e08f-4ed1-a238-51a060211d64 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:41:25.210284 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0421071a-73a2-44d8-936b-d7431d7abbaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:41:25.210956 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0421071a-73a2-44d8-936b-d7431d7abbaf admin admin] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:41:25.211235 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0421071a-73a2-44d8-936b-d7431d7abbaf admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:41:25.211505 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0421071a-73a2-44d8-936b-d7431d7abbaf admin admin] PATH_INFO: `/v3/users` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:41:25.212415 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0421071a-73a2-44d8-936b-d7431d7abbaf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:41:25.215301 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0421071a-73a2-44d8-936b-d7431d7abbaf admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:41:25.232244 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2b2057-9ecd-4888-a91b-99f71e81befd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca4071c5f8f4a31b5edb81fa66a43a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:41:25.232842 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2b2057-9ecd-4888-a91b-99f71e81befd service neutron] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:41:25.233195 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2b2057-9ecd-4888-a91b-99f71e81befd service neutron] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:41:25.233467 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2b2057-9ecd-4888-a91b-99f71e81befd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:41:25.235331 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-aa2b2057-9ecd-4888-a91b-99f71e81befd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:41:25.241140 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1280/2570] 10.222.0.117 () {60 vars in 1148 bytes} [Tue Jan 25 02:41:25 2022] POST /identity/v3/users => generated 300 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 02:41:25.242815 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0421071a-73a2-44d8-936b-d7431d7abbaf admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:41:25.246382 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2b2057-9ecd-4888-a91b-99f71e81befd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:41:25.249028 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2b2057-9ecd-4888-a91b-99f71e81befd service neutron] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:41:25.253718 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0421071a-73a2-44d8-936b-d7431d7abbaf admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:41:25.258140 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1291/2571] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:41:25 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:41:25.258874 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752c835e-0206-4a9b-8ffa-47a73f158a28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:41:25.259536 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752c835e-0206-4a9b-8ffa-47a73f158a28 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:41:25.259857 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752c835e-0206-4a9b-8ffa-47a73f158a28 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:41:25.260663 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752c835e-0206-4a9b-8ffa-47a73f158a28 admin admin] PATH_INFO: `/v3/roles` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:41:25.261459 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752c835e-0206-4a9b-8ffa-47a73f158a28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:41:25.263099 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752c835e-0206-4a9b-8ffa-47a73f158a28 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:41:25.273648 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1281/2572] 10.222.0.117 () {58 vars in 1126 bytes} [Tue Jan 25 02:41:25 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 02:41:25.278490 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2b2057-9ecd-4888-a91b-99f71e81befd service neutron] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:41:25.289705 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2b2057-9ecd-4888-a91b-99f71e81befd service neutron] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:41:25.295348 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9622f73-acdd-466a-acd0-233c397ad84d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:41:25.296884 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9622f73-acdd-466a-acd0-233c397ad84d admin admin] REQUEST_METHOD: `PUT` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:41:25.297174 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9622f73-acdd-466a-acd0-233c397ad84d admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:41:25.297450 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9622f73-acdd-466a-acd0-233c397ad84d admin admin] PATH_INFO: `/v3/projects/f6cf9fd1dd88429ca5ec598e4e584c0a/users/37ce7328b7854a86a1699193a80261bd/roles/d8dbc6d83d9d41d28c3feb8b3485b291` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:41:25.312867 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9622f73-acdd-466a-acd0-233c397ad84d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6cf9fd1dd88429ca5ec598e4e584c0a, user_id=37ce7328b7854a86a1699193a80261bd, role_id=d8dbc6d83d9d41d28c3feb8b3485b291)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:41:25.316370 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9622f73-acdd-466a-acd0-233c397ad84d admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:41:25.330009 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1292/2573] 10.222.0.117 () {60 vars in 1487 bytes} [Tue Jan 25 02:41:25 2022] PUT /identity/v3/projects/f6cf9fd1dd88429ca5ec598e4e584c0a/users/37ce7328b7854a86a1699193a80261bd/roles/d8dbc6d83d9d41d28c3feb8b3485b291 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:41:25.333907 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752c835e-0206-4a9b-8ffa-47a73f158a28 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:41:25.344704 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752c835e-0206-4a9b-8ffa-47a73f158a28 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:41:25.399965 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57874b44-9ba4-454b-95ea-5c4565c159d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:41:25.400691 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57874b44-9ba4-454b-95ea-5c4565c159d4 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:41:25.401525 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57874b44-9ba4-454b-95ea-5c4565c159d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:41:25.401805 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57874b44-9ba4-454b-95ea-5c4565c159d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:41:25.402646 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57874b44-9ba4-454b-95ea-5c4565c159d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:41:25.404316 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57874b44-9ba4-454b-95ea-5c4565c159d4 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:41:25.414293 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1282/2574] 10.222.0.117 () {58 vars in 1126 bytes} [Tue Jan 25 02:41:25 2022] GET /identity/v3/roles => generated 1427 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 02:41:25.419192 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9622f73-acdd-466a-acd0-233c397ad84d admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:41:25.429425 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9622f73-acdd-466a-acd0-233c397ad84d admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:41:25.434165 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c50a3a-47d8-4780-87e8-d8d89c23cfb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:41:25.435048 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c50a3a-47d8-4780-87e8-d8d89c23cfb1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:41:25.435337 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c50a3a-47d8-4780-87e8-d8d89c23cfb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:41:25.435615 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c50a3a-47d8-4780-87e8-d8d89c23cfb1 admin admin] PATH_INFO: `/v3/projects/f6cf9fd1dd88429ca5ec598e4e584c0a/users/37ce7328b7854a86a1699193a80261bd/roles/d8dbc6d83d9d41d28c3feb8b3485b291` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:41:25.437665 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c50a3a-47d8-4780-87e8-d8d89c23cfb1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6cf9fd1dd88429ca5ec598e4e584c0a, user_id=37ce7328b7854a86a1699193a80261bd, role_id=d8dbc6d83d9d41d28c3feb8b3485b291)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:41:25.440367 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c50a3a-47d8-4780-87e8-d8d89c23cfb1 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:41:25.451272 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1293/2575] 10.222.0.117 () {60 vars in 1487 bytes} [Tue Jan 25 02:41:25 2022] PUT /identity/v3/projects/f6cf9fd1dd88429ca5ec598e4e584c0a/users/37ce7328b7854a86a1699193a80261bd/roles/d8dbc6d83d9d41d28c3feb8b3485b291 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 25 02:41:25.461520 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ede540-da80-4274-80f4-8832f105fd8f None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:41:25.461884 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ede540-da80-4274-80f4-8832f105fd8f None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:41:25.462237 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ede540-da80-4274-80f4-8832f105fd8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:41:25.490330 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-f4ede540-da80-4274-80f4-8832f105fd8f None None] MFA Rules not processed for user `37ce7328b7854a86a1699193a80261bd`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:41:25.491555 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-f4ede540-da80-4274-80f4-8832f105fd8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:41:25.563715 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1283/2576] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:41:25 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:41:25.574252 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c50a3a-47d8-4780-87e8-d8d89c23cfb1 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:41:25.576068 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-21c50a3a-47d8-4780-87e8-d8d89c23cfb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:41:25.640697 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c50a3a-47d8-4780-87e8-d8d89c23cfb1 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:41:25.644538 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce404160-5a3b-44f2-addb-ca5307bff7d4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cc5249aea09430080e232cf17757f86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:41:25.645188 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce404160-5a3b-44f2-addb-ca5307bff7d4 service cinder] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:41:25.645475 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce404160-5a3b-44f2-addb-ca5307bff7d4 service cinder] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:41:25.645755 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce404160-5a3b-44f2-addb-ca5307bff7d4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:41:25.707158 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce404160-5a3b-44f2-addb-ca5307bff7d4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:41:25.708678 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce404160-5a3b-44f2-addb-ca5307bff7d4 service cinder] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:41:25.718840 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1294/2577] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:41:25 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:41:26.524908 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ede540-da80-4274-80f4-8832f105fd8f None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:41:26.527351 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-f4ede540-da80-4274-80f4-8832f105fd8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:41:26.569120 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce404160-5a3b-44f2-addb-ca5307bff7d4 service cinder] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:41:26.578295 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce404160-5a3b-44f2-addb-ca5307bff7d4 service cinder] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:41:26.583901 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975d4403-7f6d-40b0-8010-0f49417ddb7d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cc5249aea09430080e232cf17757f86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:41:26.584550 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975d4403-7f6d-40b0-8010-0f49417ddb7d service cinder] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:41:26.585095 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975d4403-7f6d-40b0-8010-0f49417ddb7d service cinder] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:41:26.585702 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975d4403-7f6d-40b0-8010-0f49417ddb7d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:41:26.588180 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-975d4403-7f6d-40b0-8010-0f49417ddb7d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:41:26.615322 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ede540-da80-4274-80f4-8832f105fd8f None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:41:26.622438 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0258df-9fcd-4c98-88cf-ff16d64cb353 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9ad6269900346458050063c12cac299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:41:26.623254 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0258df-9fcd-4c98-88cf-ff16d64cb353 service nova] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:41:26.623640 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0258df-9fcd-4c98-88cf-ff16d64cb353 service nova] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:41:26.624038 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0258df-9fcd-4c98-88cf-ff16d64cb353 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:41:26.626158 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-be0258df-9fcd-4c98-88cf-ff16d64cb353 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:41:26.638813 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0258df-9fcd-4c98-88cf-ff16d64cb353 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:41:26.640510 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0258df-9fcd-4c98-88cf-ff16d64cb353 service nova] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:41:26.652788 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1284/2578] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:41:26 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:41:26.680219 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975d4403-7f6d-40b0-8010-0f49417ddb7d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:41:26.681698 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975d4403-7f6d-40b0-8010-0f49417ddb7d service cinder] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:41:26.694884 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1295/2579] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:41:26 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:41:27.212349 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0258df-9fcd-4c98-88cf-ff16d64cb353 service nova] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:41:27.214445 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-be0258df-9fcd-4c98-88cf-ff16d64cb353 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:41:27.227991 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0258df-9fcd-4c98-88cf-ff16d64cb353 service nova] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:41:27.235035 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bf91e5-023a-47cd-a4b3-1256c34a03ce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cc5249aea09430080e232cf17757f86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:41:27.235035 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bf91e5-023a-47cd-a4b3-1256c34a03ce service cinder] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:41:27.235035 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bf91e5-023a-47cd-a4b3-1256c34a03ce service cinder] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:41:27.235035 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bf91e5-023a-47cd-a4b3-1256c34a03ce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:41:27.300447 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bf91e5-023a-47cd-a4b3-1256c34a03ce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:41:27.301922 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bf91e5-023a-47cd-a4b3-1256c34a03ce service cinder] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:41:27.311835 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1285/2580] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:41:27 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:41:27.852180 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975d4403-7f6d-40b0-8010-0f49417ddb7d service cinder] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:41:27.861880 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975d4403-7f6d-40b0-8010-0f49417ddb7d service cinder] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:41:27.865588 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1198c8e-5e43-4a5e-8200-ff9ba0bd01b5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cc5249aea09430080e232cf17757f86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:41:27.866236 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1198c8e-5e43-4a5e-8200-ff9ba0bd01b5 service cinder] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:41:27.866520 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1198c8e-5e43-4a5e-8200-ff9ba0bd01b5 service cinder] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:41:27.866796 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1198c8e-5e43-4a5e-8200-ff9ba0bd01b5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:41:27.875790 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1198c8e-5e43-4a5e-8200-ff9ba0bd01b5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:41:27.877241 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1198c8e-5e43-4a5e-8200-ff9ba0bd01b5 service cinder] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:41:27.887001 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1296/2581] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:41:27 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:41:31.688455 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bf91e5-023a-47cd-a4b3-1256c34a03ce service cinder] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:41:31.701030 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bf91e5-023a-47cd-a4b3-1256c34a03ce service cinder] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:41:31.707133 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060dee95-8e0b-437f-a418-7d8ea4438dbc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9ad6269900346458050063c12cac299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:41:31.707814 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060dee95-8e0b-437f-a418-7d8ea4438dbc service nova] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:41:31.708103 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060dee95-8e0b-437f-a418-7d8ea4438dbc service nova] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:41:31.708383 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060dee95-8e0b-437f-a418-7d8ea4438dbc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:41:31.710204 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-060dee95-8e0b-437f-a418-7d8ea4438dbc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:41:31.722590 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1198c8e-5e43-4a5e-8200-ff9ba0bd01b5 service cinder] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:41:31.770350 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060dee95-8e0b-437f-a418-7d8ea4438dbc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:41:31.771908 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060dee95-8e0b-437f-a418-7d8ea4438dbc service nova] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:41:31.780969 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1286/2582] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:41:31 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:41:31.781837 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060dee95-8e0b-437f-a418-7d8ea4438dbc service nova] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:41:31.784031 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1198c8e-5e43-4a5e-8200-ff9ba0bd01b5 service cinder] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:41:31.793055 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4959ab86-d8f4-4e57-82ff-7a21ca1ac2bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:41:31.794825 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4959ab86-d8f4-4e57-82ff-7a21ca1ac2bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:41:31.795175 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4959ab86-d8f4-4e57-82ff-7a21ca1ac2bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:41:31.795383 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4959ab86-d8f4-4e57-82ff-7a21ca1ac2bf admin admin] PATH_INFO: `/v3/users/b0bf2e17bf06453a8775711a193e3a74` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:41:31.798240 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4959ab86-d8f4-4e57-82ff-7a21ca1ac2bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0bf2e17bf06453a8775711a193e3a74)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:41:31.800306 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4959ab86-d8f4-4e57-82ff-7a21ca1ac2bf admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:41:31.842063 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060dee95-8e0b-437f-a418-7d8ea4438dbc service nova] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:41:31.847201 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c8e5db-0945-40c6-b3e2-b6c0400f5918 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca4071c5f8f4a31b5edb81fa66a43a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:41:31.847880 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c8e5db-0945-40c6-b3e2-b6c0400f5918 service neutron] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:41:31.848165 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c8e5db-0945-40c6-b3e2-b6c0400f5918 service neutron] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:41:31.848437 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c8e5db-0945-40c6-b3e2-b6c0400f5918 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:41:31.854483 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-4959ab86-d8f4-4e57-82ff-7a21ca1ac2bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0bf2e17bf06453a8775711a193e3a74'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:41:31.856595 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-4959ab86-d8f4-4e57-82ff-7a21ca1ac2bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0bf2e17bf06453a8775711a193e3a74'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:41:31.858691 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c8e5db-0945-40c6-b3e2-b6c0400f5918 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:41:31.860328 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c8e5db-0945-40c6-b3e2-b6c0400f5918 service neutron] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:41:31.865129 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-4959ab86-d8f4-4e57-82ff-7a21ca1ac2bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0bf2e17bf06453a8775711a193e3a74'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:41:31.865901 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-4959ab86-d8f4-4e57-82ff-7a21ca1ac2bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0bf2e17bf06453a8775711a193e3a74'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:41:31.871906 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1287/2583] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:41:31 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:41:31.875170 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-4959ab86-d8f4-4e57-82ff-7a21ca1ac2bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0bf2e17bf06453a8775711a193e3a74'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:41:31.896307 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1297/2584] 10.222.0.117 () {58 vars in 1228 bytes} [Tue Jan 25 02:41:31 2022] DELETE /identity/v3/users/b0bf2e17bf06453a8775711a193e3a74 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 25 02:41:31.898096 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8dede7-2255-4045-9780-d2b60abb0593 None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:41:31.898331 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8dede7-2255-4045-9780-d2b60abb0593 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:41:31.898610 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8dede7-2255-4045-9780-d2b60abb0593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:41:31.917062 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-0c8dede7-2255-4045-9780-d2b60abb0593 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:41:31.919233 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-0c8dede7-2255-4045-9780-d2b60abb0593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:41:31.993428 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1288/2585] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:41:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:41:32.003901 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4959ab86-d8f4-4e57-82ff-7a21ca1ac2bf admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:41:32.005331 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-4959ab86-d8f4-4e57-82ff-7a21ca1ac2bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:41:32.062774 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4959ab86-d8f4-4e57-82ff-7a21ca1ac2bf admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:41:32.066487 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8685760-0ae6-4747-a2ca-47edce9a024b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca4071c5f8f4a31b5edb81fa66a43a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:41:32.067128 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8685760-0ae6-4747-a2ca-47edce9a024b service neutron] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:41:32.067411 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8685760-0ae6-4747-a2ca-47edce9a024b service neutron] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:41:32.067685 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8685760-0ae6-4747-a2ca-47edce9a024b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:41:32.076897 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8685760-0ae6-4747-a2ca-47edce9a024b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:41:32.078613 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8685760-0ae6-4747-a2ca-47edce9a024b service neutron] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:41:32.088071 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1298/2586] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:41:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:41:32.373242 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8dede7-2255-4045-9780-d2b60abb0593 None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:41:32.374819 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-0c8dede7-2255-4045-9780-d2b60abb0593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:41:32.394386 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8dede7-2255-4045-9780-d2b60abb0593 None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:41:32.399232 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfacc8f7-f72e-4712-846b-b4f519f8c86f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:41:32.400149 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfacc8f7-f72e-4712-846b-b4f519f8c86f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:41:32.400429 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfacc8f7-f72e-4712-846b-b4f519f8c86f admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:41:32.400696 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfacc8f7-f72e-4712-846b-b4f519f8c86f admin admin] PATH_INFO: `/v3/projects/917ede0b8b0f45628bb3d610f324ffeb` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:41:32.403196 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfacc8f7-f72e-4712-846b-b4f519f8c86f admin admin] RBAC: Authorizing `identity:delete_project(project_id=917ede0b8b0f45628bb3d610f324ffeb)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:41:32.405397 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfacc8f7-f72e-4712-846b-b4f519f8c86f admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:41:32.474247 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-dfacc8f7-f72e-4712-846b-b4f519f8c86f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '917ede0b8b0f45628bb3d610f324ffeb', 'request_id': 'req-dfacc8f7-f72e-4712-846b-b4f519f8c86f'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:41:32.482739 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-dfacc8f7-f72e-4712-846b-b4f519f8c86f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '917ede0b8b0f45628bb3d610f324ffeb', 'request_id': 'req-dfacc8f7-f72e-4712-846b-b4f519f8c86f'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:41:32.489978 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-dfacc8f7-f72e-4712-846b-b4f519f8c86f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '917ede0b8b0f45628bb3d610f324ffeb', 'request_id': 'req-dfacc8f7-f72e-4712-846b-b4f519f8c86f'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:41:32.519932 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-dfacc8f7-f72e-4712-846b-b4f519f8c86f admin admin] The token cache is being invalidate because project 917ede0b8b0f45628bb3d610f324ffeb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79120) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 25 02:41:32.520240 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-dfacc8f7-f72e-4712-846b-b4f519f8c86f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:41:32.521040 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-dfacc8f7-f72e-4712-846b-b4f519f8c86f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:41:32.523619 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1289/2587] 10.222.0.117 () {58 vars in 1237 bytes} [Tue Jan 25 02:41:32 2022] DELETE /identity/v3/projects/917ede0b8b0f45628bb3d610f324ffeb => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:41:32.528188 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8685760-0ae6-4747-a2ca-47edce9a024b service neutron] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:41:32.545921 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8685760-0ae6-4747-a2ca-47edce9a024b service neutron] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:41:32.633625 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3956024-260a-4186-8180-3edac3cdf973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:41:32.634705 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3956024-260a-4186-8180-3edac3cdf973 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:41:32.635232 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3956024-260a-4186-8180-3edac3cdf973 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:41:32.635584 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3956024-260a-4186-8180-3edac3cdf973 admin admin] PATH_INFO: `/v3/users/87313f5e4f684c78be0398d39acfc770` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:41:32.637288 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3956024-260a-4186-8180-3edac3cdf973 admin admin] RBAC: Authorizing `identity:delete_user(user_id=87313f5e4f684c78be0398d39acfc770)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:41:32.639398 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3956024-260a-4186-8180-3edac3cdf973 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:41:32.702910 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-f3956024-260a-4186-8180-3edac3cdf973 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87313f5e4f684c78be0398d39acfc770'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:41:32.703574 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-f3956024-260a-4186-8180-3edac3cdf973 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87313f5e4f684c78be0398d39acfc770'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:41:32.710393 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-f3956024-260a-4186-8180-3edac3cdf973 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87313f5e4f684c78be0398d39acfc770'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:41:32.711048 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-f3956024-260a-4186-8180-3edac3cdf973 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87313f5e4f684c78be0398d39acfc770'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:41:32.718779 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-f3956024-260a-4186-8180-3edac3cdf973 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87313f5e4f684c78be0398d39acfc770'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:41:32.736500 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1299/2588] 10.222.0.117 () {58 vars in 1228 bytes} [Tue Jan 25 02:41:32 2022] DELETE /identity/v3/users/87313f5e4f684c78be0398d39acfc770 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:41:33.294431 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfacc8f7-f72e-4712-846b-b4f519f8c86f admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:41:33.296033 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-dfacc8f7-f72e-4712-846b-b4f519f8c86f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:41:33.312019 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfacc8f7-f72e-4712-846b-b4f519f8c86f admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:41:33.374499 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04625f31-f88d-4dc1-ab1d-5279fdd2de96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:41:33.375343 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04625f31-f88d-4dc1-ab1d-5279fdd2de96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:41:33.375634 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04625f31-f88d-4dc1-ab1d-5279fdd2de96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:41:33.375951 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04625f31-f88d-4dc1-ab1d-5279fdd2de96 admin admin] PATH_INFO: `/v3/projects/cd072a2c1fdf4a0680a9708c776ebc2e` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:41:33.377190 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04625f31-f88d-4dc1-ab1d-5279fdd2de96 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd072a2c1fdf4a0680a9708c776ebc2e)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:41:33.379151 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04625f31-f88d-4dc1-ab1d-5279fdd2de96 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:41:33.426430 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-04625f31-f88d-4dc1-ab1d-5279fdd2de96 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd072a2c1fdf4a0680a9708c776ebc2e', 'request_id': 'req-04625f31-f88d-4dc1-ab1d-5279fdd2de96'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:41:33.431672 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-04625f31-f88d-4dc1-ab1d-5279fdd2de96 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd072a2c1fdf4a0680a9708c776ebc2e', 'request_id': 'req-04625f31-f88d-4dc1-ab1d-5279fdd2de96'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:41:33.437987 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-04625f31-f88d-4dc1-ab1d-5279fdd2de96 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd072a2c1fdf4a0680a9708c776ebc2e', 'request_id': 'req-04625f31-f88d-4dc1-ab1d-5279fdd2de96'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:41:33.451002 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-04625f31-f88d-4dc1-ab1d-5279fdd2de96 admin admin] The token cache is being invalidate because project cd072a2c1fdf4a0680a9708c776ebc2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79120) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 25 02:41:33.451365 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-04625f31-f88d-4dc1-ab1d-5279fdd2de96 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:41:33.452324 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-04625f31-f88d-4dc1-ab1d-5279fdd2de96 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:41:33.454152 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1290/2589] 10.222.0.117 () {58 vars in 1237 bytes} [Tue Jan 25 02:41:33 2022] DELETE /identity/v3/projects/cd072a2c1fdf4a0680a9708c776ebc2e => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:41:33.458098 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3956024-260a-4186-8180-3edac3cdf973 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:41:33.459511 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-f3956024-260a-4186-8180-3edac3cdf973 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:41:33.472921 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3956024-260a-4186-8180-3edac3cdf973 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:41:33.527669 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec76a4cb-d6da-435c-951a-67b7c9480265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:41:33.528569 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec76a4cb-d6da-435c-951a-67b7c9480265 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:41:33.528855 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec76a4cb-d6da-435c-951a-67b7c9480265 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:41:33.529131 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec76a4cb-d6da-435c-951a-67b7c9480265 admin admin] PATH_INFO: `/v3/users/37ce7328b7854a86a1699193a80261bd` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:41:33.530405 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec76a4cb-d6da-435c-951a-67b7c9480265 admin admin] RBAC: Authorizing `identity:delete_user(user_id=37ce7328b7854a86a1699193a80261bd)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:41:33.532437 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec76a4cb-d6da-435c-951a-67b7c9480265 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:41:33.579344 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-ec76a4cb-d6da-435c-951a-67b7c9480265 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37ce7328b7854a86a1699193a80261bd'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:41:33.580032 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-ec76a4cb-d6da-435c-951a-67b7c9480265 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37ce7328b7854a86a1699193a80261bd'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:41:33.586774 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-ec76a4cb-d6da-435c-951a-67b7c9480265 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37ce7328b7854a86a1699193a80261bd'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:41:33.587491 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-ec76a4cb-d6da-435c-951a-67b7c9480265 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37ce7328b7854a86a1699193a80261bd'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:41:33.595661 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-ec76a4cb-d6da-435c-951a-67b7c9480265 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37ce7328b7854a86a1699193a80261bd'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:41:33.613238 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1300/2590] 10.222.0.117 () {58 vars in 1228 bytes} [Tue Jan 25 02:41:33 2022] DELETE /identity/v3/users/37ce7328b7854a86a1699193a80261bd => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:41:33.887120 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04625f31-f88d-4dc1-ab1d-5279fdd2de96 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:41:33.888593 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-04625f31-f88d-4dc1-ab1d-5279fdd2de96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:41:33.907737 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04625f31-f88d-4dc1-ab1d-5279fdd2de96 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:41:33.976555 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ff65ac-ad3e-49cb-b10a-70530eef3bf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:41:33.977422 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ff65ac-ad3e-49cb-b10a-70530eef3bf0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:41:33.977706 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ff65ac-ad3e-49cb-b10a-70530eef3bf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:41:33.977984 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ff65ac-ad3e-49cb-b10a-70530eef3bf0 admin admin] PATH_INFO: `/v3/projects/f6cf9fd1dd88429ca5ec598e4e584c0a` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:41:33.979192 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ff65ac-ad3e-49cb-b10a-70530eef3bf0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6cf9fd1dd88429ca5ec598e4e584c0a)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:41:33.981370 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ff65ac-ad3e-49cb-b10a-70530eef3bf0 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:41:34.028840 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-30ff65ac-ad3e-49cb-b10a-70530eef3bf0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6cf9fd1dd88429ca5ec598e4e584c0a', 'request_id': 'req-30ff65ac-ad3e-49cb-b10a-70530eef3bf0'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:41:34.034452 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-30ff65ac-ad3e-49cb-b10a-70530eef3bf0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6cf9fd1dd88429ca5ec598e4e584c0a', 'request_id': 'req-30ff65ac-ad3e-49cb-b10a-70530eef3bf0'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:41:34.040584 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-30ff65ac-ad3e-49cb-b10a-70530eef3bf0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6cf9fd1dd88429ca5ec598e4e584c0a', 'request_id': 'req-30ff65ac-ad3e-49cb-b10a-70530eef3bf0'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:41:34.052755 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-30ff65ac-ad3e-49cb-b10a-70530eef3bf0 admin admin] The token cache is being invalidate because project f6cf9fd1dd88429ca5ec598e4e584c0a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79120) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 25 02:41:34.053068 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-30ff65ac-ad3e-49cb-b10a-70530eef3bf0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:41:34.053693 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-30ff65ac-ad3e-49cb-b10a-70530eef3bf0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:41:34.055366 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1291/2591] 10.222.0.117 () {58 vars in 1237 bytes} [Tue Jan 25 02:41:33 2022] DELETE /identity/v3/projects/f6cf9fd1dd88429ca5ec598e4e584c0a => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:41:34.061620 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ed01fd-fffd-4d8b-86ec-20f943b92576 None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:41:34.062106 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ed01fd-fffd-4d8b-86ec-20f943b92576 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:41:34.062192 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ed01fd-fffd-4d8b-86ec-20f943b92576 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:41:34.080720 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-b7ed01fd-fffd-4d8b-86ec-20f943b92576 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:41:34.081932 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-b7ed01fd-fffd-4d8b-86ec-20f943b92576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:41:34.142281 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1301/2592] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:41:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:41:34.150230 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db1af0a-ea0b-41ad-b265-b667a58f9c81 None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:41:34.150809 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db1af0a-ea0b-41ad-b265-b667a58f9c81 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:41:34.151383 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db1af0a-ea0b-41ad-b265-b667a58f9c81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:41:34.177634 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-0db1af0a-ea0b-41ad-b265-b667a58f9c81 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:41:34.179210 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-0db1af0a-ea0b-41ad-b265-b667a58f9c81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:41:34.195546 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1292/2593] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:41:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:41:34.196761 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ed01fd-fffd-4d8b-86ec-20f943b92576 None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:41:34.208931 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ed01fd-fffd-4d8b-86ec-20f943b92576 None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:41:34.223425 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad55aff-83e7-4edd-bf28-2e54dd790607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:41:34.224216 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad55aff-83e7-4edd-bf28-2e54dd790607 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:41:34.224572 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad55aff-83e7-4edd-bf28-2e54dd790607 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:41:34.224920 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad55aff-83e7-4edd-bf28-2e54dd790607 admin admin] PATH_INFO: `/v3/domains` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:41:34.225749 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad55aff-83e7-4edd-bf28-2e54dd790607 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:41:34.226130 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad55aff-83e7-4edd-bf28-2e54dd790607 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:41:34.227858 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad55aff-83e7-4edd-bf28-2e54dd790607 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:41:34.244937 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1302/2594] 10.222.0.117 () {58 vars in 1157 bytes} [Tue Jan 25 02:41:34 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:41:34.249973 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db1af0a-ea0b-41ad-b265-b667a58f9c81 None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:41:34.252290 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e4d672-0c1f-457b-99de-a986221a7c79 None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:41:34.252663 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e4d672-0c1f-457b-99de-a986221a7c79 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:41:34.253017 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e4d672-0c1f-457b-99de-a986221a7c79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:41:34.262689 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db1af0a-ea0b-41ad-b265-b667a58f9c81 None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:41:34.267997 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39aecf7-f29d-4fdf-9d7e-297c99cb2ac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:41:34.268902 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39aecf7-f29d-4fdf-9d7e-297c99cb2ac8 admin admin] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:41:34.269264 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39aecf7-f29d-4fdf-9d7e-297c99cb2ac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:41:34.269614 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39aecf7-f29d-4fdf-9d7e-297c99cb2ac8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:41:34.270832 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39aecf7-f29d-4fdf-9d7e-297c99cb2ac8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:41:34.272991 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39aecf7-f29d-4fdf-9d7e-297c99cb2ac8 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:41:34.277376 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-15e4d672-0c1f-457b-99de-a986221a7c79 None None] MFA Rules not processed for user `5924414ee6e948a680b8b75c8797b466`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:41:34.278858 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-15e4d672-0c1f-457b-99de-a986221a7c79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:41:34.303742 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1293/2595] 10.222.0.117 () {60 vars in 1157 bytes} [Tue Jan 25 02:41:34 2022] POST /identity/v3/projects => generated 366 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 25 02:41:34.307998 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39aecf7-f29d-4fdf-9d7e-297c99cb2ac8 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:41:34.337214 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1303/2596] 10.222.0.117 () {58 vars in 972 bytes} [Tue Jan 25 02:41:34 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:41:34.354350 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e4d672-0c1f-457b-99de-a986221a7c79 None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:41:34.360510 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-15e4d672-0c1f-457b-99de-a986221a7c79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:41:34.381175 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39aecf7-f29d-4fdf-9d7e-297c99cb2ac8 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:41:34.386098 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e917662b-7c12-4c5f-8cef-5568d44dca92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:41:34.386893 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e917662b-7c12-4c5f-8cef-5568d44dca92 admin admin] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:41:34.387088 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e917662b-7c12-4c5f-8cef-5568d44dca92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:41:34.387493 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e917662b-7c12-4c5f-8cef-5568d44dca92 admin admin] PATH_INFO: `/v3/users` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:41:34.388249 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e917662b-7c12-4c5f-8cef-5568d44dca92 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:41:34.390919 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e917662b-7c12-4c5f-8cef-5568d44dca92 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:41:34.413015 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1294/2597] 10.222.0.117 () {60 vars in 1148 bytes} [Tue Jan 25 02:41:34 2022] POST /identity/v3/users => generated 284 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 02:41:34.417201 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e917662b-7c12-4c5f-8cef-5568d44dca92 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:41:34.428003 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e917662b-7c12-4c5f-8cef-5568d44dca92 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:41:34.433222 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71448f98-d37d-4e31-aaa6-58a8737d3fa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:41:34.434083 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71448f98-d37d-4e31-aaa6-58a8737d3fa8 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:41:34.434408 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71448f98-d37d-4e31-aaa6-58a8737d3fa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:41:34.434687 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71448f98-d37d-4e31-aaa6-58a8737d3fa8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:41:34.435440 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71448f98-d37d-4e31-aaa6-58a8737d3fa8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:41:34.437220 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71448f98-d37d-4e31-aaa6-58a8737d3fa8 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:41:34.447401 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1295/2598] 10.222.0.117 () {58 vars in 1126 bytes} [Tue Jan 25 02:41:34 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 02:41:34.451322 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71448f98-d37d-4e31-aaa6-58a8737d3fa8 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:41:34.453514 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e4d672-0c1f-457b-99de-a986221a7c79 None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:41:34.463834 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71448f98-d37d-4e31-aaa6-58a8737d3fa8 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:41:34.469814 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7a68bc-d24a-49e6-948d-7f17b35f2f72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:41:34.470487 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7a68bc-d24a-49e6-948d-7f17b35f2f72 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:41:34.471238 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7a68bc-d24a-49e6-948d-7f17b35f2f72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:41:34.471525 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7a68bc-d24a-49e6-948d-7f17b35f2f72 admin admin] PATH_INFO: `/v3/roles` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:41:34.472297 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7a68bc-d24a-49e6-948d-7f17b35f2f72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:41:34.474585 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7a68bc-d24a-49e6-948d-7f17b35f2f72 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:41:34.486392 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1296/2599] 10.222.0.117 () {58 vars in 1126 bytes} [Tue Jan 25 02:41:34 2022] GET /identity/v3/roles => generated 1427 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 25 02:41:34.490501 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7a68bc-d24a-49e6-948d-7f17b35f2f72 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:41:34.500330 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7a68bc-d24a-49e6-948d-7f17b35f2f72 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:41:34.505140 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c8896a-a8e4-4811-be5e-61cf8247923d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:41:34.506013 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c8896a-a8e4-4811-be5e-61cf8247923d admin admin] REQUEST_METHOD: `PUT` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:41:34.506297 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c8896a-a8e4-4811-be5e-61cf8247923d admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:41:34.506570 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c8896a-a8e4-4811-be5e-61cf8247923d admin admin] PATH_INFO: `/v3/projects/c8742f8c7c3d45efb313385698ed782e/users/4986dc55181d45c9b050d6a699be725a/roles/33a8e87420ed423f9cb29e0084eab5d2` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:41:34.516858 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0787eaea-08b6-4c50-8665-51a06b46aa8d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100f12ee56754f1c859106bf3e473df6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:41:34.517612 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0787eaea-08b6-4c50-8665-51a06b46aa8d service swift] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:41:34.517970 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0787eaea-08b6-4c50-8665-51a06b46aa8d service swift] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:41:34.518409 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0787eaea-08b6-4c50-8665-51a06b46aa8d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:41:34.521053 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c8896a-a8e4-4811-be5e-61cf8247923d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8742f8c7c3d45efb313385698ed782e, user_id=4986dc55181d45c9b050d6a699be725a, role_id=33a8e87420ed423f9cb29e0084eab5d2)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:41:34.523722 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c8896a-a8e4-4811-be5e-61cf8247923d admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:41:34.537625 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1297/2600] 10.222.0.117 () {60 vars in 1487 bytes} [Tue Jan 25 02:41:34 2022] PUT /identity/v3/projects/c8742f8c7c3d45efb313385698ed782e/users/4986dc55181d45c9b050d6a699be725a/roles/33a8e87420ed423f9cb29e0084eab5d2 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:41:34.550158 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3278d9dd-7cd1-4ef3-96f7-b51dcaaa7561 None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:41:34.550588 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3278d9dd-7cd1-4ef3-96f7-b51dcaaa7561 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:41:34.551222 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3278d9dd-7cd1-4ef3-96f7-b51dcaaa7561 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:41:34.582510 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-3278d9dd-7cd1-4ef3-96f7-b51dcaaa7561 None None] MFA Rules not processed for user `4986dc55181d45c9b050d6a699be725a`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:41:34.584054 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-3278d9dd-7cd1-4ef3-96f7-b51dcaaa7561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:41:34.596614 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0787eaea-08b6-4c50-8665-51a06b46aa8d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:41:34.600247 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0787eaea-08b6-4c50-8665-51a06b46aa8d service swift] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:41:34.612690 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1304/2601] 10.222.0.117 () {60 vars in 1389 bytes} [Tue Jan 25 02:41:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jan 25 02:41:34.667280 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1298/2602] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:41:34 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 25 02:41:34.678225 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0787eaea-08b6-4c50-8665-51a06b46aa8d service swift] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:41:34.680036 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-0787eaea-08b6-4c50-8665-51a06b46aa8d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:41:34.758540 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0787eaea-08b6-4c50-8665-51a06b46aa8d service swift] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:41:34.816346 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4308d8e7-0d43-4856-b589-3eaeb42e93f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cc5249aea09430080e232cf17757f86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:41:34.817213 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4308d8e7-0d43-4856-b589-3eaeb42e93f2 service cinder] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:41:34.817522 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4308d8e7-0d43-4856-b589-3eaeb42e93f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:41:34.817831 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4308d8e7-0d43-4856-b589-3eaeb42e93f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:41:34.829788 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4308d8e7-0d43-4856-b589-3eaeb42e93f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:41:34.831542 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4308d8e7-0d43-4856-b589-3eaeb42e93f2 service cinder] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:41:34.842329 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1305/2603] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:41:34 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:41:35.035731 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3278d9dd-7cd1-4ef3-96f7-b51dcaaa7561 None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:41:35.037351 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-3278d9dd-7cd1-4ef3-96f7-b51dcaaa7561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:41:35.272540 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3278d9dd-7cd1-4ef3-96f7-b51dcaaa7561 None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:41:35.276232 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b1f0c3-9f53-45f7-842d-05ab786ad6a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca4071c5f8f4a31b5edb81fa66a43a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:41:35.276919 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b1f0c3-9f53-45f7-842d-05ab786ad6a2 service neutron] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:41:35.277242 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b1f0c3-9f53-45f7-842d-05ab786ad6a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:41:35.277519 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b1f0c3-9f53-45f7-842d-05ab786ad6a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:41:35.279605 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-85b1f0c3-9f53-45f7-842d-05ab786ad6a2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:41:35.345628 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b1f0c3-9f53-45f7-842d-05ab786ad6a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:41:35.347069 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b1f0c3-9f53-45f7-842d-05ab786ad6a2 service neutron] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:41:35.357288 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1299/2604] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:41:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:41:42.269427 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4308d8e7-0d43-4856-b589-3eaeb42e93f2 service cinder] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:41:42.271190 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-4308d8e7-0d43-4856-b589-3eaeb42e93f2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:41:42.288103 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4308d8e7-0d43-4856-b589-3eaeb42e93f2 service cinder] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:41:42.293249 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135bbdd6-d8c7-4a96-81b8-1aebe57b5765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:41:42.294111 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135bbdd6-d8c7-4a96-81b8-1aebe57b5765 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:41:42.294398 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135bbdd6-d8c7-4a96-81b8-1aebe57b5765 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:41:42.294674 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135bbdd6-d8c7-4a96-81b8-1aebe57b5765 admin admin] PATH_INFO: `/v3/users/4cd46fc7a1d84effa41ba0f8935fcf68` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:41:42.295974 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135bbdd6-d8c7-4a96-81b8-1aebe57b5765 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4cd46fc7a1d84effa41ba0f8935fcf68)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:41:42.297904 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135bbdd6-d8c7-4a96-81b8-1aebe57b5765 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:41:42.342656 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-135bbdd6-d8c7-4a96-81b8-1aebe57b5765 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4cd46fc7a1d84effa41ba0f8935fcf68'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:41:42.343317 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-135bbdd6-d8c7-4a96-81b8-1aebe57b5765 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4cd46fc7a1d84effa41ba0f8935fcf68'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:41:42.350701 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-135bbdd6-d8c7-4a96-81b8-1aebe57b5765 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4cd46fc7a1d84effa41ba0f8935fcf68'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:41:42.351471 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-135bbdd6-d8c7-4a96-81b8-1aebe57b5765 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4cd46fc7a1d84effa41ba0f8935fcf68'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:41:42.360128 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-135bbdd6-d8c7-4a96-81b8-1aebe57b5765 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4cd46fc7a1d84effa41ba0f8935fcf68'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:41:42.377827 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1306/2605] 10.222.0.117 () {58 vars in 1228 bytes} [Tue Jan 25 02:41:42 2022] DELETE /identity/v3/users/4cd46fc7a1d84effa41ba0f8935fcf68 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:41:42.547427 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b1f0c3-9f53-45f7-842d-05ab786ad6a2 service neutron] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:41:42.557161 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b1f0c3-9f53-45f7-842d-05ab786ad6a2 service neutron] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:41:42.613827 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be810b4-ebfd-4c87-9305-6dab0a65878d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:41:42.614686 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be810b4-ebfd-4c87-9305-6dab0a65878d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:41:42.614974 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be810b4-ebfd-4c87-9305-6dab0a65878d admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:41:42.615249 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be810b4-ebfd-4c87-9305-6dab0a65878d admin admin] PATH_INFO: `/v3/projects/420e54880e0e49999ee0ca6050023575` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:41:42.616500 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be810b4-ebfd-4c87-9305-6dab0a65878d admin admin] RBAC: Authorizing `identity:delete_project(project_id=420e54880e0e49999ee0ca6050023575)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:41:42.618428 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be810b4-ebfd-4c87-9305-6dab0a65878d admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:41:42.663721 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-8be810b4-ebfd-4c87-9305-6dab0a65878d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '420e54880e0e49999ee0ca6050023575', 'request_id': 'req-8be810b4-ebfd-4c87-9305-6dab0a65878d'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:41:42.670994 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-8be810b4-ebfd-4c87-9305-6dab0a65878d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '420e54880e0e49999ee0ca6050023575', 'request_id': 'req-8be810b4-ebfd-4c87-9305-6dab0a65878d'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:41:42.679540 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-8be810b4-ebfd-4c87-9305-6dab0a65878d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '420e54880e0e49999ee0ca6050023575', 'request_id': 'req-8be810b4-ebfd-4c87-9305-6dab0a65878d'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:41:42.692890 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-8be810b4-ebfd-4c87-9305-6dab0a65878d admin admin] The token cache is being invalidate because project 420e54880e0e49999ee0ca6050023575 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79120) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 25 02:41:42.693182 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-8be810b4-ebfd-4c87-9305-6dab0a65878d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:41:42.693802 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-8be810b4-ebfd-4c87-9305-6dab0a65878d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:41:42.695563 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1300/2606] 10.222.0.117 () {58 vars in 1237 bytes} [Tue Jan 25 02:41:42 2022] DELETE /identity/v3/projects/420e54880e0e49999ee0ca6050023575 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:41:42.700147 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135bbdd6-d8c7-4a96-81b8-1aebe57b5765 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:41:42.701632 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-135bbdd6-d8c7-4a96-81b8-1aebe57b5765 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:41:42.715414 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135bbdd6-d8c7-4a96-81b8-1aebe57b5765 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:41:42.768601 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fbcc9d-0749-43c6-8e59-5fc0cf3d4969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:41:42.769466 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fbcc9d-0749-43c6-8e59-5fc0cf3d4969 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:41:42.769751 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fbcc9d-0749-43c6-8e59-5fc0cf3d4969 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:41:42.770027 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fbcc9d-0749-43c6-8e59-5fc0cf3d4969 admin admin] PATH_INFO: `/v3/users/5bbaf52f604a4b6789ebd5830597704c` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:41:42.771214 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fbcc9d-0749-43c6-8e59-5fc0cf3d4969 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5bbaf52f604a4b6789ebd5830597704c)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:41:42.773155 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fbcc9d-0749-43c6-8e59-5fc0cf3d4969 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:41:42.817079 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-73fbcc9d-0749-43c6-8e59-5fc0cf3d4969 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5bbaf52f604a4b6789ebd5830597704c'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:41:42.817652 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-73fbcc9d-0749-43c6-8e59-5fc0cf3d4969 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5bbaf52f604a4b6789ebd5830597704c'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:41:42.825466 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-73fbcc9d-0749-43c6-8e59-5fc0cf3d4969 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5bbaf52f604a4b6789ebd5830597704c'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:41:42.826116 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-73fbcc9d-0749-43c6-8e59-5fc0cf3d4969 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5bbaf52f604a4b6789ebd5830597704c'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:41:42.833453 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-73fbcc9d-0749-43c6-8e59-5fc0cf3d4969 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5bbaf52f604a4b6789ebd5830597704c'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:41:42.851226 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1307/2607] 10.222.0.117 () {58 vars in 1228 bytes} [Tue Jan 25 02:41:42 2022] DELETE /identity/v3/users/5bbaf52f604a4b6789ebd5830597704c => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:41:43.019271 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be810b4-ebfd-4c87-9305-6dab0a65878d admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:41:43.020763 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-8be810b4-ebfd-4c87-9305-6dab0a65878d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:41:43.033931 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be810b4-ebfd-4c87-9305-6dab0a65878d admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:41:43.089679 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b91314-a1b5-41a3-aa1e-18909383d9d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:41:43.090453 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b91314-a1b5-41a3-aa1e-18909383d9d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:41:43.090734 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b91314-a1b5-41a3-aa1e-18909383d9d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:41:43.091007 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b91314-a1b5-41a3-aa1e-18909383d9d1 admin admin] PATH_INFO: `/v3/projects/0d879aff8bc64332896a3089c20f4a76` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:41:43.092223 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b91314-a1b5-41a3-aa1e-18909383d9d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d879aff8bc64332896a3089c20f4a76)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:41:43.094116 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b91314-a1b5-41a3-aa1e-18909383d9d1 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:41:43.139377 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-32b91314-a1b5-41a3-aa1e-18909383d9d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d879aff8bc64332896a3089c20f4a76', 'request_id': 'req-32b91314-a1b5-41a3-aa1e-18909383d9d1'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:41:43.144717 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-32b91314-a1b5-41a3-aa1e-18909383d9d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d879aff8bc64332896a3089c20f4a76', 'request_id': 'req-32b91314-a1b5-41a3-aa1e-18909383d9d1'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:41:43.150561 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-32b91314-a1b5-41a3-aa1e-18909383d9d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d879aff8bc64332896a3089c20f4a76', 'request_id': 'req-32b91314-a1b5-41a3-aa1e-18909383d9d1'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:41:43.162143 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-32b91314-a1b5-41a3-aa1e-18909383d9d1 admin admin] The token cache is being invalidate because project 0d879aff8bc64332896a3089c20f4a76 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79120) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 25 02:41:43.162482 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-32b91314-a1b5-41a3-aa1e-18909383d9d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:41:43.163145 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-32b91314-a1b5-41a3-aa1e-18909383d9d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:41:43.164706 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1301/2608] 10.222.0.117 () {58 vars in 1237 bytes} [Tue Jan 25 02:41:43 2022] DELETE /identity/v3/projects/0d879aff8bc64332896a3089c20f4a76 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:41:43.171061 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb10010-e5e5-4eba-a70f-e53ebe8ea38c None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:41:43.171356 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb10010-e5e5-4eba-a70f-e53ebe8ea38c None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:41:43.171640 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb10010-e5e5-4eba-a70f-e53ebe8ea38c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:41:43.189402 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-9eb10010-e5e5-4eba-a70f-e53ebe8ea38c None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:41:43.190604 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-9eb10010-e5e5-4eba-a70f-e53ebe8ea38c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:41:43.248944 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1308/2609] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:41:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:41:43.256863 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88913cb8-5409-4ee3-a136-5c2e2b3591a6 None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:41:43.257154 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88913cb8-5409-4ee3-a136-5c2e2b3591a6 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:41:43.257432 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88913cb8-5409-4ee3-a136-5c2e2b3591a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:41:43.275491 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-88913cb8-5409-4ee3-a136-5c2e2b3591a6 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:41:43.277291 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-88913cb8-5409-4ee3-a136-5c2e2b3591a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:41:43.285511 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1302/2610] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:41:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:41:43.290003 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb10010-e5e5-4eba-a70f-e53ebe8ea38c None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:41:43.300465 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb10010-e5e5-4eba-a70f-e53ebe8ea38c None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:41:43.305195 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d406af21-663f-43c7-82e8-ab186d3dc5e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:41:43.305875 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d406af21-663f-43c7-82e8-ab186d3dc5e0 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:41:43.306158 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d406af21-663f-43c7-82e8-ab186d3dc5e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:41:43.306436 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d406af21-663f-43c7-82e8-ab186d3dc5e0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:41:43.307175 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d406af21-663f-43c7-82e8-ab186d3dc5e0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:41:43.307479 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d406af21-663f-43c7-82e8-ab186d3dc5e0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:41:43.309162 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d406af21-663f-43c7-82e8-ab186d3dc5e0 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:41:43.320738 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1309/2611] 10.222.0.117 () {58 vars in 1157 bytes} [Tue Jan 25 02:41:43 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:41:43.325323 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88913cb8-5409-4ee3-a136-5c2e2b3591a6 None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:41:43.335130 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88913cb8-5409-4ee3-a136-5c2e2b3591a6 None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:41:43.340889 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da827792-5787-4a66-bf41-3a5055432fae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:41:43.341841 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da827792-5787-4a66-bf41-3a5055432fae admin admin] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:41:43.341841 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da827792-5787-4a66-bf41-3a5055432fae admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:41:43.342130 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da827792-5787-4a66-bf41-3a5055432fae admin admin] PATH_INFO: `/v3/projects` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:41:43.342787 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da827792-5787-4a66-bf41-3a5055432fae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:41:43.344720 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da827792-5787-4a66-bf41-3a5055432fae admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:41:43.371103 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1303/2612] 10.222.0.117 () {60 vars in 1157 bytes} [Tue Jan 25 02:41:43 2022] POST /identity/v3/projects => generated 378 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 02:41:43.375409 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d406af21-663f-43c7-82e8-ab186d3dc5e0 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:41:43.385195 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d406af21-663f-43c7-82e8-ab186d3dc5e0 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:41:43.439457 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2fb6ad-3191-4ded-aef3-64397f5987f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:41:43.440140 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2fb6ad-3191-4ded-aef3-64397f5987f0 admin admin] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:41:43.440422 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2fb6ad-3191-4ded-aef3-64397f5987f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:41:43.440695 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2fb6ad-3191-4ded-aef3-64397f5987f0 admin admin] PATH_INFO: `/v3/users` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:41:43.441396 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2fb6ad-3191-4ded-aef3-64397f5987f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:41:43.443297 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2fb6ad-3191-4ded-aef3-64397f5987f0 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:41:43.463213 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1310/2613] 10.222.0.117 () {60 vars in 1148 bytes} [Tue Jan 25 02:41:43 2022] POST /identity/v3/users => generated 290 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 02:41:43.468430 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da827792-5787-4a66-bf41-3a5055432fae admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:41:43.478499 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da827792-5787-4a66-bf41-3a5055432fae admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:41:43.483966 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7cb5af-e9ad-4bc2-b4b0-fe1a9332ed6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:41:43.484626 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7cb5af-e9ad-4bc2-b4b0-fe1a9332ed6c admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:41:43.484909 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7cb5af-e9ad-4bc2-b4b0-fe1a9332ed6c admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:41:43.485203 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7cb5af-e9ad-4bc2-b4b0-fe1a9332ed6c admin admin] PATH_INFO: `/v3/roles` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:41:43.486356 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7cb5af-e9ad-4bc2-b4b0-fe1a9332ed6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:41:43.487987 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7cb5af-e9ad-4bc2-b4b0-fe1a9332ed6c admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:41:43.498735 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1304/2614] 10.222.0.117 () {58 vars in 1126 bytes} [Tue Jan 25 02:41:43 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 25 02:41:43.502895 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2fb6ad-3191-4ded-aef3-64397f5987f0 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:41:43.517081 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2fb6ad-3191-4ded-aef3-64397f5987f0 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:41:43.521772 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462fc720-0ed5-4263-9d0a-9451f6885509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:41:43.522424 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462fc720-0ed5-4263-9d0a-9451f6885509 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:41:43.522703 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462fc720-0ed5-4263-9d0a-9451f6885509 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:41:43.522977 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462fc720-0ed5-4263-9d0a-9451f6885509 admin admin] PATH_INFO: `/v3/roles` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:41:43.523739 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462fc720-0ed5-4263-9d0a-9451f6885509 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:41:43.525352 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462fc720-0ed5-4263-9d0a-9451f6885509 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:41:43.535563 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1311/2615] 10.222.0.117 () {58 vars in 1126 bytes} [Tue Jan 25 02:41:43 2022] GET /identity/v3/roles => generated 1427 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 25 02:41:43.539876 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7cb5af-e9ad-4bc2-b4b0-fe1a9332ed6c admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:41:43.550512 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7cb5af-e9ad-4bc2-b4b0-fe1a9332ed6c admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:41:43.555164 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba735e0-05f4-4609-85dd-727d611ed440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:41:43.556069 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba735e0-05f4-4609-85dd-727d611ed440 admin admin] REQUEST_METHOD: `PUT` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:41:43.556348 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba735e0-05f4-4609-85dd-727d611ed440 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:41:43.556625 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba735e0-05f4-4609-85dd-727d611ed440 admin admin] PATH_INFO: `/v3/projects/d61a4845c27e4b928c5445d95321e2a3/users/1467bd27c3c441f19715f33dd6c3d78a/roles/33a8e87420ed423f9cb29e0084eab5d2` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:41:43.570950 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba735e0-05f4-4609-85dd-727d611ed440 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d61a4845c27e4b928c5445d95321e2a3, user_id=1467bd27c3c441f19715f33dd6c3d78a, role_id=33a8e87420ed423f9cb29e0084eab5d2)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:41:43.573764 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba735e0-05f4-4609-85dd-727d611ed440 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:41:43.586618 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1305/2616] 10.222.0.117 () {60 vars in 1487 bytes} [Tue Jan 25 02:41:43 2022] PUT /identity/v3/projects/d61a4845c27e4b928c5445d95321e2a3/users/1467bd27c3c441f19715f33dd6c3d78a/roles/33a8e87420ed423f9cb29e0084eab5d2 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:41:43.592638 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27e4105-c969-4b36-82c9-8ac8ba65e079 None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:41:43.592883 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27e4105-c969-4b36-82c9-8ac8ba65e079 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:41:43.593162 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27e4105-c969-4b36-82c9-8ac8ba65e079 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:41:43.611317 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-b27e4105-c969-4b36-82c9-8ac8ba65e079 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:41:43.612530 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-b27e4105-c969-4b36-82c9-8ac8ba65e079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:41:43.667037 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1312/2617] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:41:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:41:43.676820 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba735e0-05f4-4609-85dd-727d611ed440 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:41:43.678510 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-eba735e0-05f4-4609-85dd-727d611ed440 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:41:43.735807 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba735e0-05f4-4609-85dd-727d611ed440 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:41:43.739332 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce0b76a-5741-4b41-9161-4286c3603dbf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca4071c5f8f4a31b5edb81fa66a43a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:41:43.740004 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce0b76a-5741-4b41-9161-4286c3603dbf service neutron] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:41:43.740283 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce0b76a-5741-4b41-9161-4286c3603dbf service neutron] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:41:43.740553 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce0b76a-5741-4b41-9161-4286c3603dbf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:41:43.750841 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce0b76a-5741-4b41-9161-4286c3603dbf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:41:43.753441 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce0b76a-5741-4b41-9161-4286c3603dbf service neutron] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:41:43.768943 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1306/2618] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:41:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:41:48.273967 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db61234-aaa6-416b-a7ee-c74f91fe0cb1 None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:41:48.277407 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db61234-aaa6-416b-a7ee-c74f91fe0cb1 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:41:48.277407 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db61234-aaa6-416b-a7ee-c74f91fe0cb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:41:48.339859 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-8db61234-aaa6-416b-a7ee-c74f91fe0cb1 None None] MFA Rules not processed for user `1467bd27c3c441f19715f33dd6c3d78a`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:41:48.341512 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-8db61234-aaa6-416b-a7ee-c74f91fe0cb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:41:48.427411 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1313/2619] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:41:48 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:41:48.432425 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce0b76a-5741-4b41-9161-4286c3603dbf service neutron] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:41:48.445240 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce0b76a-5741-4b41-9161-4286c3603dbf service neutron] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:41:48.451929 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a393f3-7bb3-47c1-8124-bc22bc344086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:41:48.452967 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a393f3-7bb3-47c1-8124-bc22bc344086 admin admin] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:41:48.453255 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a393f3-7bb3-47c1-8124-bc22bc344086 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:41:48.453531 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a393f3-7bb3-47c1-8124-bc22bc344086 admin admin] PATH_INFO: `/v3/projects` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:41:48.454235 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a393f3-7bb3-47c1-8124-bc22bc344086 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:41:48.456353 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a393f3-7bb3-47c1-8124-bc22bc344086 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:41:48.491201 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1307/2620] 10.222.0.117 () {60 vars in 1157 bytes} [Tue Jan 25 02:41:48 2022] POST /identity/v3/projects => generated 376 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 02:41:48.500251 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db61234-aaa6-416b-a7ee-c74f91fe0cb1 None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:41:48.513694 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db61234-aaa6-416b-a7ee-c74f91fe0cb1 None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:41:48.581321 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d562da-f05c-4aaf-9ad5-8f2a67c10c46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:41:48.582003 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d562da-f05c-4aaf-9ad5-8f2a67c10c46 admin admin] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:41:48.582280 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d562da-f05c-4aaf-9ad5-8f2a67c10c46 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:41:48.582742 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d562da-f05c-4aaf-9ad5-8f2a67c10c46 admin admin] PATH_INFO: `/v3/users` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:41:48.583628 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d562da-f05c-4aaf-9ad5-8f2a67c10c46 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:41:48.598271 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d562da-f05c-4aaf-9ad5-8f2a67c10c46 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:41:48.631555 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1314/2621] 10.222.0.117 () {60 vars in 1148 bytes} [Tue Jan 25 02:41:48 2022] POST /identity/v3/users => generated 295 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 02:41:48.635332 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a393f3-7bb3-47c1-8124-bc22bc344086 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:41:48.647308 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a393f3-7bb3-47c1-8124-bc22bc344086 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:41:48.652863 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6e74bc-43f8-4540-a899-a235ab3c5f0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:41:48.653537 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6e74bc-43f8-4540-a899-a235ab3c5f0a admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:41:48.653825 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6e74bc-43f8-4540-a899-a235ab3c5f0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:41:48.654160 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6e74bc-43f8-4540-a899-a235ab3c5f0a admin admin] PATH_INFO: `/v3/roles` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:41:48.655087 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6e74bc-43f8-4540-a899-a235ab3c5f0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:41:48.657545 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6e74bc-43f8-4540-a899-a235ab3c5f0a admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:41:48.674242 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1308/2622] 10.222.0.117 () {58 vars in 1126 bytes} [Tue Jan 25 02:41:48 2022] GET /identity/v3/roles => generated 1427 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 25 02:41:48.678766 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d562da-f05c-4aaf-9ad5-8f2a67c10c46 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:41:48.690676 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d562da-f05c-4aaf-9ad5-8f2a67c10c46 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:41:48.696355 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cf83a3-b291-4a0c-92e6-a70954c2981a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:41:48.697465 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cf83a3-b291-4a0c-92e6-a70954c2981a admin admin] REQUEST_METHOD: `PUT` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:41:48.697836 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cf83a3-b291-4a0c-92e6-a70954c2981a admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:41:48.698300 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cf83a3-b291-4a0c-92e6-a70954c2981a admin admin] PATH_INFO: `/v3/projects/4ca9786b60fe466f86fe6d24c7dcf2aa/users/e8f26ce1d8ee43ed8079fa0c6160d655/roles/d8dbc6d83d9d41d28c3feb8b3485b291` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:41:48.721143 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cf83a3-b291-4a0c-92e6-a70954c2981a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ca9786b60fe466f86fe6d24c7dcf2aa, user_id=e8f26ce1d8ee43ed8079fa0c6160d655, role_id=d8dbc6d83d9d41d28c3feb8b3485b291)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:41:48.724345 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cf83a3-b291-4a0c-92e6-a70954c2981a admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:41:48.762185 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1315/2623] 10.222.0.117 () {60 vars in 1487 bytes} [Tue Jan 25 02:41:48 2022] PUT /identity/v3/projects/4ca9786b60fe466f86fe6d24c7dcf2aa/users/e8f26ce1d8ee43ed8079fa0c6160d655/roles/d8dbc6d83d9d41d28c3feb8b3485b291 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:41:48.766361 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6e74bc-43f8-4540-a899-a235ab3c5f0a admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:41:48.778286 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6e74bc-43f8-4540-a899-a235ab3c5f0a admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:41:48.865685 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc26661-84d6-4f8c-837d-8bfe6f361d4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:41:48.866364 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc26661-84d6-4f8c-837d-8bfe6f361d4f admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:41:48.866644 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc26661-84d6-4f8c-837d-8bfe6f361d4f admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:41:48.867199 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc26661-84d6-4f8c-837d-8bfe6f361d4f admin admin] PATH_INFO: `/v3/roles` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:41:48.868138 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc26661-84d6-4f8c-837d-8bfe6f361d4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:41:48.870221 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc26661-84d6-4f8c-837d-8bfe6f361d4f admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:41:48.882929 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1309/2624] 10.222.0.117 () {58 vars in 1126 bytes} [Tue Jan 25 02:41:48 2022] GET /identity/v3/roles => generated 1427 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 25 02:41:48.888083 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cf83a3-b291-4a0c-92e6-a70954c2981a admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:41:48.899497 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cf83a3-b291-4a0c-92e6-a70954c2981a admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:41:48.906719 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a32b0e-7be1-4cde-9df9-559e0c847733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:41:48.907521 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a32b0e-7be1-4cde-9df9-559e0c847733 admin admin] REQUEST_METHOD: `PUT` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:41:48.907923 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a32b0e-7be1-4cde-9df9-559e0c847733 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:41:48.908277 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a32b0e-7be1-4cde-9df9-559e0c847733 admin admin] PATH_INFO: `/v3/projects/4ca9786b60fe466f86fe6d24c7dcf2aa/users/e8f26ce1d8ee43ed8079fa0c6160d655/roles/d8dbc6d83d9d41d28c3feb8b3485b291` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:41:48.910968 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a32b0e-7be1-4cde-9df9-559e0c847733 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ca9786b60fe466f86fe6d24c7dcf2aa, user_id=e8f26ce1d8ee43ed8079fa0c6160d655, role_id=d8dbc6d83d9d41d28c3feb8b3485b291)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:41:48.913665 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a32b0e-7be1-4cde-9df9-559e0c847733 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:41:48.930376 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1316/2625] 10.222.0.117 () {60 vars in 1487 bytes} [Tue Jan 25 02:41:48 2022] PUT /identity/v3/projects/4ca9786b60fe466f86fe6d24c7dcf2aa/users/e8f26ce1d8ee43ed8079fa0c6160d655/roles/d8dbc6d83d9d41d28c3feb8b3485b291 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:41:55.739713 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff79b0b-fa83-45f9-8a8e-01146e42a677 None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:41:55.740210 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff79b0b-fa83-45f9-8a8e-01146e42a677 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:41:55.740311 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff79b0b-fa83-45f9-8a8e-01146e42a677 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:41:55.785891 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-1ff79b0b-fa83-45f9-8a8e-01146e42a677 None None] MFA Rules not processed for user `e8f26ce1d8ee43ed8079fa0c6160d655`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:41:55.788020 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-1ff79b0b-fa83-45f9-8a8e-01146e42a677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:41:55.898540 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1310/2626] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:41:55 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:41:55.912813 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a32b0e-7be1-4cde-9df9-559e0c847733 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:41:55.915366 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-84a32b0e-7be1-4cde-9df9-559e0c847733 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:41:56.042486 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a32b0e-7be1-4cde-9df9-559e0c847733 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:41:56.048521 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8555304e-85ed-41f5-9ab7-f96f5d99f664 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9ad6269900346458050063c12cac299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:41:56.049492 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8555304e-85ed-41f5-9ab7-f96f5d99f664 service nova] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:41:56.049857 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8555304e-85ed-41f5-9ab7-f96f5d99f664 service nova] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:41:56.050206 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8555304e-85ed-41f5-9ab7-f96f5d99f664 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:41:56.124752 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8555304e-85ed-41f5-9ab7-f96f5d99f664 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:41:56.126514 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8555304e-85ed-41f5-9ab7-f96f5d99f664 service nova] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:41:56.137663 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1317/2627] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:41:55 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:41:56.870812 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2ab4ba-677e-48ac-b6b8-cc65fc7aad80 None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:41:56.872022 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2ab4ba-677e-48ac-b6b8-cc65fc7aad80 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:41:56.872516 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2ab4ba-677e-48ac-b6b8-cc65fc7aad80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:41:56.895577 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-7d2ab4ba-677e-48ac-b6b8-cc65fc7aad80 None None] MFA Rules not processed for user `a366d243b91b479cac0fa7f3238cbafa`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:41:56.897165 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-7d2ab4ba-677e-48ac-b6b8-cc65fc7aad80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:41:56.971849 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1311/2628] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:41:56 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:41:57.347824 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8555304e-85ed-41f5-9ab7-f96f5d99f664 service nova] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:41:57.423543 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8555304e-85ed-41f5-9ab7-f96f5d99f664 service nova] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:41:57.427936 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bc9570-3261-4f98-982c-f6c36418d0f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca4071c5f8f4a31b5edb81fa66a43a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:41:57.428841 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bc9570-3261-4f98-982c-f6c36418d0f3 service neutron] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:41:57.429679 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bc9570-3261-4f98-982c-f6c36418d0f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:41:57.430231 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bc9570-3261-4f98-982c-f6c36418d0f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:41:57.433034 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-b6bc9570-3261-4f98-982c-f6c36418d0f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:41:57.445870 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bc9570-3261-4f98-982c-f6c36418d0f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:41:57.447751 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bc9570-3261-4f98-982c-f6c36418d0f3 service neutron] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:41:57.459917 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1318/2629] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:41:57 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:41:57.957103 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2ab4ba-677e-48ac-b6b8-cc65fc7aad80 None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:41:57.959186 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-7d2ab4ba-677e-48ac-b6b8-cc65fc7aad80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:41:58.093402 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2ab4ba-677e-48ac-b6b8-cc65fc7aad80 None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:41:58.099679 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19248a6c-7545-495e-8eeb-58c27d7a05e0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '890151a6bf2840f0a0a00f45dd2d38a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:41:58.100416 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19248a6c-7545-495e-8eeb-58c27d7a05e0 service placement] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:41:58.100839 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19248a6c-7545-495e-8eeb-58c27d7a05e0 service placement] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:41:58.101123 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19248a6c-7545-495e-8eeb-58c27d7a05e0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:41:58.103031 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-19248a6c-7545-495e-8eeb-58c27d7a05e0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:41:58.115249 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19248a6c-7545-495e-8eeb-58c27d7a05e0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:41:58.116899 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19248a6c-7545-495e-8eeb-58c27d7a05e0 service placement] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:41:58.129137 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1312/2630] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:41:57 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:42:14.254507 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bc9570-3261-4f98-982c-f6c36418d0f3 service neutron] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:42:14.256761 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-b6bc9570-3261-4f98-982c-f6c36418d0f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:42:14.273309 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bc9570-3261-4f98-982c-f6c36418d0f3 service neutron] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:42:14.279967 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30886da8-b579-4de3-adad-19b512e85306 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9ad6269900346458050063c12cac299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:42:14.280611 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30886da8-b579-4de3-adad-19b512e85306 service nova] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:42:14.280900 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30886da8-b579-4de3-adad-19b512e85306 service nova] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:42:14.281179 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30886da8-b579-4de3-adad-19b512e85306 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:42:14.282971 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-30886da8-b579-4de3-adad-19b512e85306 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:42:14.296465 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30886da8-b579-4de3-adad-19b512e85306 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:42:14.298113 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30886da8-b579-4de3-adad-19b512e85306 service nova] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:42:14.308977 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1319/2631] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:42:14 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:42:21.586823 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19248a6c-7545-495e-8eeb-58c27d7a05e0 service placement] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:42:21.588266 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-19248a6c-7545-495e-8eeb-58c27d7a05e0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:42:21.657786 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19248a6c-7545-495e-8eeb-58c27d7a05e0 service placement] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:42:21.662335 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92698d5d-4fcc-4ba3-b63a-5004631475a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:42:21.663198 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92698d5d-4fcc-4ba3-b63a-5004631475a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:42:21.663483 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92698d5d-4fcc-4ba3-b63a-5004631475a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:42:21.663798 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92698d5d-4fcc-4ba3-b63a-5004631475a0 admin admin] PATH_INFO: `/v3/users/4986dc55181d45c9b050d6a699be725a` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:42:21.664995 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92698d5d-4fcc-4ba3-b63a-5004631475a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4986dc55181d45c9b050d6a699be725a)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:42:21.666904 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92698d5d-4fcc-4ba3-b63a-5004631475a0 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:42:21.712914 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-92698d5d-4fcc-4ba3-b63a-5004631475a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4986dc55181d45c9b050d6a699be725a'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:42:21.720515 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-92698d5d-4fcc-4ba3-b63a-5004631475a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4986dc55181d45c9b050d6a699be725a'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:42:21.721218 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-92698d5d-4fcc-4ba3-b63a-5004631475a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4986dc55181d45c9b050d6a699be725a'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:42:21.721853 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-92698d5d-4fcc-4ba3-b63a-5004631475a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4986dc55181d45c9b050d6a699be725a'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:42:21.733452 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-92698d5d-4fcc-4ba3-b63a-5004631475a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4986dc55181d45c9b050d6a699be725a'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:42:21.745288 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1313/2632] 10.222.0.117 () {58 vars in 1228 bytes} [Tue Jan 25 02:42:21 2022] DELETE /identity/v3/users/4986dc55181d45c9b050d6a699be725a => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:42:21.750259 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a3090f-a676-43a5-bbcd-e7c64ab1830f None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:42:21.750758 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a3090f-a676-43a5-bbcd-e7c64ab1830f None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:42:21.750868 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a3090f-a676-43a5-bbcd-e7c64ab1830f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:42:21.768154 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-27a3090f-a676-43a5-bbcd-e7c64ab1830f None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:42:21.769350 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-27a3090f-a676-43a5-bbcd-e7c64ab1830f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:42:21.828116 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1320/2633] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:42:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:42:21.837854 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92698d5d-4fcc-4ba3-b63a-5004631475a0 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:42:21.839276 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-92698d5d-4fcc-4ba3-b63a-5004631475a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:42:21.914132 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92698d5d-4fcc-4ba3-b63a-5004631475a0 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:42:21.919928 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98328911-3faa-4f37-b340-a7ac5adeb587 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca4071c5f8f4a31b5edb81fa66a43a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:42:21.920822 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98328911-3faa-4f37-b340-a7ac5adeb587 service neutron] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:42:21.921109 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98328911-3faa-4f37-b340-a7ac5adeb587 service neutron] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:42:21.921377 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98328911-3faa-4f37-b340-a7ac5adeb587 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:42:21.930373 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98328911-3faa-4f37-b340-a7ac5adeb587 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:42:21.931829 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98328911-3faa-4f37-b340-a7ac5adeb587 service neutron] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:42:21.941583 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1314/2634] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:42:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 25 02:42:22.201270 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a3090f-a676-43a5-bbcd-e7c64ab1830f None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:42:22.202738 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-27a3090f-a676-43a5-bbcd-e7c64ab1830f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:42:22.226137 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a3090f-a676-43a5-bbcd-e7c64ab1830f None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:42:22.231186 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d0ab3a-e70d-4059-a206-5fcb7d5a513c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:42:22.232739 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d0ab3a-e70d-4059-a206-5fcb7d5a513c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:42:22.233030 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d0ab3a-e70d-4059-a206-5fcb7d5a513c admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:42:22.233308 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d0ab3a-e70d-4059-a206-5fcb7d5a513c admin admin] PATH_INFO: `/v3/projects/c8742f8c7c3d45efb313385698ed782e` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:42:22.234525 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d0ab3a-e70d-4059-a206-5fcb7d5a513c admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8742f8c7c3d45efb313385698ed782e)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:42:22.236516 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d0ab3a-e70d-4059-a206-5fcb7d5a513c admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:42:22.281982 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-e0d0ab3a-e70d-4059-a206-5fcb7d5a513c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8742f8c7c3d45efb313385698ed782e', 'request_id': 'req-e0d0ab3a-e70d-4059-a206-5fcb7d5a513c'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:42:22.287386 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-e0d0ab3a-e70d-4059-a206-5fcb7d5a513c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8742f8c7c3d45efb313385698ed782e', 'request_id': 'req-e0d0ab3a-e70d-4059-a206-5fcb7d5a513c'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:42:22.295504 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-e0d0ab3a-e70d-4059-a206-5fcb7d5a513c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8742f8c7c3d45efb313385698ed782e', 'request_id': 'req-e0d0ab3a-e70d-4059-a206-5fcb7d5a513c'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:42:22.306398 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-e0d0ab3a-e70d-4059-a206-5fcb7d5a513c admin admin] The token cache is being invalidate because project c8742f8c7c3d45efb313385698ed782e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79121) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 25 02:42:22.306675 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-e0d0ab3a-e70d-4059-a206-5fcb7d5a513c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:42:22.307296 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-e0d0ab3a-e70d-4059-a206-5fcb7d5a513c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:42:22.308863 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1321/2635] 10.222.0.117 () {58 vars in 1237 bytes} [Tue Jan 25 02:42:22 2022] DELETE /identity/v3/projects/c8742f8c7c3d45efb313385698ed782e => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 25 02:42:25.883310 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbf3a8a-15a3-4fa9-98bb-cd240e3d7e03 None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:42:25.883824 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbf3a8a-15a3-4fa9-98bb-cd240e3d7e03 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:42:25.884035 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbf3a8a-15a3-4fa9-98bb-cd240e3d7e03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:42:25.901037 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-0dbf3a8a-15a3-4fa9-98bb-cd240e3d7e03 None None] MFA Rules not processed for user `1467bd27c3c441f19715f33dd6c3d78a`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:42:25.902222 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-0dbf3a8a-15a3-4fa9-98bb-cd240e3d7e03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:42:25.963902 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1315/2636] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:42:25 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:42:26.273378 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d0ab3a-e70d-4059-a206-5fcb7d5a513c admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:42:26.274821 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-e0d0ab3a-e70d-4059-a206-5fcb7d5a513c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:42:26.331581 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d0ab3a-e70d-4059-a206-5fcb7d5a513c admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:42:26.335130 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2e5dd1-75bd-4c41-a890-adc8143cb9b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca4071c5f8f4a31b5edb81fa66a43a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:42:26.335794 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2e5dd1-75bd-4c41-a890-adc8143cb9b7 service neutron] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:42:26.336075 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2e5dd1-75bd-4c41-a890-adc8143cb9b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:42:26.336350 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2e5dd1-75bd-4c41-a890-adc8143cb9b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:42:26.338100 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-0e2e5dd1-75bd-4c41-a890-adc8143cb9b7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:42:26.347442 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2e5dd1-75bd-4c41-a890-adc8143cb9b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:42:26.348912 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2e5dd1-75bd-4c41-a890-adc8143cb9b7 service neutron] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:42:26.356693 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1322/2637] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:42:26 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:42:45.594702 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbf3a8a-15a3-4fa9-98bb-cd240e3d7e03 None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:42:45.596479 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-0dbf3a8a-15a3-4fa9-98bb-cd240e3d7e03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:42:45.608845 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbf3a8a-15a3-4fa9-98bb-cd240e3d7e03 None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:42:45.612634 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced0a75a-0d78-4ccc-b7df-8f4211a2dad4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca4071c5f8f4a31b5edb81fa66a43a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:42:45.613260 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced0a75a-0d78-4ccc-b7df-8f4211a2dad4 service neutron] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:42:45.613539 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced0a75a-0d78-4ccc-b7df-8f4211a2dad4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:42:45.613809 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced0a75a-0d78-4ccc-b7df-8f4211a2dad4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:42:45.615499 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-ced0a75a-0d78-4ccc-b7df-8f4211a2dad4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:42:45.676616 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced0a75a-0d78-4ccc-b7df-8f4211a2dad4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:42:45.678054 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced0a75a-0d78-4ccc-b7df-8f4211a2dad4 service neutron] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:42:45.687548 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1316/2638] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:42:45 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:43:35.638168 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2e5dd1-75bd-4c41-a890-adc8143cb9b7 service neutron] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:43:35.640332 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-0e2e5dd1-75bd-4c41-a890-adc8143cb9b7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:43:35.708028 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2e5dd1-75bd-4c41-a890-adc8143cb9b7 service neutron] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:43:35.713128 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb8aab5-fc9e-4c59-8a50-3b9c8344c102 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '890151a6bf2840f0a0a00f45dd2d38a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:43:35.713774 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb8aab5-fc9e-4c59-8a50-3b9c8344c102 service placement] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:43:35.714060 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb8aab5-fc9e-4c59-8a50-3b9c8344c102 service placement] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:43:35.714338 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb8aab5-fc9e-4c59-8a50-3b9c8344c102 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:43:35.716243 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-8eb8aab5-fc9e-4c59-8a50-3b9c8344c102 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:43:35.727506 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb8aab5-fc9e-4c59-8a50-3b9c8344c102 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:43:35.729129 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb8aab5-fc9e-4c59-8a50-3b9c8344c102 service placement] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:43:35.738669 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1323/2639] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:43:35 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:43:59.752107 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46655dd3-846c-4668-bfda-4b8d4656c9a7 None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:43:59.752618 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46655dd3-846c-4668-bfda-4b8d4656c9a7 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:43:59.752735 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46655dd3-846c-4668-bfda-4b8d4656c9a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:43:59.775057 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-46655dd3-846c-4668-bfda-4b8d4656c9a7 None None] MFA Rules not processed for user `5924414ee6e948a680b8b75c8797b466`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:43:59.776288 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-46655dd3-846c-4668-bfda-4b8d4656c9a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:43:59.845956 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1317/2640] 10.222.0.117 () {58 vars in 1014 bytes} [Tue Jan 25 02:43:59 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:43:59.892246 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb8aab5-fc9e-4c59-8a50-3b9c8344c102 service placement] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:43:59.893660 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-8eb8aab5-fc9e-4c59-8a50-3b9c8344c102 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:43:59.961796 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb8aab5-fc9e-4c59-8a50-3b9c8344c102 service placement] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:43:59.966686 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94aac1d7-557f-41e5-8517-166d85591804 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100f12ee56754f1c859106bf3e473df6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:43:59.967327 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aac1d7-557f-41e5-8517-166d85591804 service swift] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:43:59.967609 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aac1d7-557f-41e5-8517-166d85591804 service swift] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:43:59.968547 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aac1d7-557f-41e5-8517-166d85591804 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:43:59.976344 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94aac1d7-557f-41e5-8517-166d85591804 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:43:59.977937 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94aac1d7-557f-41e5-8517-166d85591804 service swift] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:43:59.985784 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1324/2641] 10.222.0.117 () {60 vars in 1389 bytes} [Tue Jan 25 02:43:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 25 02:44:14.162431 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50982d6-3c6f-47c1-a612-af811d7a8403 None None] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:44:14.162999 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50982d6-3c6f-47c1-a612-af811d7a8403 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:44:14.162999 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50982d6-3c6f-47c1-a612-af811d7a8403 None None] PATH_INFO: `/` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:44:14.164835 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1318/2642] 10.222.0.117 () {54 vars in 926 bytes} [Tue Jan 25 02:44:14 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:44:14.171767 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c6ad19-5921-4066-9ae6-877fdb0a0446 None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:44:14.172308 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c6ad19-5921-4066-9ae6-877fdb0a0446 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:44:14.172481 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c6ad19-5921-4066-9ae6-877fdb0a0446 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:44:14.190665 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-77c6ad19-5921-4066-9ae6-877fdb0a0446 None None] MFA Rules not processed for user `d9ad6269900346458050063c12cac299`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:44:14.192032 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-77c6ad19-5921-4066-9ae6-877fdb0a0446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:44:14.260281 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1325/2643] 10.222.0.117 () {58 vars in 1023 bytes} [Tue Jan 25 02:44:14 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 25 02:44:14.273390 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50982d6-3c6f-47c1-a612-af811d7a8403 None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:44:14.275076 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-b50982d6-3c6f-47c1-a612-af811d7a8403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:44:14.331674 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50982d6-3c6f-47c1-a612-af811d7a8403 None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:44:14.335250 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5386c5-c3f2-404c-b4cc-b38f44bf7f4b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db3663416137459d9da4a71032505b0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:44:14.335917 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5386c5-c3f2-404c-b4cc-b38f44bf7f4b service glance] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:44:14.336200 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5386c5-c3f2-404c-b4cc-b38f44bf7f4b service glance] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:44:14.336478 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5386c5-c3f2-404c-b4cc-b38f44bf7f4b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:44:14.346933 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5386c5-c3f2-404c-b4cc-b38f44bf7f4b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:44:14.348402 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5386c5-c3f2-404c-b4cc-b38f44bf7f4b service glance] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:44:14.358728 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1319/2644] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:44:14 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:44:14.425632 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d262300f-a3d8-46ef-a10d-d25ebce7d434 None None] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:44:14.425632 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d262300f-a3d8-46ef-a10d-d25ebce7d434 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:44:14.425960 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d262300f-a3d8-46ef-a10d-d25ebce7d434 None None] PATH_INFO: `/` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:44:14.427479 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1326/2645] 10.222.0.117 () {54 vars in 926 bytes} [Tue Jan 25 02:44:14 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jan 25 02:44:14.432240 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f574a1-b46e-455e-b852-2543d3295780 None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:44:14.432530 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f574a1-b46e-455e-b852-2543d3295780 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:44:14.432804 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f574a1-b46e-455e-b852-2543d3295780 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:44:14.451246 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-b3f574a1-b46e-455e-b852-2543d3295780 None None] MFA Rules not processed for user `9ca4071c5f8f4a31b5edb81fa66a43a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:44:14.453005 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-b3f574a1-b46e-455e-b852-2543d3295780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:44:14.459435 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1320/2646] 10.222.0.117 () {58 vars in 1023 bytes} [Tue Jan 25 02:44:14 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:44:14.471652 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d262300f-a3d8-46ef-a10d-d25ebce7d434 None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:44:14.482680 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d262300f-a3d8-46ef-a10d-d25ebce7d434 None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:44:14.486240 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c786a6d-9896-4b1c-8466-d9efcf2c72f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca4071c5f8f4a31b5edb81fa66a43a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:44:14.486858 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c786a6d-9896-4b1c-8466-d9efcf2c72f4 service neutron] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:44:14.487137 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c786a6d-9896-4b1c-8466-d9efcf2c72f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:44:14.487438 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c786a6d-9896-4b1c-8466-d9efcf2c72f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:44:14.494378 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c786a6d-9896-4b1c-8466-d9efcf2c72f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:44:14.495847 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c786a6d-9896-4b1c-8466-d9efcf2c72f4 service neutron] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:44:14.503969 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1327/2647] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:44:14 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:44:16.185354 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec975ed4-81ee-42ec-a6c4-280233ee59f8 None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:44:16.185814 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec975ed4-81ee-42ec-a6c4-280233ee59f8 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:44:16.185931 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec975ed4-81ee-42ec-a6c4-280233ee59f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:44:16.204727 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-ec975ed4-81ee-42ec-a6c4-280233ee59f8 None None] MFA Rules not processed for user `5924414ee6e948a680b8b75c8797b466`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:44:16.205963 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-ec975ed4-81ee-42ec-a6c4-280233ee59f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:44:16.213049 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1321/2648] 10.222.0.117 () {58 vars in 1014 bytes} [Tue Jan 25 02:44:16 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:44:16.224853 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c786a6d-9896-4b1c-8466-d9efcf2c72f4 service neutron] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:44:16.236681 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c786a6d-9896-4b1c-8466-d9efcf2c72f4 service neutron] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:44:16.241571 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28559195-a062-442d-b8c9-5f8e643357a6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100f12ee56754f1c859106bf3e473df6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:44:16.242205 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28559195-a062-442d-b8c9-5f8e643357a6 service swift] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:44:16.242488 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28559195-a062-442d-b8c9-5f8e643357a6 service swift] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:44:16.242764 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28559195-a062-442d-b8c9-5f8e643357a6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:44:16.251246 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28559195-a062-442d-b8c9-5f8e643357a6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:44:16.252865 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28559195-a062-442d-b8c9-5f8e643357a6 service swift] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:44:16.260700 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1328/2649] 10.222.0.117 () {60 vars in 1389 bytes} [Tue Jan 25 02:44:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 25 02:44:36.651666 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cad19c-ea54-4f34-ae98-08fd221daa99 None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:44:36.652182 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cad19c-ea54-4f34-ae98-08fd221daa99 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:44:36.652277 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cad19c-ea54-4f34-ae98-08fd221daa99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:44:36.669206 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-90cad19c-ea54-4f34-ae98-08fd221daa99 None None] MFA Rules not processed for user `5924414ee6e948a680b8b75c8797b466`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:44:36.670379 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-90cad19c-ea54-4f34-ae98-08fd221daa99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:44:36.679676 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1322/2650] 10.222.0.117 () {58 vars in 972 bytes} [Tue Jan 25 02:44:36 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:44:36.693334 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28559195-a062-442d-b8c9-5f8e643357a6 service swift] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:44:36.705404 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28559195-a062-442d-b8c9-5f8e643357a6 service swift] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:44:36.710809 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d198ad0-7721-412a-95db-e05aceed2a8d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100f12ee56754f1c859106bf3e473df6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:44:36.711441 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d198ad0-7721-412a-95db-e05aceed2a8d service swift] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:44:36.711746 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d198ad0-7721-412a-95db-e05aceed2a8d service swift] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:44:36.712028 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d198ad0-7721-412a-95db-e05aceed2a8d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:44:36.720204 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d198ad0-7721-412a-95db-e05aceed2a8d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:44:36.721802 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d198ad0-7721-412a-95db-e05aceed2a8d service swift] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:44:36.729584 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1329/2651] 10.222.0.117 () {60 vars in 1389 bytes} [Tue Jan 25 02:44:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 25 02:44:38.364319 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cad19c-ea54-4f34-ae98-08fd221daa99 None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:44:38.365740 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-90cad19c-ea54-4f34-ae98-08fd221daa99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:44:38.419602 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cad19c-ea54-4f34-ae98-08fd221daa99 None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:44:38.423842 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a876da47-c14f-44ef-bd37-f617d3b912d2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cc5249aea09430080e232cf17757f86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:44:38.424486 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a876da47-c14f-44ef-bd37-f617d3b912d2 service cinder] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:44:38.424771 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a876da47-c14f-44ef-bd37-f617d3b912d2 service cinder] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:44:38.425050 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a876da47-c14f-44ef-bd37-f617d3b912d2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:44:38.426799 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-a876da47-c14f-44ef-bd37-f617d3b912d2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:44:38.482866 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a876da47-c14f-44ef-bd37-f617d3b912d2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:44:38.484329 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a876da47-c14f-44ef-bd37-f617d3b912d2 service cinder] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:44:38.493790 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1323/2652] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:44:38 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:44:46.576965 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb8ad93-4282-43d9-88a9-96af95d29577 None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:44:46.577502 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb8ad93-4282-43d9-88a9-96af95d29577 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:44:46.577611 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb8ad93-4282-43d9-88a9-96af95d29577 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:44:46.597074 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-ddb8ad93-4282-43d9-88a9-96af95d29577 None None] MFA Rules not processed for user `8f9b0a291a2041aab799eef5bbf8f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:44:46.598271 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-ddb8ad93-4282-43d9-88a9-96af95d29577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:44:46.605135 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1330/2653] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:44:46 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:45:10.144148 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e47fd74-f86c-4b92-b5d2-b87f3c968e2b None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:45:10.144762 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e47fd74-f86c-4b92-b5d2-b87f3c968e2b None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:45:10.144762 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e47fd74-f86c-4b92-b5d2-b87f3c968e2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:45:10.165482 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-7e47fd74-f86c-4b92-b5d2-b87f3c968e2b None None] MFA Rules not processed for user `1467bd27c3c441f19715f33dd6c3d78a`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:45:10.166706 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-7e47fd74-f86c-4b92-b5d2-b87f3c968e2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:45:10.173524 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1324/2654] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:45:10 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:45:26.086065 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb8ad93-4282-43d9-88a9-96af95d29577 None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:45:26.095600 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb8ad93-4282-43d9-88a9-96af95d29577 None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:45:26.099480 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0bce7f-7553-459f-984d-03cc5932004d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca4071c5f8f4a31b5edb81fa66a43a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:45:26.100150 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0bce7f-7553-459f-984d-03cc5932004d service neutron] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:45:26.100430 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0bce7f-7553-459f-984d-03cc5932004d service neutron] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:45:26.100706 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0bce7f-7553-459f-984d-03cc5932004d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:45:26.102459 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-bc0bce7f-7553-459f-984d-03cc5932004d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:45:26.116025 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0bce7f-7553-459f-984d-03cc5932004d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:45:26.117478 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0bce7f-7553-459f-984d-03cc5932004d service neutron] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:45:26.128480 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1331/2655] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:45:26 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:45:33.686217 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e47fd74-f86c-4b92-b5d2-b87f3c968e2b None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:45:33.687632 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-7e47fd74-f86c-4b92-b5d2-b87f3c968e2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:45:33.700507 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e47fd74-f86c-4b92-b5d2-b87f3c968e2b None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:45:33.704140 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe8baf1-bf19-48c7-8fbb-05fd83092d34 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cc5249aea09430080e232cf17757f86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:45:33.704778 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe8baf1-bf19-48c7-8fbb-05fd83092d34 service cinder] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:45:33.705061 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe8baf1-bf19-48c7-8fbb-05fd83092d34 service cinder] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:45:33.705365 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe8baf1-bf19-48c7-8fbb-05fd83092d34 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:45:33.707108 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-afe8baf1-bf19-48c7-8fbb-05fd83092d34 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:45:33.784950 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe8baf1-bf19-48c7-8fbb-05fd83092d34 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:45:33.786980 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe8baf1-bf19-48c7-8fbb-05fd83092d34 service cinder] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:45:33.804721 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1325/2656] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:45:33 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:45:40.679283 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0bce7f-7553-459f-984d-03cc5932004d service neutron] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:45:40.687800 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0bce7f-7553-459f-984d-03cc5932004d service neutron] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:45:40.692318 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c059a76-7605-450b-9727-233989248898 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca4071c5f8f4a31b5edb81fa66a43a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:45:40.693315 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c059a76-7605-450b-9727-233989248898 service neutron] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:45:40.693798 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c059a76-7605-450b-9727-233989248898 service neutron] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:45:40.694082 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c059a76-7605-450b-9727-233989248898 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:45:40.695992 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-7c059a76-7605-450b-9727-233989248898 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:45:40.759971 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c059a76-7605-450b-9727-233989248898 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:45:40.761599 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c059a76-7605-450b-9727-233989248898 service neutron] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:45:40.772011 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1332/2657] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:45:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:45:44.043005 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe8baf1-bf19-48c7-8fbb-05fd83092d34 service cinder] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:45:44.044780 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-afe8baf1-bf19-48c7-8fbb-05fd83092d34 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:45:44.059358 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe8baf1-bf19-48c7-8fbb-05fd83092d34 service cinder] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:45:44.063781 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd172bdf-d6d1-4b82-917e-c7c585bfa012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:45:44.064638 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd172bdf-d6d1-4b82-917e-c7c585bfa012 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:45:44.064913 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd172bdf-d6d1-4b82-917e-c7c585bfa012 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:45:44.065183 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd172bdf-d6d1-4b82-917e-c7c585bfa012 admin admin] PATH_INFO: `/v3/users/a366d243b91b479cac0fa7f3238cbafa` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:45:44.066436 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd172bdf-d6d1-4b82-917e-c7c585bfa012 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a366d243b91b479cac0fa7f3238cbafa)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:45:44.068883 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd172bdf-d6d1-4b82-917e-c7c585bfa012 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:45:44.115775 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-bd172bdf-d6d1-4b82-917e-c7c585bfa012 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a366d243b91b479cac0fa7f3238cbafa'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:45:44.122694 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-bd172bdf-d6d1-4b82-917e-c7c585bfa012 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a366d243b91b479cac0fa7f3238cbafa'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:45:44.123305 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-bd172bdf-d6d1-4b82-917e-c7c585bfa012 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a366d243b91b479cac0fa7f3238cbafa'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:45:44.123942 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-bd172bdf-d6d1-4b82-917e-c7c585bfa012 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a366d243b91b479cac0fa7f3238cbafa'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:45:44.135630 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-bd172bdf-d6d1-4b82-917e-c7c585bfa012 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a366d243b91b479cac0fa7f3238cbafa'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:45:44.147822 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1326/2658] 10.222.0.117 () {58 vars in 1228 bytes} [Tue Jan 25 02:45:44 2022] DELETE /identity/v3/users/a366d243b91b479cac0fa7f3238cbafa => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:45:44.317813 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c059a76-7605-450b-9727-233989248898 service neutron] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:45:44.329951 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c059a76-7605-450b-9727-233989248898 service neutron] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:45:44.386751 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da8cb24-9e20-4a80-92fa-dd1b70363116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:45:44.387612 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da8cb24-9e20-4a80-92fa-dd1b70363116 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:45:44.387925 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da8cb24-9e20-4a80-92fa-dd1b70363116 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:45:44.388200 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da8cb24-9e20-4a80-92fa-dd1b70363116 admin admin] PATH_INFO: `/v3/projects/461a94a96965493aa3c9fdfcd43258c5` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:45:44.389391 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da8cb24-9e20-4a80-92fa-dd1b70363116 admin admin] RBAC: Authorizing `identity:delete_project(project_id=461a94a96965493aa3c9fdfcd43258c5)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:45:44.391313 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da8cb24-9e20-4a80-92fa-dd1b70363116 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:45:44.435167 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-5da8cb24-9e20-4a80-92fa-dd1b70363116 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '461a94a96965493aa3c9fdfcd43258c5', 'request_id': 'req-5da8cb24-9e20-4a80-92fa-dd1b70363116'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:45:44.440323 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-5da8cb24-9e20-4a80-92fa-dd1b70363116 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '461a94a96965493aa3c9fdfcd43258c5', 'request_id': 'req-5da8cb24-9e20-4a80-92fa-dd1b70363116'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:45:44.448094 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-5da8cb24-9e20-4a80-92fa-dd1b70363116 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '461a94a96965493aa3c9fdfcd43258c5', 'request_id': 'req-5da8cb24-9e20-4a80-92fa-dd1b70363116'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:45:44.459508 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-5da8cb24-9e20-4a80-92fa-dd1b70363116 admin admin] The token cache is being invalidate because project 461a94a96965493aa3c9fdfcd43258c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79121) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 25 02:45:44.459849 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-5da8cb24-9e20-4a80-92fa-dd1b70363116 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:45:44.460457 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-5da8cb24-9e20-4a80-92fa-dd1b70363116 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:45:44.461999 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1333/2659] 10.222.0.117 () {58 vars in 1237 bytes} [Tue Jan 25 02:45:44 2022] DELETE /identity/v3/projects/461a94a96965493aa3c9fdfcd43258c5 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:45:44.467774 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b51db5-3bea-4d3a-a39f-cc38b5fcd6df None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:45:44.468067 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b51db5-3bea-4d3a-a39f-cc38b5fcd6df None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:45:44.468346 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b51db5-3bea-4d3a-a39f-cc38b5fcd6df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:45:44.486583 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-53b51db5-3bea-4d3a-a39f-cc38b5fcd6df None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:45:44.487832 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-53b51db5-3bea-4d3a-a39f-cc38b5fcd6df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:45:44.546136 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1327/2660] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:45:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 25 02:45:44.555062 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c07135-9b32-405c-9272-27f454be3c15 None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:45:44.555354 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c07135-9b32-405c-9272-27f454be3c15 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:45:44.555633 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c07135-9b32-405c-9272-27f454be3c15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:45:44.574226 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-76c07135-9b32-405c-9272-27f454be3c15 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:45:44.575433 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-76c07135-9b32-405c-9272-27f454be3c15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:45:44.583919 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1334/2661] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:45:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:45:44.588000 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b51db5-3bea-4d3a-a39f-cc38b5fcd6df None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:45:44.597660 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b51db5-3bea-4d3a-a39f-cc38b5fcd6df None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:45:44.603039 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2bc565-884e-41a5-973d-6de8116bd6ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:45:44.603722 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2bc565-884e-41a5-973d-6de8116bd6ec admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:45:44.604020 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2bc565-884e-41a5-973d-6de8116bd6ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:45:44.604313 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2bc565-884e-41a5-973d-6de8116bd6ec admin admin] PATH_INFO: `/v3/domains` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:45:44.605052 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2bc565-884e-41a5-973d-6de8116bd6ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:45:44.605358 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2bc565-884e-41a5-973d-6de8116bd6ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:45:44.606986 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2bc565-884e-41a5-973d-6de8116bd6ec admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:45:44.618875 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1328/2662] 10.222.0.117 () {58 vars in 1157 bytes} [Tue Jan 25 02:45:44 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 25 02:45:44.623335 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c07135-9b32-405c-9272-27f454be3c15 None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:45:44.632740 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c07135-9b32-405c-9272-27f454be3c15 None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:45:44.637400 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31df2a09-ef02-4307-8805-95abe7f5b0a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:45:44.638049 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31df2a09-ef02-4307-8805-95abe7f5b0a4 admin admin] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:45:44.638330 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31df2a09-ef02-4307-8805-95abe7f5b0a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:45:44.638604 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31df2a09-ef02-4307-8805-95abe7f5b0a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:45:44.639304 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31df2a09-ef02-4307-8805-95abe7f5b0a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:45:44.641249 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31df2a09-ef02-4307-8805-95abe7f5b0a4 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:45:44.675630 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1335/2663] 10.222.0.117 () {60 vars in 1157 bytes} [Tue Jan 25 02:45:44 2022] POST /identity/v3/projects => generated 404 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 02:45:44.681115 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2bc565-884e-41a5-973d-6de8116bd6ec admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:45:44.690818 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2bc565-884e-41a5-973d-6de8116bd6ec admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:45:44.747134 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c5e28b-8a0d-4bc3-ac31-7e7e123cabfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:45:44.747815 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c5e28b-8a0d-4bc3-ac31-7e7e123cabfa admin admin] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:45:44.748097 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c5e28b-8a0d-4bc3-ac31-7e7e123cabfa admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:45:44.748374 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c5e28b-8a0d-4bc3-ac31-7e7e123cabfa admin admin] PATH_INFO: `/v3/users` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:45:44.749057 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c5e28b-8a0d-4bc3-ac31-7e7e123cabfa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:45:44.750957 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c5e28b-8a0d-4bc3-ac31-7e7e123cabfa admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:45:44.770729 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1329/2664] 10.222.0.117 () {60 vars in 1148 bytes} [Tue Jan 25 02:45:44 2022] POST /identity/v3/users => generated 303 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 02:45:44.774555 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31df2a09-ef02-4307-8805-95abe7f5b0a4 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:45:44.784707 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31df2a09-ef02-4307-8805-95abe7f5b0a4 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:45:44.790041 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312c6f16-1aca-4fe4-8912-66512a14696e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:45:44.790692 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312c6f16-1aca-4fe4-8912-66512a14696e admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:45:44.790980 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312c6f16-1aca-4fe4-8912-66512a14696e admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:45:44.791261 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312c6f16-1aca-4fe4-8912-66512a14696e admin admin] PATH_INFO: `/v3/roles` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:45:44.792048 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312c6f16-1aca-4fe4-8912-66512a14696e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:45:44.793656 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312c6f16-1aca-4fe4-8912-66512a14696e admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:45:44.803511 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1336/2665] 10.222.0.117 () {58 vars in 1126 bytes} [Tue Jan 25 02:45:44 2022] GET /identity/v3/roles => generated 1427 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 02:45:44.807173 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c5e28b-8a0d-4bc3-ac31-7e7e123cabfa admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:45:44.816824 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c5e28b-8a0d-4bc3-ac31-7e7e123cabfa admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:45:44.821847 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f2f103-c2ed-4d06-9b8a-e19c6da1a896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:45:44.822534 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f2f103-c2ed-4d06-9b8a-e19c6da1a896 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:45:44.822815 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f2f103-c2ed-4d06-9b8a-e19c6da1a896 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:45:44.823119 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f2f103-c2ed-4d06-9b8a-e19c6da1a896 admin admin] PATH_INFO: `/v3/roles` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:45:44.823920 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f2f103-c2ed-4d06-9b8a-e19c6da1a896 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:45:44.825545 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f2f103-c2ed-4d06-9b8a-e19c6da1a896 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:45:44.836529 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1330/2666] 10.222.0.117 () {58 vars in 1126 bytes} [Tue Jan 25 02:45:44 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 02:45:44.840541 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312c6f16-1aca-4fe4-8912-66512a14696e admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:45:44.851323 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312c6f16-1aca-4fe4-8912-66512a14696e admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:45:44.855959 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d7855e-1327-4680-b991-e95faf518533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:45:44.856827 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d7855e-1327-4680-b991-e95faf518533 admin admin] REQUEST_METHOD: `PUT` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:45:44.857137 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d7855e-1327-4680-b991-e95faf518533 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:45:44.857412 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d7855e-1327-4680-b991-e95faf518533 admin admin] PATH_INFO: `/v3/projects/bcd08de294344d6796ff60fb12a350b4/users/3152621c38c7464283596ceb205699c6/roles/33a8e87420ed423f9cb29e0084eab5d2` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:45:44.871451 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d7855e-1327-4680-b991-e95faf518533 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bcd08de294344d6796ff60fb12a350b4, user_id=3152621c38c7464283596ceb205699c6, role_id=33a8e87420ed423f9cb29e0084eab5d2)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:45:44.874132 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d7855e-1327-4680-b991-e95faf518533 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:45:44.887771 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1337/2667] 10.222.0.117 () {60 vars in 1487 bytes} [Tue Jan 25 02:45:44 2022] PUT /identity/v3/projects/bcd08de294344d6796ff60fb12a350b4/users/3152621c38c7464283596ceb205699c6/roles/33a8e87420ed423f9cb29e0084eab5d2 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:45:44.898283 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b4da5c-2f23-4845-b492-9fe934d9488e None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:45:44.898570 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b4da5c-2f23-4845-b492-9fe934d9488e None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:45:44.898865 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b4da5c-2f23-4845-b492-9fe934d9488e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:45:44.925344 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-a3b4da5c-2f23-4845-b492-9fe934d9488e None None] MFA Rules not processed for user `3152621c38c7464283596ceb205699c6`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:45:44.927105 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-a3b4da5c-2f23-4845-b492-9fe934d9488e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:45:45.004481 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1331/2668] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:45:44 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:45:45.008888 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d7855e-1327-4680-b991-e95faf518533 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:45:45.069269 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d7855e-1327-4680-b991-e95faf518533 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:45:45.074145 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa3b0d2-4cc4-48bd-8b05-96e7e92fdfaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:45:45.074795 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa3b0d2-4cc4-48bd-8b05-96e7e92fdfaf admin admin] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:45:45.075083 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa3b0d2-4cc4-48bd-8b05-96e7e92fdfaf admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:45:45.075362 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa3b0d2-4cc4-48bd-8b05-96e7e92fdfaf admin admin] PATH_INFO: `/v3/projects` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:45:45.076095 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa3b0d2-4cc4-48bd-8b05-96e7e92fdfaf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:45:45.078023 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa3b0d2-4cc4-48bd-8b05-96e7e92fdfaf admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:45:45.106998 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1338/2669] 10.222.0.117 () {60 vars in 1157 bytes} [Tue Jan 25 02:45:45 2022] POST /identity/v3/projects => generated 406 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 02:45:45.108926 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b4da5c-2f23-4845-b492-9fe934d9488e None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:45:45.119322 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b4da5c-2f23-4845-b492-9fe934d9488e None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:45:45.176551 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc654d52-924b-425b-8bb8-e425d7277241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:45:45.177263 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc654d52-924b-425b-8bb8-e425d7277241 admin admin] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:45:45.177549 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc654d52-924b-425b-8bb8-e425d7277241 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:45:45.177856 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc654d52-924b-425b-8bb8-e425d7277241 admin admin] PATH_INFO: `/v3/users` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:45:45.178556 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc654d52-924b-425b-8bb8-e425d7277241 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:45:45.180521 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc654d52-924b-425b-8bb8-e425d7277241 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:45:45.204976 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1332/2670] 10.222.0.117 () {60 vars in 1148 bytes} [Tue Jan 25 02:45:45 2022] POST /identity/v3/users => generated 310 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 02:45:45.205762 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa3b0d2-4cc4-48bd-8b05-96e7e92fdfaf admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:45:45.216689 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa3b0d2-4cc4-48bd-8b05-96e7e92fdfaf admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:45:45.221541 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1f3361-daf9-4357-88c3-b1951a679c84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:45:45.222204 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1f3361-daf9-4357-88c3-b1951a679c84 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:45:45.222491 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1f3361-daf9-4357-88c3-b1951a679c84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:45:45.223286 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1f3361-daf9-4357-88c3-b1951a679c84 admin admin] PATH_INFO: `/v3/roles` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:45:45.224090 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1f3361-daf9-4357-88c3-b1951a679c84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:45:45.225729 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1f3361-daf9-4357-88c3-b1951a679c84 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:45:45.236211 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1339/2671] 10.222.0.117 () {58 vars in 1126 bytes} [Tue Jan 25 02:45:45 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 25 02:45:45.240890 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc654d52-924b-425b-8bb8-e425d7277241 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:45:45.250607 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc654d52-924b-425b-8bb8-e425d7277241 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:45:45.255330 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1cc19a-e824-4307-82b2-0bb191deec73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:45:45.256233 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1cc19a-e824-4307-82b2-0bb191deec73 admin admin] REQUEST_METHOD: `PUT` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:45:45.256515 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1cc19a-e824-4307-82b2-0bb191deec73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:45:45.256789 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1cc19a-e824-4307-82b2-0bb191deec73 admin admin] PATH_INFO: `/v3/projects/2af8372f99f04bf49771b1459f2131fc/users/45873efb46ec4dbea32a28e41c20a83e/roles/d8dbc6d83d9d41d28c3feb8b3485b291` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:45:45.271626 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1cc19a-e824-4307-82b2-0bb191deec73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2af8372f99f04bf49771b1459f2131fc, user_id=45873efb46ec4dbea32a28e41c20a83e, role_id=d8dbc6d83d9d41d28c3feb8b3485b291)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:45:45.274301 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1cc19a-e824-4307-82b2-0bb191deec73 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:45:45.287622 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1333/2672] 10.222.0.117 () {60 vars in 1487 bytes} [Tue Jan 25 02:45:45 2022] PUT /identity/v3/projects/2af8372f99f04bf49771b1459f2131fc/users/45873efb46ec4dbea32a28e41c20a83e/roles/d8dbc6d83d9d41d28c3feb8b3485b291 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 25 02:45:45.291521 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1f3361-daf9-4357-88c3-b1951a679c84 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:45:45.301951 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1f3361-daf9-4357-88c3-b1951a679c84 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:45:45.356201 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4b82fa-b9ce-481d-a19b-5861d7fd32d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:45:45.356875 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4b82fa-b9ce-481d-a19b-5861d7fd32d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:45:45.357164 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4b82fa-b9ce-481d-a19b-5861d7fd32d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:45:45.357442 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4b82fa-b9ce-481d-a19b-5861d7fd32d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:45:45.358179 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4b82fa-b9ce-481d-a19b-5861d7fd32d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:45:45.359816 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4b82fa-b9ce-481d-a19b-5861d7fd32d0 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:45:45.371411 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1340/2673] 10.222.0.117 () {58 vars in 1126 bytes} [Tue Jan 25 02:45:45 2022] GET /identity/v3/roles => generated 1427 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 02:45:45.375349 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1cc19a-e824-4307-82b2-0bb191deec73 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:45:45.386147 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1cc19a-e824-4307-82b2-0bb191deec73 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:45:45.390820 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13478d43-69dd-491b-b3fb-bf030d068aea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:45:45.391814 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13478d43-69dd-491b-b3fb-bf030d068aea admin admin] REQUEST_METHOD: `PUT` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:45:45.392149 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13478d43-69dd-491b-b3fb-bf030d068aea admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:45:45.392488 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13478d43-69dd-491b-b3fb-bf030d068aea admin admin] PATH_INFO: `/v3/projects/2af8372f99f04bf49771b1459f2131fc/users/45873efb46ec4dbea32a28e41c20a83e/roles/d8dbc6d83d9d41d28c3feb8b3485b291` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:45:45.394532 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13478d43-69dd-491b-b3fb-bf030d068aea admin admin] RBAC: Authorizing `identity:create_grant(project_id=2af8372f99f04bf49771b1459f2131fc, user_id=45873efb46ec4dbea32a28e41c20a83e, role_id=d8dbc6d83d9d41d28c3feb8b3485b291)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:45:45.397848 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13478d43-69dd-491b-b3fb-bf030d068aea admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:45:45.408129 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1334/2674] 10.222.0.117 () {60 vars in 1487 bytes} [Tue Jan 25 02:45:45 2022] PUT /identity/v3/projects/2af8372f99f04bf49771b1459f2131fc/users/45873efb46ec4dbea32a28e41c20a83e/roles/d8dbc6d83d9d41d28c3feb8b3485b291 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:45:45.418546 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa35c316-1cb4-46f0-a5ba-cfa80c854363 None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:45:45.418843 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa35c316-1cb4-46f0-a5ba-cfa80c854363 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:45:45.419274 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa35c316-1cb4-46f0-a5ba-cfa80c854363 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:45:45.450294 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-fa35c316-1cb4-46f0-a5ba-cfa80c854363 None None] MFA Rules not processed for user `45873efb46ec4dbea32a28e41c20a83e`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:45:45.451186 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-fa35c316-1cb4-46f0-a5ba-cfa80c854363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:45:45.518402 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1341/2675] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:45:45 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:45:45.528430 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13478d43-69dd-491b-b3fb-bf030d068aea admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:45:45.530255 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-13478d43-69dd-491b-b3fb-bf030d068aea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:45:45.587861 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13478d43-69dd-491b-b3fb-bf030d068aea admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:45:45.591510 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0a903c-c957-41f3-ac89-439b4a875950 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cc5249aea09430080e232cf17757f86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:45:45.592182 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0a903c-c957-41f3-ac89-439b4a875950 service cinder] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:45:45.592465 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0a903c-c957-41f3-ac89-439b4a875950 service cinder] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:45:45.592740 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0a903c-c957-41f3-ac89-439b4a875950 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:45:45.601835 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0a903c-c957-41f3-ac89-439b4a875950 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:45:45.603318 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0a903c-c957-41f3-ac89-439b4a875950 service cinder] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:45:45.612412 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1335/2676] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:45:45 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:45:45.754283 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa35c316-1cb4-46f0-a5ba-cfa80c854363 None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:45:45.816049 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa35c316-1cb4-46f0-a5ba-cfa80c854363 None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:45:45.821427 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e0d27b-bd2c-4bed-8dae-b95c7e2a49c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:45:45.822290 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e0d27b-bd2c-4bed-8dae-b95c7e2a49c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:45:45.822573 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e0d27b-bd2c-4bed-8dae-b95c7e2a49c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:45:45.822851 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e0d27b-bd2c-4bed-8dae-b95c7e2a49c9 admin admin] PATH_INFO: `/v3/users/3152621c38c7464283596ceb205699c6` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:45:45.824071 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e0d27b-bd2c-4bed-8dae-b95c7e2a49c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3152621c38c7464283596ceb205699c6)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:45:45.825985 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e0d27b-bd2c-4bed-8dae-b95c7e2a49c9 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:45:45.869950 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-79e0d27b-bd2c-4bed-8dae-b95c7e2a49c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3152621c38c7464283596ceb205699c6'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:45:45.870586 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-79e0d27b-bd2c-4bed-8dae-b95c7e2a49c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3152621c38c7464283596ceb205699c6'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:45:45.877368 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-79e0d27b-bd2c-4bed-8dae-b95c7e2a49c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3152621c38c7464283596ceb205699c6'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:45:45.878001 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-79e0d27b-bd2c-4bed-8dae-b95c7e2a49c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3152621c38c7464283596ceb205699c6'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:45:45.884864 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-79e0d27b-bd2c-4bed-8dae-b95c7e2a49c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3152621c38c7464283596ceb205699c6'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:45:45.902283 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1342/2677] 10.222.0.117 () {58 vars in 1228 bytes} [Tue Jan 25 02:45:45 2022] DELETE /identity/v3/users/3152621c38c7464283596ceb205699c6 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:45:45.906789 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f13a430-6652-4819-a5f0-1d71f2adf012 None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:45:45.907081 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f13a430-6652-4819-a5f0-1d71f2adf012 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:45:45.907361 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f13a430-6652-4819-a5f0-1d71f2adf012 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:45:45.925944 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-8f13a430-6652-4819-a5f0-1d71f2adf012 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:45:45.927898 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-8f13a430-6652-4819-a5f0-1d71f2adf012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:45:45.983262 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1336/2678] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:45:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 25 02:45:45.993635 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e0d27b-bd2c-4bed-8dae-b95c7e2a49c9 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:45:45.995051 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-79e0d27b-bd2c-4bed-8dae-b95c7e2a49c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:45:46.053002 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e0d27b-bd2c-4bed-8dae-b95c7e2a49c9 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:45:46.056767 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7119ab1-716d-4ce8-b861-93b7672557aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca4071c5f8f4a31b5edb81fa66a43a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:45:46.057406 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7119ab1-716d-4ce8-b861-93b7672557aa service neutron] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:45:46.057692 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7119ab1-716d-4ce8-b861-93b7672557aa service neutron] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:45:46.057970 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7119ab1-716d-4ce8-b861-93b7672557aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:45:46.067291 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7119ab1-716d-4ce8-b861-93b7672557aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:45:46.068785 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7119ab1-716d-4ce8-b861-93b7672557aa service neutron] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:45:46.078270 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1343/2679] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:45:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:45:46.347092 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f13a430-6652-4819-a5f0-1d71f2adf012 None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:45:46.349340 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-8f13a430-6652-4819-a5f0-1d71f2adf012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:45:46.362083 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f13a430-6652-4819-a5f0-1d71f2adf012 None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:45:46.368362 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a86ad6-eb50-4390-8d57-1badf66981be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:45:46.369391 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a86ad6-eb50-4390-8d57-1badf66981be admin admin] REQUEST_METHOD: `DELETE` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:45:46.369780 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a86ad6-eb50-4390-8d57-1badf66981be admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:45:46.369940 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a86ad6-eb50-4390-8d57-1badf66981be admin admin] PATH_INFO: `/v3/projects/bcd08de294344d6796ff60fb12a350b4` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:45:46.371129 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a86ad6-eb50-4390-8d57-1badf66981be admin admin] RBAC: Authorizing `identity:delete_project(project_id=bcd08de294344d6796ff60fb12a350b4)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:45:46.373112 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a86ad6-eb50-4390-8d57-1badf66981be admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:45:46.418434 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-07a86ad6-eb50-4390-8d57-1badf66981be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bcd08de294344d6796ff60fb12a350b4', 'request_id': 'req-07a86ad6-eb50-4390-8d57-1badf66981be'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:45:46.423435 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-07a86ad6-eb50-4390-8d57-1badf66981be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bcd08de294344d6796ff60fb12a350b4', 'request_id': 'req-07a86ad6-eb50-4390-8d57-1badf66981be'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:45:46.430182 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-07a86ad6-eb50-4390-8d57-1badf66981be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bcd08de294344d6796ff60fb12a350b4', 'request_id': 'req-07a86ad6-eb50-4390-8d57-1badf66981be'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:45:46.442507 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-07a86ad6-eb50-4390-8d57-1badf66981be admin admin] The token cache is being invalidate because project bcd08de294344d6796ff60fb12a350b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79120) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 25 02:45:46.442793 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-07a86ad6-eb50-4390-8d57-1badf66981be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:45:46.443401 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-07a86ad6-eb50-4390-8d57-1badf66981be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:45:46.444912 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1337/2680] 10.222.0.117 () {58 vars in 1237 bytes} [Tue Jan 25 02:45:46 2022] DELETE /identity/v3/projects/bcd08de294344d6796ff60fb12a350b4 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:45:46.449237 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7119ab1-716d-4ce8-b861-93b7672557aa service neutron] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:45:46.458883 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7119ab1-716d-4ce8-b861-93b7672557aa service neutron] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:45:46.512872 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946dc8e4-58f6-4fd5-8f1b-01b9a1db0758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:45:46.513781 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946dc8e4-58f6-4fd5-8f1b-01b9a1db0758 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:45:46.514059 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946dc8e4-58f6-4fd5-8f1b-01b9a1db0758 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:45:46.514331 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946dc8e4-58f6-4fd5-8f1b-01b9a1db0758 admin admin] PATH_INFO: `/v3/users/45873efb46ec4dbea32a28e41c20a83e` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:45:46.515508 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946dc8e4-58f6-4fd5-8f1b-01b9a1db0758 admin admin] RBAC: Authorizing `identity:delete_user(user_id=45873efb46ec4dbea32a28e41c20a83e)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:45:46.517470 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946dc8e4-58f6-4fd5-8f1b-01b9a1db0758 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:45:46.563058 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-946dc8e4-58f6-4fd5-8f1b-01b9a1db0758 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45873efb46ec4dbea32a28e41c20a83e'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:45:46.563721 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-946dc8e4-58f6-4fd5-8f1b-01b9a1db0758 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45873efb46ec4dbea32a28e41c20a83e'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:45:46.570351 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-946dc8e4-58f6-4fd5-8f1b-01b9a1db0758 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45873efb46ec4dbea32a28e41c20a83e'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:45:46.570978 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-946dc8e4-58f6-4fd5-8f1b-01b9a1db0758 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45873efb46ec4dbea32a28e41c20a83e'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:45:46.578475 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-946dc8e4-58f6-4fd5-8f1b-01b9a1db0758 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45873efb46ec4dbea32a28e41c20a83e'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:45:46.595762 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1344/2681] 10.222.0.117 () {58 vars in 1228 bytes} [Tue Jan 25 02:45:46 2022] DELETE /identity/v3/users/45873efb46ec4dbea32a28e41c20a83e => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 25 02:45:46.863956 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a86ad6-eb50-4390-8d57-1badf66981be admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:45:46.865680 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-07a86ad6-eb50-4390-8d57-1badf66981be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:45:46.878442 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a86ad6-eb50-4390-8d57-1badf66981be admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:45:46.935981 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d96c5f6-a067-40a5-950d-911ce3b6b1bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:45:46.936753 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d96c5f6-a067-40a5-950d-911ce3b6b1bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:45:46.937035 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d96c5f6-a067-40a5-950d-911ce3b6b1bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:45:46.937308 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d96c5f6-a067-40a5-950d-911ce3b6b1bb admin admin] PATH_INFO: `/v3/projects/2af8372f99f04bf49771b1459f2131fc` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:45:46.938517 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d96c5f6-a067-40a5-950d-911ce3b6b1bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=2af8372f99f04bf49771b1459f2131fc)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:45:46.940485 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d96c5f6-a067-40a5-950d-911ce3b6b1bb admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:45:46.987283 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-9d96c5f6-a067-40a5-950d-911ce3b6b1bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2af8372f99f04bf49771b1459f2131fc', 'request_id': 'req-9d96c5f6-a067-40a5-950d-911ce3b6b1bb'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:45:46.993498 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-9d96c5f6-a067-40a5-950d-911ce3b6b1bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2af8372f99f04bf49771b1459f2131fc', 'request_id': 'req-9d96c5f6-a067-40a5-950d-911ce3b6b1bb'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:45:46.999467 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-9d96c5f6-a067-40a5-950d-911ce3b6b1bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2af8372f99f04bf49771b1459f2131fc', 'request_id': 'req-9d96c5f6-a067-40a5-950d-911ce3b6b1bb'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:45:47.011918 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-9d96c5f6-a067-40a5-950d-911ce3b6b1bb admin admin] The token cache is being invalidate because project 2af8372f99f04bf49771b1459f2131fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79120) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 25 02:45:47.012204 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-9d96c5f6-a067-40a5-950d-911ce3b6b1bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:45:47.012814 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-9d96c5f6-a067-40a5-950d-911ce3b6b1bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:45:47.014410 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1338/2682] 10.222.0.117 () {58 vars in 1237 bytes} [Tue Jan 25 02:45:46 2022] DELETE /identity/v3/projects/2af8372f99f04bf49771b1459f2131fc => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:45:47.020513 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f922600-2469-4ea8-ac34-c2a085573f91 None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:45:47.020816 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f922600-2469-4ea8-ac34-c2a085573f91 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:45:47.021096 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f922600-2469-4ea8-ac34-c2a085573f91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:45:47.039041 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-8f922600-2469-4ea8-ac34-c2a085573f91 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:45:47.040271 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-8f922600-2469-4ea8-ac34-c2a085573f91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:45:47.098174 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1345/2683] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:45:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:45:47.107080 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4ca5b1-6885-449c-98f4-6de009ec5429 None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:45:47.107370 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4ca5b1-6885-449c-98f4-6de009ec5429 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:45:47.107647 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4ca5b1-6885-449c-98f4-6de009ec5429 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:45:47.126014 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-eb4ca5b1-6885-449c-98f4-6de009ec5429 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:45:47.127190 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-eb4ca5b1-6885-449c-98f4-6de009ec5429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:45:47.135566 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1339/2684] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:45:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:45:47.139575 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f922600-2469-4ea8-ac34-c2a085573f91 None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:45:47.148991 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f922600-2469-4ea8-ac34-c2a085573f91 None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:45:47.153554 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910b4d67-2719-45ed-a7ee-727c5d13a39b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:45:47.154202 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910b4d67-2719-45ed-a7ee-727c5d13a39b admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:45:47.154485 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910b4d67-2719-45ed-a7ee-727c5d13a39b admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:45:47.154779 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910b4d67-2719-45ed-a7ee-727c5d13a39b admin admin] PATH_INFO: `/v3/domains` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:45:47.155494 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910b4d67-2719-45ed-a7ee-727c5d13a39b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:45:47.155950 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910b4d67-2719-45ed-a7ee-727c5d13a39b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:45:47.157574 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910b4d67-2719-45ed-a7ee-727c5d13a39b admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:45:47.168831 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1346/2685] 10.222.0.117 () {58 vars in 1157 bytes} [Tue Jan 25 02:45:47 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:45:47.172831 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4ca5b1-6885-449c-98f4-6de009ec5429 None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:45:47.182670 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4ca5b1-6885-449c-98f4-6de009ec5429 None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:45:47.187260 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498ee40e-d65a-492a-a1e0-cd83fb1392e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:45:47.187950 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498ee40e-d65a-492a-a1e0-cd83fb1392e2 admin admin] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:45:47.188228 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498ee40e-d65a-492a-a1e0-cd83fb1392e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:45:47.188499 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498ee40e-d65a-492a-a1e0-cd83fb1392e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:45:47.189196 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498ee40e-d65a-492a-a1e0-cd83fb1392e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:45:47.191200 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498ee40e-d65a-492a-a1e0-cd83fb1392e2 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:45:47.217137 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1340/2686] 10.222.0.117 () {60 vars in 1157 bytes} [Tue Jan 25 02:45:47 2022] POST /identity/v3/projects => generated 364 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 02:45:47.221275 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910b4d67-2719-45ed-a7ee-727c5d13a39b admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:45:47.231720 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910b4d67-2719-45ed-a7ee-727c5d13a39b admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:45:47.286661 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5018c55-6ea1-4041-b2d5-0a70db451f74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:45:47.287330 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5018c55-6ea1-4041-b2d5-0a70db451f74 admin admin] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:45:47.287616 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5018c55-6ea1-4041-b2d5-0a70db451f74 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:45:47.287943 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5018c55-6ea1-4041-b2d5-0a70db451f74 admin admin] PATH_INFO: `/v3/users` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:45:47.288659 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5018c55-6ea1-4041-b2d5-0a70db451f74 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:45:47.290601 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5018c55-6ea1-4041-b2d5-0a70db451f74 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:45:47.309981 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1347/2687] 10.222.0.117 () {60 vars in 1148 bytes} [Tue Jan 25 02:45:47 2022] POST /identity/v3/users => generated 283 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 25 02:45:47.314044 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498ee40e-d65a-492a-a1e0-cd83fb1392e2 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:45:47.325115 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498ee40e-d65a-492a-a1e0-cd83fb1392e2 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:45:47.330142 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d938b5-256e-4258-b60d-6ff222614973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:45:47.330799 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d938b5-256e-4258-b60d-6ff222614973 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:45:47.331086 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d938b5-256e-4258-b60d-6ff222614973 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:45:47.331366 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d938b5-256e-4258-b60d-6ff222614973 admin admin] PATH_INFO: `/v3/roles` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:45:47.332903 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d938b5-256e-4258-b60d-6ff222614973 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:45:47.334548 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d938b5-256e-4258-b60d-6ff222614973 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:45:47.345082 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1341/2688] 10.222.0.117 () {58 vars in 1126 bytes} [Tue Jan 25 02:45:47 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 02:45:47.349526 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5018c55-6ea1-4041-b2d5-0a70db451f74 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:45:47.362468 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5018c55-6ea1-4041-b2d5-0a70db451f74 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:45:47.367791 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee61822b-6e80-4a7c-a99d-f84ab1f4540c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:45:47.368451 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee61822b-6e80-4a7c-a99d-f84ab1f4540c admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:45:47.368740 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee61822b-6e80-4a7c-a99d-f84ab1f4540c admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:45:47.369560 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee61822b-6e80-4a7c-a99d-f84ab1f4540c admin admin] PATH_INFO: `/v3/roles` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:45:47.369752 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee61822b-6e80-4a7c-a99d-f84ab1f4540c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:45:47.371371 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee61822b-6e80-4a7c-a99d-f84ab1f4540c admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:45:47.381954 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1348/2689] 10.222.0.117 () {58 vars in 1126 bytes} [Tue Jan 25 02:45:47 2022] GET /identity/v3/roles => generated 1427 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 25 02:45:47.386154 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d938b5-256e-4258-b60d-6ff222614973 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:45:47.396976 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d938b5-256e-4258-b60d-6ff222614973 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:45:47.401480 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba8eee9-cbef-4963-a13b-dd60d33fcdda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:45:47.402342 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba8eee9-cbef-4963-a13b-dd60d33fcdda admin admin] REQUEST_METHOD: `PUT` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:45:47.402619 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba8eee9-cbef-4963-a13b-dd60d33fcdda admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:45:47.402890 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba8eee9-cbef-4963-a13b-dd60d33fcdda admin admin] PATH_INFO: `/v3/projects/5fe0da15b35b43888ef16e7eb8b0e588/users/aabfcf6d858a4cf29e20d2e872451a32/roles/33a8e87420ed423f9cb29e0084eab5d2` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:45:47.416941 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba8eee9-cbef-4963-a13b-dd60d33fcdda admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fe0da15b35b43888ef16e7eb8b0e588, user_id=aabfcf6d858a4cf29e20d2e872451a32, role_id=33a8e87420ed423f9cb29e0084eab5d2)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:45:47.419555 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba8eee9-cbef-4963-a13b-dd60d33fcdda admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:45:47.436270 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1342/2690] 10.222.0.117 () {60 vars in 1487 bytes} [Tue Jan 25 02:45:47 2022] PUT /identity/v3/projects/5fe0da15b35b43888ef16e7eb8b0e588/users/aabfcf6d858a4cf29e20d2e872451a32/roles/33a8e87420ed423f9cb29e0084eab5d2 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:45:47.444747 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b730d7f3-8a1b-4b6e-87d7-dcafd874f859 None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:45:47.444977 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b730d7f3-8a1b-4b6e-87d7-dcafd874f859 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:45:47.445257 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b730d7f3-8a1b-4b6e-87d7-dcafd874f859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:45:47.471940 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-b730d7f3-8a1b-4b6e-87d7-dcafd874f859 None None] MFA Rules not processed for user `aabfcf6d858a4cf29e20d2e872451a32`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:45:47.473982 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-b730d7f3-8a1b-4b6e-87d7-dcafd874f859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:45:47.537656 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1349/2691] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:45:47 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:45:47.542161 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba8eee9-cbef-4963-a13b-dd60d33fcdda admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:45:47.602473 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba8eee9-cbef-4963-a13b-dd60d33fcdda admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:45:47.607084 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77891123-fdef-4d78-8505-f0abef69012c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:45:47.607763 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77891123-fdef-4d78-8505-f0abef69012c admin admin] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:45:47.608049 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77891123-fdef-4d78-8505-f0abef69012c admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:45:47.608325 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77891123-fdef-4d78-8505-f0abef69012c admin admin] PATH_INFO: `/v3/projects` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:45:47.609037 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77891123-fdef-4d78-8505-f0abef69012c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:45:47.610933 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77891123-fdef-4d78-8505-f0abef69012c admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:45:47.636006 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1343/2692] 10.222.0.117 () {60 vars in 1157 bytes} [Tue Jan 25 02:45:47 2022] POST /identity/v3/projects => generated 364 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 25 02:45:47.640048 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b730d7f3-8a1b-4b6e-87d7-dcafd874f859 None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:45:47.650429 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b730d7f3-8a1b-4b6e-87d7-dcafd874f859 None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:45:47.706325 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5f4cd9-df87-400c-8e16-7ecd04ed34d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:45:47.707504 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5f4cd9-df87-400c-8e16-7ecd04ed34d0 admin admin] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:45:47.707996 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5f4cd9-df87-400c-8e16-7ecd04ed34d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:45:47.708285 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5f4cd9-df87-400c-8e16-7ecd04ed34d0 admin admin] PATH_INFO: `/v3/users` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:45:47.708997 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5f4cd9-df87-400c-8e16-7ecd04ed34d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:45:47.710931 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5f4cd9-df87-400c-8e16-7ecd04ed34d0 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:45:47.734189 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1350/2693] 10.222.0.117 () {60 vars in 1148 bytes} [Tue Jan 25 02:45:47 2022] POST /identity/v3/users => generated 289 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 02:45:47.735431 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77891123-fdef-4d78-8505-f0abef69012c admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:45:47.745998 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77891123-fdef-4d78-8505-f0abef69012c admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:45:47.750506 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d93c99b-ca03-48c0-9768-bdb55c87d5eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:45:47.751150 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d93c99b-ca03-48c0-9768-bdb55c87d5eb admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:45:47.751429 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d93c99b-ca03-48c0-9768-bdb55c87d5eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:45:47.751724 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d93c99b-ca03-48c0-9768-bdb55c87d5eb admin admin] PATH_INFO: `/v3/roles` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:45:47.752460 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d93c99b-ca03-48c0-9768-bdb55c87d5eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:45:47.754935 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d93c99b-ca03-48c0-9768-bdb55c87d5eb admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:45:47.764860 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1344/2694] 10.222.0.117 () {58 vars in 1126 bytes} [Tue Jan 25 02:45:47 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 02:45:47.768871 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5f4cd9-df87-400c-8e16-7ecd04ed34d0 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:45:47.779591 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5f4cd9-df87-400c-8e16-7ecd04ed34d0 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:45:47.784213 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475fb16c-1a00-4e0f-8c71-ae018c6a65f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:45:47.785087 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475fb16c-1a00-4e0f-8c71-ae018c6a65f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:45:47.785963 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475fb16c-1a00-4e0f-8c71-ae018c6a65f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:45:47.786240 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475fb16c-1a00-4e0f-8c71-ae018c6a65f6 admin admin] PATH_INFO: `/v3/projects/4efea0cc16af48208b84347751da3b80/users/c4be6f7a0caf40b88da77c2921a03a24/roles/d8dbc6d83d9d41d28c3feb8b3485b291` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:45:47.800513 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475fb16c-1a00-4e0f-8c71-ae018c6a65f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4efea0cc16af48208b84347751da3b80, user_id=c4be6f7a0caf40b88da77c2921a03a24, role_id=d8dbc6d83d9d41d28c3feb8b3485b291)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:45:47.803748 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475fb16c-1a00-4e0f-8c71-ae018c6a65f6 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:45:47.815957 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1351/2695] 10.222.0.117 () {60 vars in 1487 bytes} [Tue Jan 25 02:45:47 2022] PUT /identity/v3/projects/4efea0cc16af48208b84347751da3b80/users/c4be6f7a0caf40b88da77c2921a03a24/roles/d8dbc6d83d9d41d28c3feb8b3485b291 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:45:47.820415 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d93c99b-ca03-48c0-9768-bdb55c87d5eb admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:45:47.830190 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d93c99b-ca03-48c0-9768-bdb55c87d5eb admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:45:47.884169 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d021b3-78fe-4613-aaa3-ca11c75d47bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:45:47.884815 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d021b3-78fe-4613-aaa3-ca11c75d47bf admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:45:47.885093 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d021b3-78fe-4613-aaa3-ca11c75d47bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:45:47.885361 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d021b3-78fe-4613-aaa3-ca11c75d47bf admin admin] PATH_INFO: `/v3/roles` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:45:47.886089 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d021b3-78fe-4613-aaa3-ca11c75d47bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:45:47.887658 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d021b3-78fe-4613-aaa3-ca11c75d47bf admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:45:47.897168 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1345/2696] 10.222.0.117 () {58 vars in 1126 bytes} [Tue Jan 25 02:45:47 2022] GET /identity/v3/roles => generated 1427 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 02:45:47.901214 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475fb16c-1a00-4e0f-8c71-ae018c6a65f6 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:45:47.911306 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475fb16c-1a00-4e0f-8c71-ae018c6a65f6 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:45:47.915955 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21d459c-8b21-4e9f-ac3f-fdee36e7e031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:45:47.916825 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21d459c-8b21-4e9f-ac3f-fdee36e7e031 admin admin] REQUEST_METHOD: `PUT` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:45:47.917110 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21d459c-8b21-4e9f-ac3f-fdee36e7e031 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:45:47.917386 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21d459c-8b21-4e9f-ac3f-fdee36e7e031 admin admin] PATH_INFO: `/v3/projects/4efea0cc16af48208b84347751da3b80/users/c4be6f7a0caf40b88da77c2921a03a24/roles/d8dbc6d83d9d41d28c3feb8b3485b291` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:45:47.919371 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21d459c-8b21-4e9f-ac3f-fdee36e7e031 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4efea0cc16af48208b84347751da3b80, user_id=c4be6f7a0caf40b88da77c2921a03a24, role_id=d8dbc6d83d9d41d28c3feb8b3485b291)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:45:47.922041 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21d459c-8b21-4e9f-ac3f-fdee36e7e031 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:45:47.932927 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1352/2697] 10.222.0.117 () {60 vars in 1487 bytes} [Tue Jan 25 02:45:47 2022] PUT /identity/v3/projects/4efea0cc16af48208b84347751da3b80/users/c4be6f7a0caf40b88da77c2921a03a24/roles/d8dbc6d83d9d41d28c3feb8b3485b291 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:45:47.944638 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07b7afd-5bcb-411c-8769-20c5aa190018 None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:45:47.944924 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07b7afd-5bcb-411c-8769-20c5aa190018 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:45:47.945198 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07b7afd-5bcb-411c-8769-20c5aa190018 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:45:47.970788 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-d07b7afd-5bcb-411c-8769-20c5aa190018 None None] MFA Rules not processed for user `c4be6f7a0caf40b88da77c2921a03a24`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:45:47.971956 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-d07b7afd-5bcb-411c-8769-20c5aa190018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:45:48.036837 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1346/2698] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:45:47 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:45:48.047455 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21d459c-8b21-4e9f-ac3f-fdee36e7e031 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:45:48.049173 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-e21d459c-8b21-4e9f-ac3f-fdee36e7e031 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:45:48.104601 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21d459c-8b21-4e9f-ac3f-fdee36e7e031 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:45:48.108238 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b401e20-0cd1-4bc1-99ca-adf33ee324ba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cc5249aea09430080e232cf17757f86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:45:48.108875 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b401e20-0cd1-4bc1-99ca-adf33ee324ba service cinder] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:45:48.109158 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b401e20-0cd1-4bc1-99ca-adf33ee324ba service cinder] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:45:48.109431 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b401e20-0cd1-4bc1-99ca-adf33ee324ba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:45:48.118909 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b401e20-0cd1-4bc1-99ca-adf33ee324ba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:45:48.120374 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b401e20-0cd1-4bc1-99ca-adf33ee324ba service cinder] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:45:48.129598 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1353/2699] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:45:48 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:45:48.198545 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07b7afd-5bcb-411c-8769-20c5aa190018 None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:45:48.208468 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07b7afd-5bcb-411c-8769-20c5aa190018 None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:45:48.212097 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a813dc5-55ae-41fd-bf47-1eedc9cba6c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cc5249aea09430080e232cf17757f86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:45:48.212724 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a813dc5-55ae-41fd-bf47-1eedc9cba6c1 service cinder] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:45:48.213002 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a813dc5-55ae-41fd-bf47-1eedc9cba6c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:45:48.213274 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a813dc5-55ae-41fd-bf47-1eedc9cba6c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:45:48.268159 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a813dc5-55ae-41fd-bf47-1eedc9cba6c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:45:48.270166 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a813dc5-55ae-41fd-bf47-1eedc9cba6c1 service cinder] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:45:48.279088 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1347/2700] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:45:48 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:45:50.944532 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b401e20-0cd1-4bc1-99ca-adf33ee324ba service cinder] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:45:51.004891 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b401e20-0cd1-4bc1-99ca-adf33ee324ba service cinder] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:45:51.009558 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d27f15-c43f-40f0-8b9a-3bad586429a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:45:51.010423 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d27f15-c43f-40f0-8b9a-3bad586429a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:45:51.010710 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d27f15-c43f-40f0-8b9a-3bad586429a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:45:51.010990 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d27f15-c43f-40f0-8b9a-3bad586429a1 admin admin] PATH_INFO: `/v3/users/aabfcf6d858a4cf29e20d2e872451a32` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:45:51.012225 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d27f15-c43f-40f0-8b9a-3bad586429a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aabfcf6d858a4cf29e20d2e872451a32)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:45:51.014168 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d27f15-c43f-40f0-8b9a-3bad586429a1 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:45:51.061805 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-b8d27f15-c43f-40f0-8b9a-3bad586429a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aabfcf6d858a4cf29e20d2e872451a32'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:45:51.062481 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-b8d27f15-c43f-40f0-8b9a-3bad586429a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aabfcf6d858a4cf29e20d2e872451a32'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:45:51.069263 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-b8d27f15-c43f-40f0-8b9a-3bad586429a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aabfcf6d858a4cf29e20d2e872451a32'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:45:51.069917 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-b8d27f15-c43f-40f0-8b9a-3bad586429a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aabfcf6d858a4cf29e20d2e872451a32'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:45:51.077243 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-b8d27f15-c43f-40f0-8b9a-3bad586429a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aabfcf6d858a4cf29e20d2e872451a32'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:45:51.093676 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1354/2701] 10.222.0.117 () {58 vars in 1228 bytes} [Tue Jan 25 02:45:50 2022] DELETE /identity/v3/users/aabfcf6d858a4cf29e20d2e872451a32 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:45:51.099062 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936b794b-d858-481a-aac2-ebbacd04a667 None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:45:51.099531 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936b794b-d858-481a-aac2-ebbacd04a667 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:45:51.099650 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936b794b-d858-481a-aac2-ebbacd04a667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:45:51.117075 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-936b794b-d858-481a-aac2-ebbacd04a667 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:45:51.118264 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-936b794b-d858-481a-aac2-ebbacd04a667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:45:51.175496 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1348/2702] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:45:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:45:51.185961 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d27f15-c43f-40f0-8b9a-3bad586429a1 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:45:51.187401 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-b8d27f15-c43f-40f0-8b9a-3bad586429a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:45:51.244842 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d27f15-c43f-40f0-8b9a-3bad586429a1 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:45:51.248714 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0cbb49-6ef1-4db2-a61f-1d02dcbe3c32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca4071c5f8f4a31b5edb81fa66a43a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:45:51.249391 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0cbb49-6ef1-4db2-a61f-1d02dcbe3c32 service neutron] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:45:51.249679 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0cbb49-6ef1-4db2-a61f-1d02dcbe3c32 service neutron] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:45:51.249958 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0cbb49-6ef1-4db2-a61f-1d02dcbe3c32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:45:51.259463 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0cbb49-6ef1-4db2-a61f-1d02dcbe3c32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:45:51.260963 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0cbb49-6ef1-4db2-a61f-1d02dcbe3c32 service neutron] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:45:51.270764 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1355/2703] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:45:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 25 02:45:51.537603 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936b794b-d858-481a-aac2-ebbacd04a667 None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:45:51.539034 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-936b794b-d858-481a-aac2-ebbacd04a667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:45:51.550524 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936b794b-d858-481a-aac2-ebbacd04a667 None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:45:51.555849 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bece13b-ec8d-4e37-a9fd-f04091da1c11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:45:51.556711 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bece13b-ec8d-4e37-a9fd-f04091da1c11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:45:51.556988 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bece13b-ec8d-4e37-a9fd-f04091da1c11 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:45:51.557256 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bece13b-ec8d-4e37-a9fd-f04091da1c11 admin admin] PATH_INFO: `/v3/projects/5fe0da15b35b43888ef16e7eb8b0e588` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:45:51.558476 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bece13b-ec8d-4e37-a9fd-f04091da1c11 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5fe0da15b35b43888ef16e7eb8b0e588)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:45:51.560423 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bece13b-ec8d-4e37-a9fd-f04091da1c11 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:45:51.608474 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-4bece13b-ec8d-4e37-a9fd-f04091da1c11 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5fe0da15b35b43888ef16e7eb8b0e588', 'request_id': 'req-4bece13b-ec8d-4e37-a9fd-f04091da1c11'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:45:51.614101 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-4bece13b-ec8d-4e37-a9fd-f04091da1c11 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5fe0da15b35b43888ef16e7eb8b0e588', 'request_id': 'req-4bece13b-ec8d-4e37-a9fd-f04091da1c11'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:45:51.620363 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-4bece13b-ec8d-4e37-a9fd-f04091da1c11 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5fe0da15b35b43888ef16e7eb8b0e588', 'request_id': 'req-4bece13b-ec8d-4e37-a9fd-f04091da1c11'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:45:51.632153 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-4bece13b-ec8d-4e37-a9fd-f04091da1c11 admin admin] The token cache is being invalidate because project 5fe0da15b35b43888ef16e7eb8b0e588 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79120) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 25 02:45:51.632445 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-4bece13b-ec8d-4e37-a9fd-f04091da1c11 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:45:51.633124 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-4bece13b-ec8d-4e37-a9fd-f04091da1c11 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:45:51.634735 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1349/2704] 10.222.0.117 () {58 vars in 1237 bytes} [Tue Jan 25 02:45:51 2022] DELETE /identity/v3/projects/5fe0da15b35b43888ef16e7eb8b0e588 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:45:51.638836 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0cbb49-6ef1-4db2-a61f-1d02dcbe3c32 service neutron] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:45:51.648882 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0cbb49-6ef1-4db2-a61f-1d02dcbe3c32 service neutron] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:45:51.703209 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d35711-7725-4765-82ac-6dd1b9f6a3e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:45:51.704119 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d35711-7725-4765-82ac-6dd1b9f6a3e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:45:51.704403 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d35711-7725-4765-82ac-6dd1b9f6a3e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:45:51.704679 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d35711-7725-4765-82ac-6dd1b9f6a3e1 admin admin] PATH_INFO: `/v3/users/c4be6f7a0caf40b88da77c2921a03a24` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:45:51.705874 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d35711-7725-4765-82ac-6dd1b9f6a3e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4be6f7a0caf40b88da77c2921a03a24)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:45:51.708373 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d35711-7725-4765-82ac-6dd1b9f6a3e1 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:45:51.752864 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-30d35711-7725-4765-82ac-6dd1b9f6a3e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4be6f7a0caf40b88da77c2921a03a24'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:45:51.753433 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-30d35711-7725-4765-82ac-6dd1b9f6a3e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4be6f7a0caf40b88da77c2921a03a24'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:45:51.760148 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-30d35711-7725-4765-82ac-6dd1b9f6a3e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4be6f7a0caf40b88da77c2921a03a24'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:45:51.760810 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-30d35711-7725-4765-82ac-6dd1b9f6a3e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4be6f7a0caf40b88da77c2921a03a24'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:45:51.768489 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-30d35711-7725-4765-82ac-6dd1b9f6a3e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4be6f7a0caf40b88da77c2921a03a24'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:45:51.787469 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1356/2705] 10.222.0.117 () {58 vars in 1228 bytes} [Tue Jan 25 02:45:51 2022] DELETE /identity/v3/users/c4be6f7a0caf40b88da77c2921a03a24 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:45:52.052163 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bece13b-ec8d-4e37-a9fd-f04091da1c11 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:45:52.053579 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-4bece13b-ec8d-4e37-a9fd-f04091da1c11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:45:52.068004 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bece13b-ec8d-4e37-a9fd-f04091da1c11 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:45:52.123303 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb8a123-6ee7-47b6-912f-90220bea38d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:45:52.124186 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb8a123-6ee7-47b6-912f-90220bea38d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:45:52.124468 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb8a123-6ee7-47b6-912f-90220bea38d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:45:52.124743 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb8a123-6ee7-47b6-912f-90220bea38d4 admin admin] PATH_INFO: `/v3/projects/4efea0cc16af48208b84347751da3b80` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:45:52.125922 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb8a123-6ee7-47b6-912f-90220bea38d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4efea0cc16af48208b84347751da3b80)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:45:52.127850 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb8a123-6ee7-47b6-912f-90220bea38d4 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:45:52.172862 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-cfb8a123-6ee7-47b6-912f-90220bea38d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4efea0cc16af48208b84347751da3b80', 'request_id': 'req-cfb8a123-6ee7-47b6-912f-90220bea38d4'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:45:52.178639 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-cfb8a123-6ee7-47b6-912f-90220bea38d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4efea0cc16af48208b84347751da3b80', 'request_id': 'req-cfb8a123-6ee7-47b6-912f-90220bea38d4'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:45:52.184589 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-cfb8a123-6ee7-47b6-912f-90220bea38d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4efea0cc16af48208b84347751da3b80', 'request_id': 'req-cfb8a123-6ee7-47b6-912f-90220bea38d4'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:45:52.197487 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-cfb8a123-6ee7-47b6-912f-90220bea38d4 admin admin] The token cache is being invalidate because project 4efea0cc16af48208b84347751da3b80 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79120) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 25 02:45:52.197777 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-cfb8a123-6ee7-47b6-912f-90220bea38d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:45:52.198403 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-cfb8a123-6ee7-47b6-912f-90220bea38d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:45:52.199956 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1350/2706] 10.222.0.117 () {58 vars in 1237 bytes} [Tue Jan 25 02:45:52 2022] DELETE /identity/v3/projects/4efea0cc16af48208b84347751da3b80 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:45:52.205652 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcc9f48-1437-4c9c-87ed-df533ed58512 None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:45:52.206107 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcc9f48-1437-4c9c-87ed-df533ed58512 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:45:52.206202 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcc9f48-1437-4c9c-87ed-df533ed58512 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:45:52.223938 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-4fcc9f48-1437-4c9c-87ed-df533ed58512 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:45:52.225145 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-4fcc9f48-1437-4c9c-87ed-df533ed58512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:45:52.281797 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1357/2707] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:45:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:45:52.290133 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abfe753-68cd-439a-b8e8-f2bbbb946302 None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:45:52.290423 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abfe753-68cd-439a-b8e8-f2bbbb946302 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:45:52.290701 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abfe753-68cd-439a-b8e8-f2bbbb946302 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:45:52.309359 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-5abfe753-68cd-439a-b8e8-f2bbbb946302 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:45:52.310471 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-5abfe753-68cd-439a-b8e8-f2bbbb946302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:45:52.319118 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1351/2708] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:45:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:45:52.323544 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcc9f48-1437-4c9c-87ed-df533ed58512 None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:45:52.333145 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcc9f48-1437-4c9c-87ed-df533ed58512 None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:45:52.337768 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126c568b-1927-461d-a90a-06040eff7dda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:45:52.338419 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126c568b-1927-461d-a90a-06040eff7dda admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:45:52.338704 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126c568b-1927-461d-a90a-06040eff7dda admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:45:52.338979 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126c568b-1927-461d-a90a-06040eff7dda admin admin] PATH_INFO: `/v3/domains` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:45:52.339747 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126c568b-1927-461d-a90a-06040eff7dda admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:45:52.340055 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126c568b-1927-461d-a90a-06040eff7dda admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:45:52.341662 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126c568b-1927-461d-a90a-06040eff7dda admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:45:52.353135 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1358/2709] 10.222.0.117 () {58 vars in 1157 bytes} [Tue Jan 25 02:45:52 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:45:52.357244 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abfe753-68cd-439a-b8e8-f2bbbb946302 None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:45:52.366601 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abfe753-68cd-439a-b8e8-f2bbbb946302 None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:45:52.371161 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde9f3d0-80b0-4404-a618-ee4c9c411715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:45:52.371819 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde9f3d0-80b0-4404-a618-ee4c9c411715 admin admin] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:45:52.372102 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde9f3d0-80b0-4404-a618-ee4c9c411715 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:45:52.372378 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde9f3d0-80b0-4404-a618-ee4c9c411715 admin admin] PATH_INFO: `/v3/projects` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:45:52.373073 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde9f3d0-80b0-4404-a618-ee4c9c411715 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:45:52.374949 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde9f3d0-80b0-4404-a618-ee4c9c411715 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:45:52.400167 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1352/2710] 10.222.0.117 () {60 vars in 1157 bytes} [Tue Jan 25 02:45:52 2022] POST /identity/v3/projects => generated 402 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 25 02:45:52.404465 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126c568b-1927-461d-a90a-06040eff7dda admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:45:52.414339 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126c568b-1927-461d-a90a-06040eff7dda admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:45:52.469966 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdda865-18ce-4d39-992a-3f68eae884ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:45:52.470621 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdda865-18ce-4d39-992a-3f68eae884ef admin admin] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:45:52.470902 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdda865-18ce-4d39-992a-3f68eae884ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:45:52.471175 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdda865-18ce-4d39-992a-3f68eae884ef admin admin] PATH_INFO: `/v3/users` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:45:52.471904 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdda865-18ce-4d39-992a-3f68eae884ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:45:52.474711 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdda865-18ce-4d39-992a-3f68eae884ef admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:45:52.494010 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1359/2711] 10.222.0.117 () {60 vars in 1148 bytes} [Tue Jan 25 02:45:52 2022] POST /identity/v3/users => generated 302 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 02:45:52.497976 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde9f3d0-80b0-4404-a618-ee4c9c411715 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:45:52.508253 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde9f3d0-80b0-4404-a618-ee4c9c411715 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:45:52.512887 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce94ced-8736-4d95-a9ce-d3cf5d890479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:45:52.513522 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce94ced-8736-4d95-a9ce-d3cf5d890479 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:45:52.513805 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce94ced-8736-4d95-a9ce-d3cf5d890479 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:45:52.514080 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce94ced-8736-4d95-a9ce-d3cf5d890479 admin admin] PATH_INFO: `/v3/roles` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:45:52.514817 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce94ced-8736-4d95-a9ce-d3cf5d890479 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:45:52.516451 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce94ced-8736-4d95-a9ce-d3cf5d890479 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:45:52.527145 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1353/2712] 10.222.0.117 () {58 vars in 1126 bytes} [Tue Jan 25 02:45:52 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 02:45:52.531120 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdda865-18ce-4d39-992a-3f68eae884ef admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:45:52.542400 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdda865-18ce-4d39-992a-3f68eae884ef admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:45:52.547413 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f748d8d-1328-43f5-a7c2-87e810cc8fe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:45:52.548101 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f748d8d-1328-43f5-a7c2-87e810cc8fe8 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:45:52.548381 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f748d8d-1328-43f5-a7c2-87e810cc8fe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:45:52.548657 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f748d8d-1328-43f5-a7c2-87e810cc8fe8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:45:52.549384 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f748d8d-1328-43f5-a7c2-87e810cc8fe8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:45:52.551211 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f748d8d-1328-43f5-a7c2-87e810cc8fe8 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:45:52.561089 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1360/2713] 10.222.0.117 () {58 vars in 1126 bytes} [Tue Jan 25 02:45:52 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 02:45:52.565180 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce94ced-8736-4d95-a9ce-d3cf5d890479 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:45:52.575676 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce94ced-8736-4d95-a9ce-d3cf5d890479 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:45:52.580533 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844b4fc3-1742-466d-bd95-9ee95a499c45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:45:52.581399 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844b4fc3-1742-466d-bd95-9ee95a499c45 admin admin] REQUEST_METHOD: `PUT` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:45:52.581685 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844b4fc3-1742-466d-bd95-9ee95a499c45 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:45:52.582631 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844b4fc3-1742-466d-bd95-9ee95a499c45 admin admin] PATH_INFO: `/v3/projects/e75bcf2bab8d43bea2b627d8f32a503c/users/7a61d79299484dbca53cefae8aaad328/roles/33a8e87420ed423f9cb29e0084eab5d2` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:45:52.596945 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844b4fc3-1742-466d-bd95-9ee95a499c45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e75bcf2bab8d43bea2b627d8f32a503c, user_id=7a61d79299484dbca53cefae8aaad328, role_id=33a8e87420ed423f9cb29e0084eab5d2)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:45:52.600374 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844b4fc3-1742-466d-bd95-9ee95a499c45 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:45:52.612945 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1354/2714] 10.222.0.117 () {60 vars in 1487 bytes} [Tue Jan 25 02:45:52 2022] PUT /identity/v3/projects/e75bcf2bab8d43bea2b627d8f32a503c/users/7a61d79299484dbca53cefae8aaad328/roles/33a8e87420ed423f9cb29e0084eab5d2 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:45:52.623609 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e37df73-9cae-489d-b06d-b7ccc8ff0ea3 None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:45:52.623939 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e37df73-9cae-489d-b06d-b7ccc8ff0ea3 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:45:52.624248 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e37df73-9cae-489d-b06d-b7ccc8ff0ea3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:45:52.650076 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-2e37df73-9cae-489d-b06d-b7ccc8ff0ea3 None None] MFA Rules not processed for user `7a61d79299484dbca53cefae8aaad328`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:45:52.651275 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-2e37df73-9cae-489d-b06d-b7ccc8ff0ea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:45:52.713996 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1361/2715] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:45:52 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:45:52.718454 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844b4fc3-1742-466d-bd95-9ee95a499c45 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:45:52.780113 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844b4fc3-1742-466d-bd95-9ee95a499c45 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:45:52.787416 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc7ac9d-98a3-45da-9748-f799b440cc43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:45:52.788456 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc7ac9d-98a3-45da-9748-f799b440cc43 admin admin] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:45:52.788749 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc7ac9d-98a3-45da-9748-f799b440cc43 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:45:52.789031 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc7ac9d-98a3-45da-9748-f799b440cc43 admin admin] PATH_INFO: `/v3/projects` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:45:52.789757 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc7ac9d-98a3-45da-9748-f799b440cc43 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:45:52.791678 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc7ac9d-98a3-45da-9748-f799b440cc43 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:45:52.820831 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1355/2716] 10.222.0.117 () {60 vars in 1157 bytes} [Tue Jan 25 02:45:52 2022] POST /identity/v3/projects => generated 400 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 02:45:52.825022 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e37df73-9cae-489d-b06d-b7ccc8ff0ea3 None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:45:52.835541 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e37df73-9cae-489d-b06d-b7ccc8ff0ea3 None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:45:52.890230 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c8b0aa-2023-4292-a20e-4904e9165620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:45:52.890899 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c8b0aa-2023-4292-a20e-4904e9165620 admin admin] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:45:52.891184 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c8b0aa-2023-4292-a20e-4904e9165620 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:45:52.891459 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c8b0aa-2023-4292-a20e-4904e9165620 admin admin] PATH_INFO: `/v3/users` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:45:52.892195 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c8b0aa-2023-4292-a20e-4904e9165620 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:45:52.894125 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c8b0aa-2023-4292-a20e-4904e9165620 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:45:52.917914 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1362/2717] 10.222.0.117 () {60 vars in 1148 bytes} [Tue Jan 25 02:45:52 2022] POST /identity/v3/users => generated 307 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 02:45:52.922606 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc7ac9d-98a3-45da-9748-f799b440cc43 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:45:52.937397 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc7ac9d-98a3-45da-9748-f799b440cc43 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:45:52.942869 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad2759a-6f19-43c9-a11a-57479a6452f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:45:52.943537 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad2759a-6f19-43c9-a11a-57479a6452f2 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:45:52.943878 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad2759a-6f19-43c9-a11a-57479a6452f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:45:52.944159 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad2759a-6f19-43c9-a11a-57479a6452f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:45:52.944904 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad2759a-6f19-43c9-a11a-57479a6452f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:45:52.946772 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad2759a-6f19-43c9-a11a-57479a6452f2 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:45:52.961133 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1356/2718] 10.222.0.117 () {58 vars in 1126 bytes} [Tue Jan 25 02:45:52 2022] GET /identity/v3/roles => generated 1427 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 02:45:52.966269 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c8b0aa-2023-4292-a20e-4904e9165620 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:45:52.977299 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c8b0aa-2023-4292-a20e-4904e9165620 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:45:52.982128 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3a06aa-6d41-4e4d-b598-746058f8ca72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:45:52.983017 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3a06aa-6d41-4e4d-b598-746058f8ca72 admin admin] REQUEST_METHOD: `PUT` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:45:52.983304 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3a06aa-6d41-4e4d-b598-746058f8ca72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:45:52.983595 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3a06aa-6d41-4e4d-b598-746058f8ca72 admin admin] PATH_INFO: `/v3/projects/c7703d57dd8a47648303f69543b93ca3/users/91c3d4b4c5ec422c8b5d63cd919985e3/roles/d8dbc6d83d9d41d28c3feb8b3485b291` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:45:52.999110 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3a06aa-6d41-4e4d-b598-746058f8ca72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7703d57dd8a47648303f69543b93ca3, user_id=91c3d4b4c5ec422c8b5d63cd919985e3, role_id=d8dbc6d83d9d41d28c3feb8b3485b291)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:45:53.001818 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3a06aa-6d41-4e4d-b598-746058f8ca72 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:45:53.019920 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1363/2719] 10.222.0.117 () {60 vars in 1487 bytes} [Tue Jan 25 02:45:52 2022] PUT /identity/v3/projects/c7703d57dd8a47648303f69543b93ca3/users/91c3d4b4c5ec422c8b5d63cd919985e3/roles/d8dbc6d83d9d41d28c3feb8b3485b291 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:45:53.024674 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad2759a-6f19-43c9-a11a-57479a6452f2 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:45:53.036513 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad2759a-6f19-43c9-a11a-57479a6452f2 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:45:53.099741 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2e28aa-73b4-4a99-8836-0f6c8333b114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:45:53.100319 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2e28aa-73b4-4a99-8836-0f6c8333b114 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:45:53.100605 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2e28aa-73b4-4a99-8836-0f6c8333b114 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:45:53.100882 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2e28aa-73b4-4a99-8836-0f6c8333b114 admin admin] PATH_INFO: `/v3/roles` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:45:53.101924 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2e28aa-73b4-4a99-8836-0f6c8333b114 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:45:53.103236 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2e28aa-73b4-4a99-8836-0f6c8333b114 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:45:53.114025 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1357/2720] 10.222.0.117 () {58 vars in 1126 bytes} [Tue Jan 25 02:45:53 2022] GET /identity/v3/roles => generated 1427 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 25 02:45:53.119728 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3a06aa-6d41-4e4d-b598-746058f8ca72 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:45:53.130888 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3a06aa-6d41-4e4d-b598-746058f8ca72 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:45:53.136011 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fe7da3-0470-47df-b2f2-c8542cfbce95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:45:53.136889 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fe7da3-0470-47df-b2f2-c8542cfbce95 admin admin] REQUEST_METHOD: `PUT` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:45:53.137167 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fe7da3-0470-47df-b2f2-c8542cfbce95 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:45:53.137436 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fe7da3-0470-47df-b2f2-c8542cfbce95 admin admin] PATH_INFO: `/v3/projects/c7703d57dd8a47648303f69543b93ca3/users/91c3d4b4c5ec422c8b5d63cd919985e3/roles/d8dbc6d83d9d41d28c3feb8b3485b291` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:45:53.139752 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fe7da3-0470-47df-b2f2-c8542cfbce95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7703d57dd8a47648303f69543b93ca3, user_id=91c3d4b4c5ec422c8b5d63cd919985e3, role_id=d8dbc6d83d9d41d28c3feb8b3485b291)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:45:53.144907 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fe7da3-0470-47df-b2f2-c8542cfbce95 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:45:53.158874 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1364/2721] 10.222.0.117 () {60 vars in 1487 bytes} [Tue Jan 25 02:45:53 2022] PUT /identity/v3/projects/c7703d57dd8a47648303f69543b93ca3/users/91c3d4b4c5ec422c8b5d63cd919985e3/roles/d8dbc6d83d9d41d28c3feb8b3485b291 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:45:53.170751 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdef655-8af1-4249-a917-1118dee24b43 None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:45:53.171322 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdef655-8af1-4249-a917-1118dee24b43 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:45:53.171322 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdef655-8af1-4249-a917-1118dee24b43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:45:53.202826 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-ffdef655-8af1-4249-a917-1118dee24b43 None None] MFA Rules not processed for user `91c3d4b4c5ec422c8b5d63cd919985e3`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:45:53.204069 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-ffdef655-8af1-4249-a917-1118dee24b43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:45:53.279259 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1358/2722] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:45:53 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:45:53.291814 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fe7da3-0470-47df-b2f2-c8542cfbce95 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:45:53.293561 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-d9fe7da3-0470-47df-b2f2-c8542cfbce95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:45:53.367446 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fe7da3-0470-47df-b2f2-c8542cfbce95 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:45:53.372513 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6db7073-a2f7-403e-a913-b52b3a580735 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cc5249aea09430080e232cf17757f86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:45:53.373309 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6db7073-a2f7-403e-a913-b52b3a580735 service cinder] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:45:53.373594 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6db7073-a2f7-403e-a913-b52b3a580735 service cinder] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:45:53.373872 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6db7073-a2f7-403e-a913-b52b3a580735 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:45:53.384999 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6db7073-a2f7-403e-a913-b52b3a580735 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:45:53.386632 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6db7073-a2f7-403e-a913-b52b3a580735 service cinder] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:45:53.398068 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1365/2723] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:45:53 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:45:53.483587 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdef655-8af1-4249-a917-1118dee24b43 None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:45:53.495035 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdef655-8af1-4249-a917-1118dee24b43 None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:45:53.500527 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea0962f-26c3-434c-a00d-0884d7147694 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cc5249aea09430080e232cf17757f86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:45:53.501175 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea0962f-26c3-434c-a00d-0884d7147694 service cinder] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:45:53.501454 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea0962f-26c3-434c-a00d-0884d7147694 service cinder] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:45:53.501964 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea0962f-26c3-434c-a00d-0884d7147694 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:45:53.575973 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea0962f-26c3-434c-a00d-0884d7147694 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:45:53.577660 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea0962f-26c3-434c-a00d-0884d7147694 service cinder] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:45:53.588873 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1359/2724] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:45:53 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:45:57.592252 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6db7073-a2f7-403e-a913-b52b3a580735 service cinder] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:45:57.652729 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6db7073-a2f7-403e-a913-b52b3a580735 service cinder] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:45:57.657244 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2ddff4-6d4b-4699-a1f5-04a7a7eaef04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:45:57.658137 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2ddff4-6d4b-4699-a1f5-04a7a7eaef04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:45:57.658424 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2ddff4-6d4b-4699-a1f5-04a7a7eaef04 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:45:57.658702 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2ddff4-6d4b-4699-a1f5-04a7a7eaef04 admin admin] PATH_INFO: `/v3/users/7a61d79299484dbca53cefae8aaad328` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:45:57.659977 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2ddff4-6d4b-4699-a1f5-04a7a7eaef04 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a61d79299484dbca53cefae8aaad328)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:45:57.662712 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2ddff4-6d4b-4699-a1f5-04a7a7eaef04 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:45:57.710202 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-0d2ddff4-6d4b-4699-a1f5-04a7a7eaef04 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a61d79299484dbca53cefae8aaad328'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:45:57.710874 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-0d2ddff4-6d4b-4699-a1f5-04a7a7eaef04 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a61d79299484dbca53cefae8aaad328'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:45:57.717742 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-0d2ddff4-6d4b-4699-a1f5-04a7a7eaef04 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a61d79299484dbca53cefae8aaad328'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:45:57.718375 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-0d2ddff4-6d4b-4699-a1f5-04a7a7eaef04 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a61d79299484dbca53cefae8aaad328'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:45:57.726876 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-0d2ddff4-6d4b-4699-a1f5-04a7a7eaef04 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a61d79299484dbca53cefae8aaad328'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:45:57.743792 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1366/2725] 10.222.0.117 () {58 vars in 1228 bytes} [Tue Jan 25 02:45:57 2022] DELETE /identity/v3/users/7a61d79299484dbca53cefae8aaad328 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:45:57.748537 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d25f09-bb4c-4f83-9a30-70c88a46b9ed None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:45:57.749056 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d25f09-bb4c-4f83-9a30-70c88a46b9ed None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:45:57.749169 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d25f09-bb4c-4f83-9a30-70c88a46b9ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:45:57.765838 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-70d25f09-bb4c-4f83-9a30-70c88a46b9ed None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:45:57.767064 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-70d25f09-bb4c-4f83-9a30-70c88a46b9ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:45:57.828449 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1360/2726] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:45:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:45:57.838887 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2ddff4-6d4b-4699-a1f5-04a7a7eaef04 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:45:57.840320 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-0d2ddff4-6d4b-4699-a1f5-04a7a7eaef04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:45:57.898096 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2ddff4-6d4b-4699-a1f5-04a7a7eaef04 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:45:57.901767 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08ac769-1683-458e-b0bd-badc2badcdab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca4071c5f8f4a31b5edb81fa66a43a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:45:57.902413 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08ac769-1683-458e-b0bd-badc2badcdab service neutron] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:45:57.902696 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08ac769-1683-458e-b0bd-badc2badcdab service neutron] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:45:57.903027 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08ac769-1683-458e-b0bd-badc2badcdab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:45:57.912619 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08ac769-1683-458e-b0bd-badc2badcdab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:45:57.914062 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08ac769-1683-458e-b0bd-badc2badcdab service neutron] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:45:57.923250 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1367/2727] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:45:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:45:58.189526 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d25f09-bb4c-4f83-9a30-70c88a46b9ed None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:45:58.190972 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-70d25f09-bb4c-4f83-9a30-70c88a46b9ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:45:58.203076 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d25f09-bb4c-4f83-9a30-70c88a46b9ed None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:45:58.208263 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de017623-90ac-45d1-97bb-728b5ff24943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:45:58.209125 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de017623-90ac-45d1-97bb-728b5ff24943 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:45:58.209408 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de017623-90ac-45d1-97bb-728b5ff24943 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:45:58.209689 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de017623-90ac-45d1-97bb-728b5ff24943 admin admin] PATH_INFO: `/v3/projects/e75bcf2bab8d43bea2b627d8f32a503c` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:45:58.210882 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de017623-90ac-45d1-97bb-728b5ff24943 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e75bcf2bab8d43bea2b627d8f32a503c)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:45:58.212857 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de017623-90ac-45d1-97bb-728b5ff24943 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:45:58.260098 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-de017623-90ac-45d1-97bb-728b5ff24943 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e75bcf2bab8d43bea2b627d8f32a503c', 'request_id': 'req-de017623-90ac-45d1-97bb-728b5ff24943'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:45:58.265285 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-de017623-90ac-45d1-97bb-728b5ff24943 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e75bcf2bab8d43bea2b627d8f32a503c', 'request_id': 'req-de017623-90ac-45d1-97bb-728b5ff24943'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:45:58.271979 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-de017623-90ac-45d1-97bb-728b5ff24943 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e75bcf2bab8d43bea2b627d8f32a503c', 'request_id': 'req-de017623-90ac-45d1-97bb-728b5ff24943'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:45:58.283923 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-de017623-90ac-45d1-97bb-728b5ff24943 admin admin] The token cache is being invalidate because project e75bcf2bab8d43bea2b627d8f32a503c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79120) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 25 02:45:58.284207 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-de017623-90ac-45d1-97bb-728b5ff24943 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:45:58.284836 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-de017623-90ac-45d1-97bb-728b5ff24943 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:45:58.287189 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1361/2728] 10.222.0.117 () {58 vars in 1237 bytes} [Tue Jan 25 02:45:58 2022] DELETE /identity/v3/projects/e75bcf2bab8d43bea2b627d8f32a503c => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:45:58.291150 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08ac769-1683-458e-b0bd-badc2badcdab service neutron] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:45:58.300615 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08ac769-1683-458e-b0bd-badc2badcdab service neutron] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:45:58.354978 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959cc187-d768-4bfd-9083-d37b0b91d83c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:45:58.355886 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959cc187-d768-4bfd-9083-d37b0b91d83c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:45:58.356176 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959cc187-d768-4bfd-9083-d37b0b91d83c admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:45:58.356456 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959cc187-d768-4bfd-9083-d37b0b91d83c admin admin] PATH_INFO: `/v3/users/91c3d4b4c5ec422c8b5d63cd919985e3` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:45:58.357658 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959cc187-d768-4bfd-9083-d37b0b91d83c admin admin] RBAC: Authorizing `identity:delete_user(user_id=91c3d4b4c5ec422c8b5d63cd919985e3)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:45:58.359585 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959cc187-d768-4bfd-9083-d37b0b91d83c admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:45:58.405139 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-959cc187-d768-4bfd-9083-d37b0b91d83c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91c3d4b4c5ec422c8b5d63cd919985e3'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:45:58.405788 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-959cc187-d768-4bfd-9083-d37b0b91d83c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91c3d4b4c5ec422c8b5d63cd919985e3'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:45:58.413748 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-959cc187-d768-4bfd-9083-d37b0b91d83c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91c3d4b4c5ec422c8b5d63cd919985e3'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:45:58.414376 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-959cc187-d768-4bfd-9083-d37b0b91d83c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91c3d4b4c5ec422c8b5d63cd919985e3'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:45:58.421425 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-959cc187-d768-4bfd-9083-d37b0b91d83c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91c3d4b4c5ec422c8b5d63cd919985e3'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:45:58.438279 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1368/2729] 10.222.0.117 () {58 vars in 1228 bytes} [Tue Jan 25 02:45:58 2022] DELETE /identity/v3/users/91c3d4b4c5ec422c8b5d63cd919985e3 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:45:58.705551 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de017623-90ac-45d1-97bb-728b5ff24943 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:45:58.707011 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-de017623-90ac-45d1-97bb-728b5ff24943 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:45:58.721790 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de017623-90ac-45d1-97bb-728b5ff24943 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:45:58.777862 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc358058-afac-4830-b09d-c791c4271c2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:45:58.778712 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc358058-afac-4830-b09d-c791c4271c2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:45:58.778989 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc358058-afac-4830-b09d-c791c4271c2b admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:45:58.779257 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc358058-afac-4830-b09d-c791c4271c2b admin admin] PATH_INFO: `/v3/projects/c7703d57dd8a47648303f69543b93ca3` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:45:58.780479 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc358058-afac-4830-b09d-c791c4271c2b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7703d57dd8a47648303f69543b93ca3)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:45:58.782365 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc358058-afac-4830-b09d-c791c4271c2b admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:45:58.826866 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-bc358058-afac-4830-b09d-c791c4271c2b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7703d57dd8a47648303f69543b93ca3', 'request_id': 'req-bc358058-afac-4830-b09d-c791c4271c2b'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:45:58.832268 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-bc358058-afac-4830-b09d-c791c4271c2b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7703d57dd8a47648303f69543b93ca3', 'request_id': 'req-bc358058-afac-4830-b09d-c791c4271c2b'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:45:58.839119 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-bc358058-afac-4830-b09d-c791c4271c2b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7703d57dd8a47648303f69543b93ca3', 'request_id': 'req-bc358058-afac-4830-b09d-c791c4271c2b'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:45:58.851166 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-bc358058-afac-4830-b09d-c791c4271c2b admin admin] The token cache is being invalidate because project c7703d57dd8a47648303f69543b93ca3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79120) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 25 02:45:58.851449 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-bc358058-afac-4830-b09d-c791c4271c2b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:45:58.852085 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-bc358058-afac-4830-b09d-c791c4271c2b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 02:45:58.853607 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1362/2730] 10.222.0.117 () {58 vars in 1237 bytes} [Tue Jan 25 02:45:58 2022] DELETE /identity/v3/projects/c7703d57dd8a47648303f69543b93ca3 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:45:58.859523 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28387ac7-5402-4571-9861-eeed954ffe4c None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:45:58.860039 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28387ac7-5402-4571-9861-eeed954ffe4c None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:45:58.860152 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28387ac7-5402-4571-9861-eeed954ffe4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:45:58.878557 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-28387ac7-5402-4571-9861-eeed954ffe4c None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:45:58.880491 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-28387ac7-5402-4571-9861-eeed954ffe4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:45:58.937213 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1369/2731] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:45:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 25 02:45:58.946179 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773fb237-f2c9-4073-8246-76901481446a None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:45:58.946474 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773fb237-f2c9-4073-8246-76901481446a None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:45:58.946757 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773fb237-f2c9-4073-8246-76901481446a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:45:58.967224 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-773fb237-f2c9-4073-8246-76901481446a None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:45:58.968474 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-773fb237-f2c9-4073-8246-76901481446a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:45:58.976503 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1363/2732] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:45:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:45:58.980752 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28387ac7-5402-4571-9861-eeed954ffe4c None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:45:58.991189 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28387ac7-5402-4571-9861-eeed954ffe4c None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:45:58.995920 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f034fe-8166-4562-8d67-605fc1dd84ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:45:58.996572 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f034fe-8166-4562-8d67-605fc1dd84ca admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:45:58.996856 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f034fe-8166-4562-8d67-605fc1dd84ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:45:58.997133 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f034fe-8166-4562-8d67-605fc1dd84ca admin admin] PATH_INFO: `/v3/domains` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:45:58.997917 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f034fe-8166-4562-8d67-605fc1dd84ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 02:45:58.998180 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f034fe-8166-4562-8d67-605fc1dd84ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:45:58.999816 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f034fe-8166-4562-8d67-605fc1dd84ca admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:45:59.012144 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1370/2733] 10.222.0.117 () {58 vars in 1157 bytes} [Tue Jan 25 02:45:58 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 02:45:59.016444 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773fb237-f2c9-4073-8246-76901481446a None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:45:59.025654 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773fb237-f2c9-4073-8246-76901481446a None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:45:59.030320 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de9a551-8797-4a38-8e23-e00b4ef53d7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:45:59.030965 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de9a551-8797-4a38-8e23-e00b4ef53d7f admin admin] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:45:59.031248 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de9a551-8797-4a38-8e23-e00b4ef53d7f admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:45:59.031522 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de9a551-8797-4a38-8e23-e00b4ef53d7f admin admin] PATH_INFO: `/v3/projects` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:45:59.032281 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de9a551-8797-4a38-8e23-e00b4ef53d7f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:45:59.034177 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de9a551-8797-4a38-8e23-e00b4ef53d7f admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:45:59.060888 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1364/2734] 10.222.0.117 () {60 vars in 1157 bytes} [Tue Jan 25 02:45:59 2022] POST /identity/v3/projects => generated 382 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 25 02:45:59.065019 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f034fe-8166-4562-8d67-605fc1dd84ca admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:45:59.075812 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f034fe-8166-4562-8d67-605fc1dd84ca admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:45:59.129985 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dd3bf4-351d-4708-ab73-8cfc07ba9098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:45:59.130788 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dd3bf4-351d-4708-ab73-8cfc07ba9098 admin admin] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:45:59.131076 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dd3bf4-351d-4708-ab73-8cfc07ba9098 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:45:59.131349 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dd3bf4-351d-4708-ab73-8cfc07ba9098 admin admin] PATH_INFO: `/v3/users` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:45:59.132086 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dd3bf4-351d-4708-ab73-8cfc07ba9098 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:45:59.134019 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dd3bf4-351d-4708-ab73-8cfc07ba9098 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:45:59.153370 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1371/2735] 10.222.0.117 () {60 vars in 1148 bytes} [Tue Jan 25 02:45:59 2022] POST /identity/v3/users => generated 292 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 02:45:59.157621 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de9a551-8797-4a38-8e23-e00b4ef53d7f admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:45:59.167668 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de9a551-8797-4a38-8e23-e00b4ef53d7f admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:45:59.172314 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c9e979-79d9-4f21-a740-f9330e3d6824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:45:59.172962 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c9e979-79d9-4f21-a740-f9330e3d6824 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:45:59.173249 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c9e979-79d9-4f21-a740-f9330e3d6824 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:45:59.173524 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c9e979-79d9-4f21-a740-f9330e3d6824 admin admin] PATH_INFO: `/v3/roles` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:45:59.174259 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c9e979-79d9-4f21-a740-f9330e3d6824 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:45:59.176446 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c9e979-79d9-4f21-a740-f9330e3d6824 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:45:59.186448 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1365/2736] 10.222.0.117 () {58 vars in 1126 bytes} [Tue Jan 25 02:45:59 2022] GET /identity/v3/roles => generated 1427 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 02:45:59.190218 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dd3bf4-351d-4708-ab73-8cfc07ba9098 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:45:59.200897 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dd3bf4-351d-4708-ab73-8cfc07ba9098 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:45:59.205593 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3387a9-ea8d-4a73-8b9d-8dd6212b119e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:45:59.206242 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3387a9-ea8d-4a73-8b9d-8dd6212b119e admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:45:59.206528 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3387a9-ea8d-4a73-8b9d-8dd6212b119e admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:45:59.206806 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3387a9-ea8d-4a73-8b9d-8dd6212b119e admin admin] PATH_INFO: `/v3/roles` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:45:59.207668 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3387a9-ea8d-4a73-8b9d-8dd6212b119e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:45:59.209300 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3387a9-ea8d-4a73-8b9d-8dd6212b119e admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:45:59.218980 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1372/2737] 10.222.0.117 () {58 vars in 1126 bytes} [Tue Jan 25 02:45:59 2022] GET /identity/v3/roles => generated 1427 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 02:45:59.223240 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c9e979-79d9-4f21-a740-f9330e3d6824 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:45:59.233086 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c9e979-79d9-4f21-a740-f9330e3d6824 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:45:59.237621 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebea274-67e5-4918-aac1-41077b2075a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:45:59.239021 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebea274-67e5-4918-aac1-41077b2075a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:45:59.239758 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebea274-67e5-4918-aac1-41077b2075a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:45:59.239758 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebea274-67e5-4918-aac1-41077b2075a0 admin admin] PATH_INFO: `/v3/projects/48ce4d90d9f948748057584c88319497/users/3b31b3b347d549308acb2e2b5332a74c/roles/33a8e87420ed423f9cb29e0084eab5d2` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:45:59.253795 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebea274-67e5-4918-aac1-41077b2075a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48ce4d90d9f948748057584c88319497, user_id=3b31b3b347d549308acb2e2b5332a74c, role_id=33a8e87420ed423f9cb29e0084eab5d2)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:45:59.257229 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebea274-67e5-4918-aac1-41077b2075a0 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:45:59.270224 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1366/2738] 10.222.0.117 () {60 vars in 1487 bytes} [Tue Jan 25 02:45:59 2022] PUT /identity/v3/projects/48ce4d90d9f948748057584c88319497/users/3b31b3b347d549308acb2e2b5332a74c/roles/33a8e87420ed423f9cb29e0084eab5d2 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 02:45:59.275409 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2ad290-ce5e-40b9-af69-96182f111a65 None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:45:59.275733 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2ad290-ce5e-40b9-af69-96182f111a65 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:45:59.276021 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2ad290-ce5e-40b9-af69-96182f111a65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:45:59.294368 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-6a2ad290-ce5e-40b9-af69-96182f111a65 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:45:59.295586 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-6a2ad290-ce5e-40b9-af69-96182f111a65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:45:59.353338 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1373/2739] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:45:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:45:59.363128 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebea274-67e5-4918-aac1-41077b2075a0 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:45:59.365054 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-5ebea274-67e5-4918-aac1-41077b2075a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:45:59.425771 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebea274-67e5-4918-aac1-41077b2075a0 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:45:59.429671 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd8417e-7bbf-4676-a414-fa693cbfcdd9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca4071c5f8f4a31b5edb81fa66a43a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:45:59.430317 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd8417e-7bbf-4676-a414-fa693cbfcdd9 service neutron] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:45:59.430601 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd8417e-7bbf-4676-a414-fa693cbfcdd9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:45:59.430878 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd8417e-7bbf-4676-a414-fa693cbfcdd9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:45:59.439769 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd8417e-7bbf-4676-a414-fa693cbfcdd9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:45:59.441203 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd8417e-7bbf-4676-a414-fa693cbfcdd9 service neutron] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:45:59.451270 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1367/2740] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:45:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:46:00.046186 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fef3ba9-a8a1-4fff-8365-da31074393eb None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:46:00.046862 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fef3ba9-a8a1-4fff-8365-da31074393eb None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:46:00.046973 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fef3ba9-a8a1-4fff-8365-da31074393eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:46:00.073690 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-6fef3ba9-a8a1-4fff-8365-da31074393eb None None] MFA Rules not processed for user `3b31b3b347d549308acb2e2b5332a74c`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:46:00.074902 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-6fef3ba9-a8a1-4fff-8365-da31074393eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:46:00.142155 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1374/2741] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:46:00 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 25 02:46:00.151804 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd8417e-7bbf-4676-a414-fa693cbfcdd9 service neutron] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:46:00.153353 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-8dd8417e-7bbf-4676-a414-fa693cbfcdd9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:46:00.211966 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd8417e-7bbf-4676-a414-fa693cbfcdd9 service neutron] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:46:00.215870 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365e612e-b6ab-49b4-b55b-6640bf95768f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cc5249aea09430080e232cf17757f86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:46:00.216521 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365e612e-b6ab-49b4-b55b-6640bf95768f service cinder] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:46:00.216805 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365e612e-b6ab-49b4-b55b-6640bf95768f service cinder] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:46:00.217129 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365e612e-b6ab-49b4-b55b-6640bf95768f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:46:00.226374 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365e612e-b6ab-49b4-b55b-6640bf95768f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:46:00.227882 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365e612e-b6ab-49b4-b55b-6640bf95768f service cinder] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:46:00.236745 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1368/2742] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:46:00 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 25 02:46:01.575682 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb3dea6-01a5-4524-961a-08325b91e191 None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:46:01.576257 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb3dea6-01a5-4524-961a-08325b91e191 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:46:01.576257 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb3dea6-01a5-4524-961a-08325b91e191 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:46:01.594045 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-cfb3dea6-01a5-4524-961a-08325b91e191 None None] MFA Rules not processed for user `3b31b3b347d549308acb2e2b5332a74c`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 02:46:01.595252 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-cfb3dea6-01a5-4524-961a-08325b91e191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:46:01.603061 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1375/2743] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 02:46:01 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 02:46:36.244696 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365e612e-b6ab-49b4-b55b-6640bf95768f service cinder] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:46:36.246125 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-365e612e-b6ab-49b4-b55b-6640bf95768f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:46:36.258614 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365e612e-b6ab-49b4-b55b-6640bf95768f service cinder] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:46:36.262200 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9b81fc-2edc-4cba-bb29-32cc9c4a7fe9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca4071c5f8f4a31b5edb81fa66a43a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:46:36.262823 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9b81fc-2edc-4cba-bb29-32cc9c4a7fe9 service neutron] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:46:36.263100 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9b81fc-2edc-4cba-bb29-32cc9c4a7fe9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:46:36.263371 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9b81fc-2edc-4cba-bb29-32cc9c4a7fe9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:46:36.265127 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-ce9b81fc-2edc-4cba-bb29-32cc9c4a7fe9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:46:36.275357 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9b81fc-2edc-4cba-bb29-32cc9c4a7fe9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:46:36.276797 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9b81fc-2edc-4cba-bb29-32cc9c4a7fe9 service neutron] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:46:36.284752 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1369/2744] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:46:36 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:46:38.460311 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb3dea6-01a5-4524-961a-08325b91e191 None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:46:38.461704 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-cfb3dea6-01a5-4524-961a-08325b91e191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:46:38.473595 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb3dea6-01a5-4524-961a-08325b91e191 None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:46:38.477145 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e611f2-9270-4540-a126-4c8b91fbe019 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cc5249aea09430080e232cf17757f86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:46:38.477777 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e611f2-9270-4540-a126-4c8b91fbe019 service cinder] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:46:38.478060 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e611f2-9270-4540-a126-4c8b91fbe019 service cinder] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:46:38.478340 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e611f2-9270-4540-a126-4c8b91fbe019 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:46:38.480046 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-e1e611f2-9270-4540-a126-4c8b91fbe019 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:46:38.547673 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e611f2-9270-4540-a126-4c8b91fbe019 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:46:38.549154 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e611f2-9270-4540-a126-4c8b91fbe019 service cinder] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:46:38.560066 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1376/2745] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:46:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:47:33.307178 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9b81fc-2edc-4cba-bb29-32cc9c4a7fe9 service neutron] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:47:33.316392 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9b81fc-2edc-4cba-bb29-32cc9c4a7fe9 service neutron] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:47:33.320945 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e379cd-3f75-4c4b-9dc1-2125836b4705 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cc5249aea09430080e232cf17757f86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:47:33.321574 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e379cd-3f75-4c4b-9dc1-2125836b4705 service cinder] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:47:33.321858 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e379cd-3f75-4c4b-9dc1-2125836b4705 service cinder] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:47:33.322133 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e379cd-3f75-4c4b-9dc1-2125836b4705 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:47:33.323938 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-45e379cd-3f75-4c4b-9dc1-2125836b4705 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:47:33.379967 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e379cd-3f75-4c4b-9dc1-2125836b4705 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:47:33.381422 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e379cd-3f75-4c4b-9dc1-2125836b4705 service cinder] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:47:33.390533 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1370/2746] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:47:33 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:48:39.513793 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e611f2-9270-4540-a126-4c8b91fbe019 service cinder] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:48:39.515183 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-e1e611f2-9270-4540-a126-4c8b91fbe019 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:48:39.649494 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e611f2-9270-4540-a126-4c8b91fbe019 service cinder] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:48:39.655857 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f262a4a-1bb1-447f-9e26-527490e4e7fa service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '890151a6bf2840f0a0a00f45dd2d38a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:48:39.656607 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f262a4a-1bb1-447f-9e26-527490e4e7fa service placement] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:48:39.656900 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f262a4a-1bb1-447f-9e26-527490e4e7fa service placement] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:48:39.657263 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f262a4a-1bb1-447f-9e26-527490e4e7fa service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:48:39.660003 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-9f262a4a-1bb1-447f-9e26-527490e4e7fa service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:48:39.672111 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f262a4a-1bb1-447f-9e26-527490e4e7fa service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:48:39.673741 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f262a4a-1bb1-447f-9e26-527490e4e7fa service placement] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:48:39.684203 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1377/2747] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:48:39 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:49:38.629980 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e379cd-3f75-4c4b-9dc1-2125836b4705 service cinder] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:49:38.659462 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e379cd-3f75-4c4b-9dc1-2125836b4705 service cinder] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:49:38.663373 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21aa48ba-65f1-4fd3-b051-f0c98f198866 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cc5249aea09430080e232cf17757f86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:49:38.664060 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aa48ba-65f1-4fd3-b051-f0c98f198866 service cinder] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:49:38.664345 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aa48ba-65f1-4fd3-b051-f0c98f198866 service cinder] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:49:38.664623 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aa48ba-65f1-4fd3-b051-f0c98f198866 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:49:38.666692 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-21aa48ba-65f1-4fd3-b051-f0c98f198866 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:49:38.750046 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21aa48ba-65f1-4fd3-b051-f0c98f198866 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:49:38.752227 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21aa48ba-65f1-4fd3-b051-f0c98f198866 service cinder] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:49:38.772402 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1371/2748] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:49:38 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:51:00.802650 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f262a4a-1bb1-447f-9e26-527490e4e7fa service placement] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:51:00.811876 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f262a4a-1bb1-447f-9e26-527490e4e7fa service placement] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:51:00.815518 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ae4c33-d991-4008-bc4c-8e471c9efc2a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cc5249aea09430080e232cf17757f86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:51:00.816188 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ae4c33-d991-4008-bc4c-8e471c9efc2a service cinder] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:51:00.816476 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ae4c33-d991-4008-bc4c-8e471c9efc2a service cinder] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:51:00.816754 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ae4c33-d991-4008-bc4c-8e471c9efc2a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:51:00.825261 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ae4c33-d991-4008-bc4c-8e471c9efc2a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:51:00.826700 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ae4c33-d991-4008-bc4c-8e471c9efc2a service cinder] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:51:00.836138 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1378/2749] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:51:00 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:51:41.237854 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21aa48ba-65f1-4fd3-b051-f0c98f198866 service cinder] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:51:41.256795 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21aa48ba-65f1-4fd3-b051-f0c98f198866 service cinder] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:51:41.260551 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ba69ef-600d-4e8c-92ef-e4cf6c068f92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca4071c5f8f4a31b5edb81fa66a43a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:51:41.261182 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ba69ef-600d-4e8c-92ef-e4cf6c068f92 service neutron] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:51:41.261462 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ba69ef-600d-4e8c-92ef-e4cf6c068f92 service neutron] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:51:41.261737 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ba69ef-600d-4e8c-92ef-e4cf6c068f92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:51:41.270066 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ba69ef-600d-4e8c-92ef-e4cf6c068f92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:51:41.271506 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ba69ef-600d-4e8c-92ef-e4cf6c068f92 service neutron] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:51:41.279786 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1372/2750] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:51:41 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 25 02:52:34.265821 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ae4c33-d991-4008-bc4c-8e471c9efc2a service cinder] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:52:34.275025 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ae4c33-d991-4008-bc4c-8e471c9efc2a service cinder] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:52:34.278819 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80934a3-4a26-4155-96b5-ca04e528a42d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cc5249aea09430080e232cf17757f86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:52:34.279454 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80934a3-4a26-4155-96b5-ca04e528a42d service cinder] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:52:34.279773 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80934a3-4a26-4155-96b5-ca04e528a42d service cinder] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:52:34.280053 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80934a3-4a26-4155-96b5-ca04e528a42d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:52:34.288831 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80934a3-4a26-4155-96b5-ca04e528a42d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:52:34.290277 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80934a3-4a26-4155-96b5-ca04e528a42d service cinder] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:52:34.317768 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1379/2751] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:52:34 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:52:52.213479 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ba69ef-600d-4e8c-92ef-e4cf6c068f92 service neutron] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:52:52.222678 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ba69ef-600d-4e8c-92ef-e4cf6c068f92 service neutron] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:52:52.226299 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc997e1-c185-4ab9-84b2-eeb5ff25322d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cc5249aea09430080e232cf17757f86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:52:52.227734 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc997e1-c185-4ab9-84b2-eeb5ff25322d service cinder] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:52:52.228083 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc997e1-c185-4ab9-84b2-eeb5ff25322d service cinder] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:52:52.228424 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc997e1-c185-4ab9-84b2-eeb5ff25322d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:52:52.245610 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc997e1-c185-4ab9-84b2-eeb5ff25322d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:52:52.247145 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc997e1-c185-4ab9-84b2-eeb5ff25322d service cinder] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:52:52.267821 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1373/2752] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:52:52 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:53:41.569679 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80934a3-4a26-4155-96b5-ca04e528a42d service cinder] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:53:41.571057 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-f80934a3-4a26-4155-96b5-ca04e528a42d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:53:41.585628 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80934a3-4a26-4155-96b5-ca04e528a42d service cinder] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:53:41.590923 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a55bc0-ec90-49b0-a217-1293eac8cca8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '890151a6bf2840f0a0a00f45dd2d38a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:53:41.591558 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a55bc0-ec90-49b0-a217-1293eac8cca8 service placement] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:53:41.591865 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a55bc0-ec90-49b0-a217-1293eac8cca8 service placement] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:53:41.592141 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a55bc0-ec90-49b0-a217-1293eac8cca8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:53:41.600780 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a55bc0-ec90-49b0-a217-1293eac8cca8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:53:41.602352 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a55bc0-ec90-49b0-a217-1293eac8cca8 service placement] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:53:41.612932 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1380/2753] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:53:41 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:54:39.423129 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc997e1-c185-4ab9-84b2-eeb5ff25322d service cinder] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:54:39.424640 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-2bc997e1-c185-4ab9-84b2-eeb5ff25322d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:54:39.452923 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc997e1-c185-4ab9-84b2-eeb5ff25322d service cinder] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:54:39.459894 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb85885-c5bb-4da6-8ece-4d00a91cdb01 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9ad6269900346458050063c12cac299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:54:39.460541 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb85885-c5bb-4da6-8ece-4d00a91cdb01 service nova] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:54:39.460824 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb85885-c5bb-4da6-8ece-4d00a91cdb01 service nova] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:54:39.461096 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb85885-c5bb-4da6-8ece-4d00a91cdb01 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:54:39.470804 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb85885-c5bb-4da6-8ece-4d00a91cdb01 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:54:39.473114 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb85885-c5bb-4da6-8ece-4d00a91cdb01 service nova] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:54:39.484759 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1374/2754] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:54:39 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:55:59.696273 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a55bc0-ec90-49b0-a217-1293eac8cca8 service placement] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:55:59.706725 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a55bc0-ec90-49b0-a217-1293eac8cca8 service placement] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:55:59.710585 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff76e2be-55e2-4d36-a2ed-b32510ceb4eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cc5249aea09430080e232cf17757f86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:55:59.711228 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff76e2be-55e2-4d36-a2ed-b32510ceb4eb service cinder] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:55:59.711514 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff76e2be-55e2-4d36-a2ed-b32510ceb4eb service cinder] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:55:59.711824 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff76e2be-55e2-4d36-a2ed-b32510ceb4eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:55:59.721535 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff76e2be-55e2-4d36-a2ed-b32510ceb4eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:55:59.723253 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff76e2be-55e2-4d36-a2ed-b32510ceb4eb service cinder] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:55:59.733460 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1381/2755] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:55:59 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:56:46.279442 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb85885-c5bb-4da6-8ece-4d00a91cdb01 service nova] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:56:46.280998 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-8cb85885-c5bb-4da6-8ece-4d00a91cdb01 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:56:46.347508 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb85885-c5bb-4da6-8ece-4d00a91cdb01 service nova] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:56:46.351075 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf61b61-2d39-44b9-a2bf-033943b2076d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca4071c5f8f4a31b5edb81fa66a43a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:56:46.351726 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf61b61-2d39-44b9-a2bf-033943b2076d service neutron] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:56:46.352017 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf61b61-2d39-44b9-a2bf-033943b2076d service neutron] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:56:46.352293 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf61b61-2d39-44b9-a2bf-033943b2076d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:56:46.354155 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-5cf61b61-2d39-44b9-a2bf-033943b2076d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:56:46.363243 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf61b61-2d39-44b9-a2bf-033943b2076d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:56:46.364694 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf61b61-2d39-44b9-a2bf-033943b2076d service neutron] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:56:46.372800 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1375/2756] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:56:46 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:57:34.500240 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff76e2be-55e2-4d36-a2ed-b32510ceb4eb service cinder] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:57:34.502717 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-ff76e2be-55e2-4d36-a2ed-b32510ceb4eb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:57:34.575977 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff76e2be-55e2-4d36-a2ed-b32510ceb4eb service cinder] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:57:34.579520 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bacf59-0286-437e-8ece-2dbf729217ff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cc5249aea09430080e232cf17757f86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:57:34.580179 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bacf59-0286-437e-8ece-2dbf729217ff service cinder] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:57:34.580463 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bacf59-0286-437e-8ece-2dbf729217ff service cinder] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:57:34.580736 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bacf59-0286-437e-8ece-2dbf729217ff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:57:34.582588 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-25bacf59-0286-437e-8ece-2dbf729217ff service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:57:34.651956 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bacf59-0286-437e-8ece-2dbf729217ff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:57:34.653836 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bacf59-0286-437e-8ece-2dbf729217ff service cinder] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:57:34.662987 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1382/2757] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:57:34 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:58:48.534635 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf61b61-2d39-44b9-a2bf-033943b2076d service neutron] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:58:48.536216 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-5cf61b61-2d39-44b9-a2bf-033943b2076d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:58:48.661796 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf61b61-2d39-44b9-a2bf-033943b2076d service neutron] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:58:48.667460 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5051141d-cf34-420e-8c8a-c89ccfbbf9c9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '890151a6bf2840f0a0a00f45dd2d38a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:58:48.668133 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5051141d-cf34-420e-8c8a-c89ccfbbf9c9 service placement] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:58:48.668418 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5051141d-cf34-420e-8c8a-c89ccfbbf9c9 service placement] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:58:48.668693 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5051141d-cf34-420e-8c8a-c89ccfbbf9c9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:58:48.670579 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-5051141d-cf34-420e-8c8a-c89ccfbbf9c9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:58:48.682876 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5051141d-cf34-420e-8c8a-c89ccfbbf9c9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:58:48.684488 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5051141d-cf34-420e-8c8a-c89ccfbbf9c9 service placement] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:58:48.694350 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1376/2758] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:58:48 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:58:53.543542 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bacf59-0286-437e-8ece-2dbf729217ff service cinder] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:58:53.545247 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-25bacf59-0286-437e-8ece-2dbf729217ff service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:58:53.566930 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bacf59-0286-437e-8ece-2dbf729217ff service cinder] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:58:53.570565 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abcd4f7-5026-4df1-85b6-7f1a969a387e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca4071c5f8f4a31b5edb81fa66a43a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:58:53.571927 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abcd4f7-5026-4df1-85b6-7f1a969a387e service neutron] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:58:53.572211 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abcd4f7-5026-4df1-85b6-7f1a969a387e service neutron] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:58:53.572492 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abcd4f7-5026-4df1-85b6-7f1a969a387e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:58:53.574280 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-8abcd4f7-5026-4df1-85b6-7f1a969a387e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:58:53.642628 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abcd4f7-5026-4df1-85b6-7f1a969a387e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:58:53.644049 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abcd4f7-5026-4df1-85b6-7f1a969a387e service neutron] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:58:53.654949 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1383/2759] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:58:53 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:58:55.995624 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5051141d-cf34-420e-8c8a-c89ccfbbf9c9 service placement] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:58:56.005032 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5051141d-cf34-420e-8c8a-c89ccfbbf9c9 service placement] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:58:56.009037 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a839d07-5262-41e7-93a0-ca9bb136f2c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca4071c5f8f4a31b5edb81fa66a43a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:58:56.009694 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a839d07-5262-41e7-93a0-ca9bb136f2c2 service neutron] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:58:56.009978 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a839d07-5262-41e7-93a0-ca9bb136f2c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:58:56.010365 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a839d07-5262-41e7-93a0-ca9bb136f2c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:58:56.012330 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-7a839d07-5262-41e7-93a0-ca9bb136f2c2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:58:56.025665 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a839d07-5262-41e7-93a0-ca9bb136f2c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:58:56.027077 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a839d07-5262-41e7-93a0-ca9bb136f2c2 service neutron] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:58:56.037654 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1377/2760] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:58:55 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:59:34.609607 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abcd4f7-5026-4df1-85b6-7f1a969a387e service neutron] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:59:34.622815 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abcd4f7-5026-4df1-85b6-7f1a969a387e service neutron] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:59:34.628891 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb68e1c-840a-4fe0-a9e1-22e113eb9ecf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9ad6269900346458050063c12cac299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:59:34.629554 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb68e1c-840a-4fe0-a9e1-22e113eb9ecf service nova] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:59:34.630408 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb68e1c-840a-4fe0-a9e1-22e113eb9ecf service nova] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:59:34.630700 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb68e1c-840a-4fe0-a9e1-22e113eb9ecf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:59:34.632546 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-eeb68e1c-840a-4fe0-a9e1-22e113eb9ecf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:59:34.646549 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb68e1c-840a-4fe0-a9e1-22e113eb9ecf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:59:34.648188 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb68e1c-840a-4fe0-a9e1-22e113eb9ecf service nova] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:59:34.659160 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1384/2761] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:59:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 02:59:42.785005 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a839d07-5262-41e7-93a0-ca9bb136f2c2 service neutron] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 02:59:42.812764 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a839d07-5262-41e7-93a0-ca9bb136f2c2 service neutron] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 02:59:42.816354 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11683b07-d149-4ebd-9749-b255140e4809 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cc5249aea09430080e232cf17757f86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 02:59:42.816985 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11683b07-d149-4ebd-9749-b255140e4809 service cinder] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 02:59:42.817266 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11683b07-d149-4ebd-9749-b255140e4809 service cinder] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 02:59:42.817538 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11683b07-d149-4ebd-9749-b255140e4809 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 02:59:42.819399 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-11683b07-d149-4ebd-9749-b255140e4809 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 02:59:42.897561 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11683b07-d149-4ebd-9749-b255140e4809 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 02:59:42.898905 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11683b07-d149-4ebd-9749-b255140e4809 service cinder] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 02:59:42.916986 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1378/2762] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 02:59:42 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:01:00.124895 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb68e1c-840a-4fe0-a9e1-22e113eb9ecf service nova] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:01:00.126297 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-eeb68e1c-840a-4fe0-a9e1-22e113eb9ecf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:01:00.149481 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb68e1c-840a-4fe0-a9e1-22e113eb9ecf service nova] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:01:00.155623 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363934b4-c4e1-4064-8a13-74a6c68ede6f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9ad6269900346458050063c12cac299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:01:00.156287 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363934b4-c4e1-4064-8a13-74a6c68ede6f service nova] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:01:00.156571 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363934b4-c4e1-4064-8a13-74a6c68ede6f service nova] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:01:00.156848 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363934b4-c4e1-4064-8a13-74a6c68ede6f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:01:00.158682 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-363934b4-c4e1-4064-8a13-74a6c68ede6f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:01:00.239625 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363934b4-c4e1-4064-8a13-74a6c68ede6f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:01:00.241385 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363934b4-c4e1-4064-8a13-74a6c68ede6f service nova] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:01:00.262817 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1385/2763] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 03:01:00 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:01:50.913058 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11683b07-d149-4ebd-9749-b255140e4809 service cinder] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:01:50.932123 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11683b07-d149-4ebd-9749-b255140e4809 service cinder] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:01:50.936384 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92af7181-634c-4b16-b855-b813b7912ac2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca4071c5f8f4a31b5edb81fa66a43a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:01:50.937008 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92af7181-634c-4b16-b855-b813b7912ac2 service neutron] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:01:50.937286 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92af7181-634c-4b16-b855-b813b7912ac2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:01:50.937581 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92af7181-634c-4b16-b855-b813b7912ac2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:01:50.944565 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92af7181-634c-4b16-b855-b813b7912ac2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:01:50.945974 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92af7181-634c-4b16-b855-b813b7912ac2 service neutron] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:01:50.954175 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1379/2764] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 03:01:50 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:02:35.502066 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363934b4-c4e1-4064-8a13-74a6c68ede6f service nova] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:02:35.513895 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363934b4-c4e1-4064-8a13-74a6c68ede6f service nova] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:02:35.519497 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f4d453-652c-4ce5-9feb-f090c3315ec0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9ad6269900346458050063c12cac299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:02:35.520175 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f4d453-652c-4ce5-9feb-f090c3315ec0 service nova] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:02:35.520462 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f4d453-652c-4ce5-9feb-f090c3315ec0 service nova] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:02:35.520738 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f4d453-652c-4ce5-9feb-f090c3315ec0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:02:35.528650 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f4d453-652c-4ce5-9feb-f090c3315ec0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:02:35.530240 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f4d453-652c-4ce5-9feb-f090c3315ec0 service nova] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:02:35.557592 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1386/2765] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 03:02:35 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:03:50.537782 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92af7181-634c-4b16-b855-b813b7912ac2 service neutron] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:03:50.539362 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-92af7181-634c-4b16-b855-b813b7912ac2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:03:50.554194 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92af7181-634c-4b16-b855-b813b7912ac2 service neutron] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:03:50.559402 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046b35df-9636-4cf9-9b42-06dbc640ced3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '890151a6bf2840f0a0a00f45dd2d38a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:03:50.560064 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046b35df-9636-4cf9-9b42-06dbc640ced3 service placement] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:03:50.560350 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046b35df-9636-4cf9-9b42-06dbc640ced3 service placement] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:03:50.560632 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046b35df-9636-4cf9-9b42-06dbc640ced3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:03:50.569582 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046b35df-9636-4cf9-9b42-06dbc640ced3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:03:50.571159 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046b35df-9636-4cf9-9b42-06dbc640ced3 service placement] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:03:50.581601 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1380/2766] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 03:03:50 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:03:52.020681 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f4d453-652c-4ce5-9feb-f090c3315ec0 service nova] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:03:52.029903 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f4d453-652c-4ce5-9feb-f090c3315ec0 service nova] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:03:52.034055 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d7b338-4944-4efd-b1c0-8da3125f460f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca4071c5f8f4a31b5edb81fa66a43a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:03:52.034691 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d7b338-4944-4efd-b1c0-8da3125f460f service neutron] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:03:52.034977 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d7b338-4944-4efd-b1c0-8da3125f460f service neutron] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:03:52.035255 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d7b338-4944-4efd-b1c0-8da3125f460f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:03:52.052844 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d7b338-4944-4efd-b1c0-8da3125f460f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:03:52.054301 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d7b338-4944-4efd-b1c0-8da3125f460f service neutron] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:03:52.074885 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1387/2767] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 03:03:52 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:03:55.461655 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046b35df-9636-4cf9-9b42-06dbc640ced3 service placement] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:03:55.470893 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046b35df-9636-4cf9-9b42-06dbc640ced3 service placement] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:03:55.474492 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e229db56-c97e-4bf3-8e58-b3344e7124d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca4071c5f8f4a31b5edb81fa66a43a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:03:55.475120 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e229db56-c97e-4bf3-8e58-b3344e7124d5 service neutron] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:03:55.475407 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e229db56-c97e-4bf3-8e58-b3344e7124d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:03:55.475686 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e229db56-c97e-4bf3-8e58-b3344e7124d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:03:55.486279 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e229db56-c97e-4bf3-8e58-b3344e7124d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:03:55.487750 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e229db56-c97e-4bf3-8e58-b3344e7124d5 service neutron] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:03:55.498733 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1381/2768] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 03:03:55 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:05:36.668286 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d7b338-4944-4efd-b1c0-8da3125f460f service neutron] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:05:36.669849 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-c7d7b338-4944-4efd-b1c0-8da3125f460f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:05:36.684683 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d7b338-4944-4efd-b1c0-8da3125f460f service neutron] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:05:36.688315 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c11cdab-bcd6-45f2-9599-377d68cdb71d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cc5249aea09430080e232cf17757f86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:05:36.688956 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c11cdab-bcd6-45f2-9599-377d68cdb71d service cinder] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:05:36.689741 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c11cdab-bcd6-45f2-9599-377d68cdb71d service cinder] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:05:36.690176 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c11cdab-bcd6-45f2-9599-377d68cdb71d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:05:36.698563 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c11cdab-bcd6-45f2-9599-377d68cdb71d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:05:36.700028 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c11cdab-bcd6-45f2-9599-377d68cdb71d service cinder] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:05:36.709538 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1388/2769] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 03:05:36 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:06:54.237830 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e229db56-c97e-4bf3-8e58-b3344e7124d5 service neutron] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:06:54.239405 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-e229db56-c97e-4bf3-8e58-b3344e7124d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:06:54.305674 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e229db56-c97e-4bf3-8e58-b3344e7124d5 service neutron] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:06:54.309362 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3a7bbb-275b-4d5c-9d44-fae982f08208 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca4071c5f8f4a31b5edb81fa66a43a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:06:54.310001 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3a7bbb-275b-4d5c-9d44-fae982f08208 service neutron] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:06:54.310285 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3a7bbb-275b-4d5c-9d44-fae982f08208 service neutron] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:06:54.310563 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3a7bbb-275b-4d5c-9d44-fae982f08208 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:06:54.312470 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-cd3a7bbb-275b-4d5c-9d44-fae982f08208 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:06:54.322546 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3a7bbb-275b-4d5c-9d44-fae982f08208 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:06:54.324012 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3a7bbb-275b-4d5c-9d44-fae982f08208 service neutron] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:06:54.331745 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1382/2770] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 03:06:54 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 25 03:07:37.009798 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c11cdab-bcd6-45f2-9599-377d68cdb71d service cinder] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:07:37.061675 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c11cdab-bcd6-45f2-9599-377d68cdb71d service cinder] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:07:37.065867 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef2e4da-bb6c-4200-bec9-09b8ed555bfd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cc5249aea09430080e232cf17757f86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:07:37.066500 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef2e4da-bb6c-4200-bec9-09b8ed555bfd service cinder] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:07:37.066785 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef2e4da-bb6c-4200-bec9-09b8ed555bfd service cinder] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:07:37.067058 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef2e4da-bb6c-4200-bec9-09b8ed555bfd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:07:37.075261 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef2e4da-bb6c-4200-bec9-09b8ed555bfd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:07:37.076724 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef2e4da-bb6c-4200-bec9-09b8ed555bfd service cinder] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:07:37.085189 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1389/2771] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 03:07:37 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:07:37.109726 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3a7bbb-275b-4d5c-9d44-fae982f08208 service neutron] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:07:37.119246 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3a7bbb-275b-4d5c-9d44-fae982f08208 service neutron] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:07:37.122760 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5062b6e5-e1f3-49c6-88ce-4a25e8a38bef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cc5249aea09430080e232cf17757f86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:07:37.123376 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5062b6e5-e1f3-49c6-88ce-4a25e8a38bef service cinder] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:07:37.123654 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5062b6e5-e1f3-49c6-88ce-4a25e8a38bef service cinder] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:07:37.123954 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5062b6e5-e1f3-49c6-88ce-4a25e8a38bef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:07:37.125769 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-5062b6e5-e1f3-49c6-88ce-4a25e8a38bef service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:07:37.194519 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5062b6e5-e1f3-49c6-88ce-4a25e8a38bef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:07:37.195988 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5062b6e5-e1f3-49c6-88ce-4a25e8a38bef service cinder] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:07:37.204642 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1383/2772] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 03:07:37 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 25 03:07:39.404277 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef2e4da-bb6c-4200-bec9-09b8ed555bfd service cinder] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:07:39.405870 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-9ef2e4da-bb6c-4200-bec9-09b8ed555bfd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:07:39.440818 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef2e4da-bb6c-4200-bec9-09b8ed555bfd service cinder] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:07:39.447531 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9801b0dc-17be-4a8b-a0bc-552fa0b1e8fd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9ad6269900346458050063c12cac299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:07:39.448295 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9801b0dc-17be-4a8b-a0bc-552fa0b1e8fd service nova] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:07:39.448657 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9801b0dc-17be-4a8b-a0bc-552fa0b1e8fd service nova] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:07:39.449012 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9801b0dc-17be-4a8b-a0bc-552fa0b1e8fd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:07:39.459772 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9801b0dc-17be-4a8b-a0bc-552fa0b1e8fd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:07:39.461510 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9801b0dc-17be-4a8b-a0bc-552fa0b1e8fd service nova] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:07:39.473996 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1390/2773] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 03:07:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:08:53.071150 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5062b6e5-e1f3-49c6-88ce-4a25e8a38bef service cinder] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:08:53.080402 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5062b6e5-e1f3-49c6-88ce-4a25e8a38bef service cinder] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:08:53.084614 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3dbcda-9ddf-46b6-8663-a283653f5ad2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca4071c5f8f4a31b5edb81fa66a43a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:08:53.085245 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3dbcda-9ddf-46b6-8663-a283653f5ad2 service neutron] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:08:53.085525 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3dbcda-9ddf-46b6-8663-a283653f5ad2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:08:53.085798 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3dbcda-9ddf-46b6-8663-a283653f5ad2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:08:53.116703 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3dbcda-9ddf-46b6-8663-a283653f5ad2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:08:53.118886 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3dbcda-9ddf-46b6-8663-a283653f5ad2 service neutron] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:08:53.133535 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1384/2774] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 03:08:53 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:08:55.563115 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9801b0dc-17be-4a8b-a0bc-552fa0b1e8fd service nova] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:08:55.564778 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-9801b0dc-17be-4a8b-a0bc-552fa0b1e8fd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:08:55.698858 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9801b0dc-17be-4a8b-a0bc-552fa0b1e8fd service nova] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:08:55.704019 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4b81da-008d-47a5-93a9-4c572fe3162d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '890151a6bf2840f0a0a00f45dd2d38a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:08:55.704659 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4b81da-008d-47a5-93a9-4c572fe3162d service placement] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:08:55.704943 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4b81da-008d-47a5-93a9-4c572fe3162d service placement] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:08:55.705218 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4b81da-008d-47a5-93a9-4c572fe3162d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:08:55.707071 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-2a4b81da-008d-47a5-93a9-4c572fe3162d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:08:55.718910 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4b81da-008d-47a5-93a9-4c572fe3162d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:08:55.720553 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4b81da-008d-47a5-93a9-4c572fe3162d service placement] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:08:55.730921 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1391/2775] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 03:08:55 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 25 03:08:56.441002 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3dbcda-9ddf-46b6-8663-a283653f5ad2 service neutron] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:08:56.449925 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3dbcda-9ddf-46b6-8663-a283653f5ad2 service neutron] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:08:56.453555 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d792bd-2d30-4b24-a887-b75fd7d80a20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca4071c5f8f4a31b5edb81fa66a43a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:08:56.454185 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d792bd-2d30-4b24-a887-b75fd7d80a20 service neutron] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:08:56.454470 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d792bd-2d30-4b24-a887-b75fd7d80a20 service neutron] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:08:56.454753 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d792bd-2d30-4b24-a887-b75fd7d80a20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:08:56.456645 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-85d792bd-2d30-4b24-a887-b75fd7d80a20 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:08:56.524921 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d792bd-2d30-4b24-a887-b75fd7d80a20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:08:56.526344 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d792bd-2d30-4b24-a887-b75fd7d80a20 service neutron] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:08:56.536950 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1385/2776] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 03:08:56 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:10:37.376819 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4b81da-008d-47a5-93a9-4c572fe3162d service placement] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:10:37.389842 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4b81da-008d-47a5-93a9-4c572fe3162d service placement] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:10:37.395339 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420d7538-d203-47fb-a448-76bfb67e00d0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9ad6269900346458050063c12cac299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:10:37.395998 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420d7538-d203-47fb-a448-76bfb67e00d0 service nova] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:10:37.396279 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420d7538-d203-47fb-a448-76bfb67e00d0 service nova] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:10:37.396551 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420d7538-d203-47fb-a448-76bfb67e00d0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:10:37.398435 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-420d7538-d203-47fb-a448-76bfb67e00d0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:10:37.476390 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420d7538-d203-47fb-a448-76bfb67e00d0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:10:37.477988 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420d7538-d203-47fb-a448-76bfb67e00d0 service nova] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:10:37.495878 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1392/2777] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 03:10:37 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:11:37.945182 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d792bd-2d30-4b24-a887-b75fd7d80a20 service neutron] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:11:37.964380 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d792bd-2d30-4b24-a887-b75fd7d80a20 service neutron] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:11:37.968729 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd1796e-5b73-4b83-a69f-0daacb447e3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca4071c5f8f4a31b5edb81fa66a43a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:11:37.969311 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd1796e-5b73-4b83-a69f-0daacb447e3c service neutron] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:11:37.969592 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd1796e-5b73-4b83-a69f-0daacb447e3c service neutron] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:11:37.969867 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd1796e-5b73-4b83-a69f-0daacb447e3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:11:37.971629 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-6bd1796e-5b73-4b83-a69f-0daacb447e3c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:11:38.053046 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd1796e-5b73-4b83-a69f-0daacb447e3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:11:38.054510 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd1796e-5b73-4b83-a69f-0daacb447e3c service neutron] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:11:38.073360 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1386/2778] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 03:11:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:11:44.679065 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420d7538-d203-47fb-a448-76bfb67e00d0 service nova] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:11:44.680906 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-420d7538-d203-47fb-a448-76bfb67e00d0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:11:44.700446 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420d7538-d203-47fb-a448-76bfb67e00d0 service nova] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:11:44.705209 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec77dc3-5f37-46d0-80fe-da8733d5b95f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:11:44.706138 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec77dc3-5f37-46d0-80fe-da8733d5b95f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:11:44.706366 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec77dc3-5f37-46d0-80fe-da8733d5b95f admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:11:44.706644 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec77dc3-5f37-46d0-80fe-da8733d5b95f admin admin] PATH_INFO: `/v3/users/1467bd27c3c441f19715f33dd6c3d78a` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:11:44.707874 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec77dc3-5f37-46d0-80fe-da8733d5b95f admin admin] RBAC: Authorizing `identity:delete_user(user_id=1467bd27c3c441f19715f33dd6c3d78a)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:11:44.709820 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec77dc3-5f37-46d0-80fe-da8733d5b95f admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:11:44.760094 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-8ec77dc3-5f37-46d0-80fe-da8733d5b95f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1467bd27c3c441f19715f33dd6c3d78a'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:11:44.760737 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-8ec77dc3-5f37-46d0-80fe-da8733d5b95f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1467bd27c3c441f19715f33dd6c3d78a'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:11:44.767937 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-8ec77dc3-5f37-46d0-80fe-da8733d5b95f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1467bd27c3c441f19715f33dd6c3d78a'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:11:44.768565 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-8ec77dc3-5f37-46d0-80fe-da8733d5b95f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1467bd27c3c441f19715f33dd6c3d78a'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:11:44.775813 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-8ec77dc3-5f37-46d0-80fe-da8733d5b95f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1467bd27c3c441f19715f33dd6c3d78a'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:11:44.792777 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1393/2779] 10.222.0.117 () {58 vars in 1228 bytes} [Tue Jan 25 03:11:44 2022] DELETE /identity/v3/users/1467bd27c3c441f19715f33dd6c3d78a => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:11:44.979312 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd1796e-5b73-4b83-a69f-0daacb447e3c service neutron] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:11:44.990138 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd1796e-5b73-4b83-a69f-0daacb447e3c service neutron] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:11:45.051571 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c7bbb8-cbeb-4d6f-9c67-9131b7c48086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:11:45.052454 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c7bbb8-cbeb-4d6f-9c67-9131b7c48086 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:11:45.052735 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c7bbb8-cbeb-4d6f-9c67-9131b7c48086 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:11:45.053010 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c7bbb8-cbeb-4d6f-9c67-9131b7c48086 admin admin] PATH_INFO: `/v3/projects/d61a4845c27e4b928c5445d95321e2a3` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:11:45.054197 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c7bbb8-cbeb-4d6f-9c67-9131b7c48086 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d61a4845c27e4b928c5445d95321e2a3)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:11:45.056156 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c7bbb8-cbeb-4d6f-9c67-9131b7c48086 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:11:45.101192 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-52c7bbb8-cbeb-4d6f-9c67-9131b7c48086 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd61a4845c27e4b928c5445d95321e2a3', 'request_id': 'req-52c7bbb8-cbeb-4d6f-9c67-9131b7c48086'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:11:45.107154 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-52c7bbb8-cbeb-4d6f-9c67-9131b7c48086 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd61a4845c27e4b928c5445d95321e2a3', 'request_id': 'req-52c7bbb8-cbeb-4d6f-9c67-9131b7c48086'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:11:45.113082 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-52c7bbb8-cbeb-4d6f-9c67-9131b7c48086 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd61a4845c27e4b928c5445d95321e2a3', 'request_id': 'req-52c7bbb8-cbeb-4d6f-9c67-9131b7c48086'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:11:45.125014 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-52c7bbb8-cbeb-4d6f-9c67-9131b7c48086 admin admin] The token cache is being invalidate because project d61a4845c27e4b928c5445d95321e2a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79120) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 25 03:11:45.125301 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-52c7bbb8-cbeb-4d6f-9c67-9131b7c48086 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:11:45.125913 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-52c7bbb8-cbeb-4d6f-9c67-9131b7c48086 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:11:45.127459 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1387/2780] 10.222.0.117 () {58 vars in 1237 bytes} [Tue Jan 25 03:11:44 2022] DELETE /identity/v3/projects/d61a4845c27e4b928c5445d95321e2a3 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:11:45.131503 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec77dc3-5f37-46d0-80fe-da8733d5b95f admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:11:45.132935 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-8ec77dc3-5f37-46d0-80fe-da8733d5b95f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:11:45.145749 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec77dc3-5f37-46d0-80fe-da8733d5b95f admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:11:45.201794 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fec98cf-d130-4f70-9717-411101f2a793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:11:45.202573 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fec98cf-d130-4f70-9717-411101f2a793 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:11:45.202852 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fec98cf-d130-4f70-9717-411101f2a793 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:11:45.203125 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fec98cf-d130-4f70-9717-411101f2a793 admin admin] PATH_INFO: `/v3/users/e8f26ce1d8ee43ed8079fa0c6160d655` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:11:45.216215 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fec98cf-d130-4f70-9717-411101f2a793 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8f26ce1d8ee43ed8079fa0c6160d655)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:11:45.218238 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fec98cf-d130-4f70-9717-411101f2a793 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:11:45.262964 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-1fec98cf-d130-4f70-9717-411101f2a793 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8f26ce1d8ee43ed8079fa0c6160d655'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:11:45.263840 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-1fec98cf-d130-4f70-9717-411101f2a793 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8f26ce1d8ee43ed8079fa0c6160d655'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:11:45.273759 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-1fec98cf-d130-4f70-9717-411101f2a793 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8f26ce1d8ee43ed8079fa0c6160d655'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:11:45.274418 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-1fec98cf-d130-4f70-9717-411101f2a793 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8f26ce1d8ee43ed8079fa0c6160d655'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:11:45.282357 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-1fec98cf-d130-4f70-9717-411101f2a793 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8f26ce1d8ee43ed8079fa0c6160d655'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:11:45.299414 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1394/2781] 10.222.0.117 () {58 vars in 1228 bytes} [Tue Jan 25 03:11:45 2022] DELETE /identity/v3/users/e8f26ce1d8ee43ed8079fa0c6160d655 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:11:45.471616 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c7bbb8-cbeb-4d6f-9c67-9131b7c48086 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:11:45.473159 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-52c7bbb8-cbeb-4d6f-9c67-9131b7c48086 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:11:45.491887 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c7bbb8-cbeb-4d6f-9c67-9131b7c48086 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:11:45.566432 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313e6720-267f-4172-b01b-b4d51340ae3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:11:45.567761 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313e6720-267f-4172-b01b-b4d51340ae3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:11:45.568210 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313e6720-267f-4172-b01b-b4d51340ae3f admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:11:45.568550 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313e6720-267f-4172-b01b-b4d51340ae3f admin admin] PATH_INFO: `/v3/projects/4ca9786b60fe466f86fe6d24c7dcf2aa` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:11:45.583193 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313e6720-267f-4172-b01b-b4d51340ae3f admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ca9786b60fe466f86fe6d24c7dcf2aa)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:11:45.586074 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313e6720-267f-4172-b01b-b4d51340ae3f admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:11:45.644896 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-313e6720-267f-4172-b01b-b4d51340ae3f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ca9786b60fe466f86fe6d24c7dcf2aa', 'request_id': 'req-313e6720-267f-4172-b01b-b4d51340ae3f'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:11:45.650540 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-313e6720-267f-4172-b01b-b4d51340ae3f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ca9786b60fe466f86fe6d24c7dcf2aa', 'request_id': 'req-313e6720-267f-4172-b01b-b4d51340ae3f'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:11:45.658747 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-313e6720-267f-4172-b01b-b4d51340ae3f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ca9786b60fe466f86fe6d24c7dcf2aa', 'request_id': 'req-313e6720-267f-4172-b01b-b4d51340ae3f'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:11:45.670608 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-313e6720-267f-4172-b01b-b4d51340ae3f admin admin] The token cache is being invalidate because project 4ca9786b60fe466f86fe6d24c7dcf2aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79120) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 25 03:11:45.670893 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-313e6720-267f-4172-b01b-b4d51340ae3f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:11:45.671489 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-313e6720-267f-4172-b01b-b4d51340ae3f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:11:45.673064 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1388/2782] 10.222.0.117 () {58 vars in 1237 bytes} [Tue Jan 25 03:11:45 2022] DELETE /identity/v3/projects/4ca9786b60fe466f86fe6d24c7dcf2aa => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:13:37.592420 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fec98cf-d130-4f70-9717-411101f2a793 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:13:37.594267 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-1fec98cf-d130-4f70-9717-411101f2a793 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:13:37.676444 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fec98cf-d130-4f70-9717-411101f2a793 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:13:37.726548 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeefda8-0ff7-4d90-a704-9ce642bdecd2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cc5249aea09430080e232cf17757f86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:13:37.727244 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeefda8-0ff7-4d90-a704-9ce642bdecd2 service cinder] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:13:37.727942 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeefda8-0ff7-4d90-a704-9ce642bdecd2 service cinder] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:13:37.728387 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeefda8-0ff7-4d90-a704-9ce642bdecd2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:13:37.730014 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-ddeefda8-0ff7-4d90-a704-9ce642bdecd2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:13:37.813808 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddeefda8-0ff7-4d90-a704-9ce642bdecd2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:13:37.815937 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddeefda8-0ff7-4d90-a704-9ce642bdecd2 service cinder] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:13:37.835241 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1395/2783] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 03:13:37 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:14:00.494422 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313e6720-267f-4172-b01b-b4d51340ae3f admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:14:00.495894 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-313e6720-267f-4172-b01b-b4d51340ae3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:14:00.563133 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313e6720-267f-4172-b01b-b4d51340ae3f admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:14:00.568308 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b38c02e-dfe7-446c-b01a-b6ada0382618 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '890151a6bf2840f0a0a00f45dd2d38a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:14:00.568948 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b38c02e-dfe7-446c-b01a-b6ada0382618 service placement] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:14:00.569234 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b38c02e-dfe7-446c-b01a-b6ada0382618 service placement] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:14:00.569517 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b38c02e-dfe7-446c-b01a-b6ada0382618 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:14:00.571273 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-8b38c02e-dfe7-446c-b01a-b6ada0382618 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:14:00.582477 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b38c02e-dfe7-446c-b01a-b6ada0382618 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:14:00.584092 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b38c02e-dfe7-446c-b01a-b6ada0382618 service placement] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:14:00.593974 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1389/2784] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 03:14:00 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:15:38.177181 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeefda8-0ff7-4d90-a704-9ce642bdecd2 service cinder] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:15:38.178561 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-ddeefda8-0ff7-4d90-a704-9ce642bdecd2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:15:38.190087 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeefda8-0ff7-4d90-a704-9ce642bdecd2 service cinder] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:15:38.193873 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3272524e-8c3c-40c8-8122-4c01d9e62488 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cc5249aea09430080e232cf17757f86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:15:38.194527 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3272524e-8c3c-40c8-8122-4c01d9e62488 service cinder] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:15:38.194814 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3272524e-8c3c-40c8-8122-4c01d9e62488 service cinder] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:15:38.195091 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3272524e-8c3c-40c8-8122-4c01d9e62488 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:15:38.196850 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-3272524e-8c3c-40c8-8122-4c01d9e62488 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:15:38.259498 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3272524e-8c3c-40c8-8122-4c01d9e62488 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:15:38.262013 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3272524e-8c3c-40c8-8122-4c01d9e62488 service cinder] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:15:38.271421 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1396/2785] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 03:15:38 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:18:24.186237 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b38c02e-dfe7-446c-b01a-b6ada0382618 service placement] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:24.187676 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-8b38c02e-dfe7-446c-b01a-b6ada0382618 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:18:24.263131 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b38c02e-dfe7-446c-b01a-b6ada0382618 service placement] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:24.266687 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888966f2-007a-4a0c-9f06-6b2fc2758500 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca4071c5f8f4a31b5edb81fa66a43a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:24.267332 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888966f2-007a-4a0c-9f06-6b2fc2758500 service neutron] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:24.267611 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888966f2-007a-4a0c-9f06-6b2fc2758500 service neutron] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:24.267918 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888966f2-007a-4a0c-9f06-6b2fc2758500 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:24.269866 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-888966f2-007a-4a0c-9f06-6b2fc2758500 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:18:24.329190 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888966f2-007a-4a0c-9f06-6b2fc2758500 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:24.330611 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888966f2-007a-4a0c-9f06-6b2fc2758500 service neutron] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:24.339880 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1390/2786] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 03:18:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:18:24.834969 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3272524e-8c3c-40c8-8122-4c01d9e62488 service cinder] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:24.836433 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-3272524e-8c3c-40c8-8122-4c01d9e62488 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:18:24.850280 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3272524e-8c3c-40c8-8122-4c01d9e62488 service cinder] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:24.854767 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d118cc3-4bc2-4881-8593-5c5f1a124e44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:24.855625 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d118cc3-4bc2-4881-8593-5c5f1a124e44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:24.856683 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d118cc3-4bc2-4881-8593-5c5f1a124e44 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:24.856993 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d118cc3-4bc2-4881-8593-5c5f1a124e44 admin admin] PATH_INFO: `/v3/users/3b31b3b347d549308acb2e2b5332a74c` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:24.858312 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d118cc3-4bc2-4881-8593-5c5f1a124e44 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b31b3b347d549308acb2e2b5332a74c)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:24.860274 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d118cc3-4bc2-4881-8593-5c5f1a124e44 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:24.906270 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-6d118cc3-4bc2-4881-8593-5c5f1a124e44 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b31b3b347d549308acb2e2b5332a74c'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:18:24.906841 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-6d118cc3-4bc2-4881-8593-5c5f1a124e44 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b31b3b347d549308acb2e2b5332a74c'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:18:24.914210 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-6d118cc3-4bc2-4881-8593-5c5f1a124e44 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b31b3b347d549308acb2e2b5332a74c'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:18:24.914842 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-6d118cc3-4bc2-4881-8593-5c5f1a124e44 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b31b3b347d549308acb2e2b5332a74c'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:18:24.923714 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-6d118cc3-4bc2-4881-8593-5c5f1a124e44 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b31b3b347d549308acb2e2b5332a74c'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:18:24.940512 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1397/2787] 10.222.0.117 () {58 vars in 1228 bytes} [Tue Jan 25 03:18:24 2022] DELETE /identity/v3/users/3b31b3b347d549308acb2e2b5332a74c => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:18:25.114799 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888966f2-007a-4a0c-9f06-6b2fc2758500 service neutron] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:25.124871 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888966f2-007a-4a0c-9f06-6b2fc2758500 service neutron] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:25.180322 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075ef869-cd98-4d7d-801b-c4c039b779dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:25.181092 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075ef869-cd98-4d7d-801b-c4c039b779dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:25.181378 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075ef869-cd98-4d7d-801b-c4c039b779dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:25.181653 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075ef869-cd98-4d7d-801b-c4c039b779dc admin admin] PATH_INFO: `/v3/projects/48ce4d90d9f948748057584c88319497` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:25.182836 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075ef869-cd98-4d7d-801b-c4c039b779dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=48ce4d90d9f948748057584c88319497)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:25.184779 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075ef869-cd98-4d7d-801b-c4c039b779dc admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:25.229824 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-075ef869-cd98-4d7d-801b-c4c039b779dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48ce4d90d9f948748057584c88319497', 'request_id': 'req-075ef869-cd98-4d7d-801b-c4c039b779dc'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:18:25.235085 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-075ef869-cd98-4d7d-801b-c4c039b779dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48ce4d90d9f948748057584c88319497', 'request_id': 'req-075ef869-cd98-4d7d-801b-c4c039b779dc'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:18:25.242159 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-075ef869-cd98-4d7d-801b-c4c039b779dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48ce4d90d9f948748057584c88319497', 'request_id': 'req-075ef869-cd98-4d7d-801b-c4c039b779dc'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:18:25.253742 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-075ef869-cd98-4d7d-801b-c4c039b779dc admin admin] The token cache is being invalidate because project 48ce4d90d9f948748057584c88319497 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79120) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 25 03:18:25.254597 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-075ef869-cd98-4d7d-801b-c4c039b779dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:18:25.255359 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-075ef869-cd98-4d7d-801b-c4c039b779dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:18:25.256921 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1391/2788] 10.222.0.117 () {58 vars in 1237 bytes} [Tue Jan 25 03:18:25 2022] DELETE /identity/v3/projects/48ce4d90d9f948748057584c88319497 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:18:25.263413 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d9d039-8d9f-4595-b13d-8489ac726e83 None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:25.263747 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d9d039-8d9f-4595-b13d-8489ac726e83 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:25.264045 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d9d039-8d9f-4595-b13d-8489ac726e83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:25.319052 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-68d9d039-8d9f-4595-b13d-8489ac726e83 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:18:25.320277 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-68d9d039-8d9f-4595-b13d-8489ac726e83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:18:25.383325 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1398/2789] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 03:18:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:18:25.391854 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de59182-e8da-4a0b-bdba-d69bfa3ad876 None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:25.392146 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de59182-e8da-4a0b-bdba-d69bfa3ad876 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:25.392423 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de59182-e8da-4a0b-bdba-d69bfa3ad876 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:25.411334 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-5de59182-e8da-4a0b-bdba-d69bfa3ad876 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:18:25.412571 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-5de59182-e8da-4a0b-bdba-d69bfa3ad876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:18:25.420697 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1392/2790] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 03:18:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:18:25.424830 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d9d039-8d9f-4595-b13d-8489ac726e83 None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:25.434542 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d9d039-8d9f-4595-b13d-8489ac726e83 None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:25.439064 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63b1918-9967-41b4-90f1-143d2ab74247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:25.439735 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63b1918-9967-41b4-90f1-143d2ab74247 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:25.440026 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63b1918-9967-41b4-90f1-143d2ab74247 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:25.440303 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63b1918-9967-41b4-90f1-143d2ab74247 admin admin] PATH_INFO: `/v3/domains` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:25.441042 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63b1918-9967-41b4-90f1-143d2ab74247 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:18:25.441349 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63b1918-9967-41b4-90f1-143d2ab74247 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:25.443761 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63b1918-9967-41b4-90f1-143d2ab74247 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:25.455214 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1399/2791] 10.222.0.117 () {58 vars in 1157 bytes} [Tue Jan 25 03:18:25 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:18:25.460263 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de59182-e8da-4a0b-bdba-d69bfa3ad876 None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:25.469331 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de59182-e8da-4a0b-bdba-d69bfa3ad876 None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:25.474060 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bea2f39-d7d9-42df-aae4-48c887cd045e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:25.474702 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bea2f39-d7d9-42df-aae4-48c887cd045e admin admin] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:25.474987 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bea2f39-d7d9-42df-aae4-48c887cd045e admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:25.475264 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bea2f39-d7d9-42df-aae4-48c887cd045e admin admin] PATH_INFO: `/v3/projects` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:25.476021 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bea2f39-d7d9-42df-aae4-48c887cd045e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:25.477918 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bea2f39-d7d9-42df-aae4-48c887cd045e admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:25.512108 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1393/2792] 10.222.0.117 () {60 vars in 1157 bytes} [Tue Jan 25 03:18:25 2022] POST /identity/v3/projects => generated 392 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 03:18:25.516171 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63b1918-9967-41b4-90f1-143d2ab74247 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:25.526537 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63b1918-9967-41b4-90f1-143d2ab74247 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:25.586859 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943703d9-253a-44cd-9c4b-7e55024d0df7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:25.587537 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943703d9-253a-44cd-9c4b-7e55024d0df7 admin admin] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:25.587849 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943703d9-253a-44cd-9c4b-7e55024d0df7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:25.588126 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943703d9-253a-44cd-9c4b-7e55024d0df7 admin admin] PATH_INFO: `/v3/users` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:25.588841 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943703d9-253a-44cd-9c4b-7e55024d0df7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:25.590782 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943703d9-253a-44cd-9c4b-7e55024d0df7 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:25.610062 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1400/2793] 10.222.0.117 () {60 vars in 1148 bytes} [Tue Jan 25 03:18:25 2022] POST /identity/v3/users => generated 297 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 25 03:18:25.614640 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bea2f39-d7d9-42df-aae4-48c887cd045e admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:25.625109 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bea2f39-d7d9-42df-aae4-48c887cd045e admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:25.630677 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba76cb52-075a-4a79-9278-2d4cbd0b5627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:25.631324 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba76cb52-075a-4a79-9278-2d4cbd0b5627 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:25.631605 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba76cb52-075a-4a79-9278-2d4cbd0b5627 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:25.631920 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba76cb52-075a-4a79-9278-2d4cbd0b5627 admin admin] PATH_INFO: `/v3/roles` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:25.632656 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba76cb52-075a-4a79-9278-2d4cbd0b5627 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:25.634242 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba76cb52-075a-4a79-9278-2d4cbd0b5627 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:25.643939 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1394/2794] 10.222.0.117 () {58 vars in 1126 bytes} [Tue Jan 25 03:18:25 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 03:18:25.647912 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943703d9-253a-44cd-9c4b-7e55024d0df7 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:25.657708 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943703d9-253a-44cd-9c4b-7e55024d0df7 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:25.662512 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b932870e-5ea1-40b2-a8b1-638eecdb3f44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:25.663166 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b932870e-5ea1-40b2-a8b1-638eecdb3f44 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:25.663453 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b932870e-5ea1-40b2-a8b1-638eecdb3f44 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:25.663766 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b932870e-5ea1-40b2-a8b1-638eecdb3f44 admin admin] PATH_INFO: `/v3/roles` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:25.664512 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b932870e-5ea1-40b2-a8b1-638eecdb3f44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:25.666391 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b932870e-5ea1-40b2-a8b1-638eecdb3f44 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:25.676669 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1401/2795] 10.222.0.117 () {58 vars in 1126 bytes} [Tue Jan 25 03:18:25 2022] GET /identity/v3/roles => generated 1427 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 03:18:25.680744 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba76cb52-075a-4a79-9278-2d4cbd0b5627 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:25.690635 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba76cb52-075a-4a79-9278-2d4cbd0b5627 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:25.696068 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805a7027-6103-4a67-bb1a-2c7460fb57fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:25.696924 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805a7027-6103-4a67-bb1a-2c7460fb57fe admin admin] REQUEST_METHOD: `PUT` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:25.697203 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805a7027-6103-4a67-bb1a-2c7460fb57fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:25.697473 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805a7027-6103-4a67-bb1a-2c7460fb57fe admin admin] PATH_INFO: `/v3/projects/72bfe8a143bc4832a9f4b862126e2364/users/a73d74acb7b4471f8a28b056ec2de737/roles/33a8e87420ed423f9cb29e0084eab5d2` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:25.712740 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805a7027-6103-4a67-bb1a-2c7460fb57fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=72bfe8a143bc4832a9f4b862126e2364, user_id=a73d74acb7b4471f8a28b056ec2de737, role_id=33a8e87420ed423f9cb29e0084eab5d2)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:25.715567 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805a7027-6103-4a67-bb1a-2c7460fb57fe admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:25.728705 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1395/2796] 10.222.0.117 () {60 vars in 1487 bytes} [Tue Jan 25 03:18:25 2022] PUT /identity/v3/projects/72bfe8a143bc4832a9f4b862126e2364/users/a73d74acb7b4471f8a28b056ec2de737/roles/33a8e87420ed423f9cb29e0084eab5d2 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:18:25.740548 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2c807d-749a-4693-bbc8-7621d45d9481 None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:25.740853 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2c807d-749a-4693-bbc8-7621d45d9481 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:25.741129 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2c807d-749a-4693-bbc8-7621d45d9481 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:25.768106 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-bf2c807d-749a-4693-bbc8-7621d45d9481 None None] MFA Rules not processed for user `a73d74acb7b4471f8a28b056ec2de737`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:18:25.769303 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-bf2c807d-749a-4693-bbc8-7621d45d9481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:18:25.832921 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1402/2797] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 03:18:25 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:18:25.842382 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805a7027-6103-4a67-bb1a-2c7460fb57fe admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:25.844132 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-805a7027-6103-4a67-bb1a-2c7460fb57fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:18:25.899201 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805a7027-6103-4a67-bb1a-2c7460fb57fe admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:25.902873 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecf3e16-e11d-40b1-9b5b-de60e4c7b45a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cc5249aea09430080e232cf17757f86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:25.903506 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecf3e16-e11d-40b1-9b5b-de60e4c7b45a service cinder] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:25.903829 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecf3e16-e11d-40b1-9b5b-de60e4c7b45a service cinder] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:25.904109 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecf3e16-e11d-40b1-9b5b-de60e4c7b45a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:25.921128 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecf3e16-e11d-40b1-9b5b-de60e4c7b45a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:25.922678 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecf3e16-e11d-40b1-9b5b-de60e4c7b45a service cinder] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:25.931738 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1396/2798] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 03:18:25 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:18:48.062097 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2c807d-749a-4693-bbc8-7621d45d9481 None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:48.123950 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2c807d-749a-4693-bbc8-7621d45d9481 None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:48.128470 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d1b55f-2c6a-4c51-ac44-c6e043677323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:48.129331 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d1b55f-2c6a-4c51-ac44-c6e043677323 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:48.129613 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d1b55f-2c6a-4c51-ac44-c6e043677323 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:48.129885 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d1b55f-2c6a-4c51-ac44-c6e043677323 admin admin] PATH_INFO: `/v3/users/a73d74acb7b4471f8a28b056ec2de737` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:48.131077 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d1b55f-2c6a-4c51-ac44-c6e043677323 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a73d74acb7b4471f8a28b056ec2de737)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:48.133046 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d1b55f-2c6a-4c51-ac44-c6e043677323 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:48.178083 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-68d1b55f-2c6a-4c51-ac44-c6e043677323 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a73d74acb7b4471f8a28b056ec2de737'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:18:48.179314 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-68d1b55f-2c6a-4c51-ac44-c6e043677323 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a73d74acb7b4471f8a28b056ec2de737'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:18:48.186139 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-68d1b55f-2c6a-4c51-ac44-c6e043677323 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a73d74acb7b4471f8a28b056ec2de737'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:18:48.186775 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-68d1b55f-2c6a-4c51-ac44-c6e043677323 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a73d74acb7b4471f8a28b056ec2de737'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:18:48.194420 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-68d1b55f-2c6a-4c51-ac44-c6e043677323 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a73d74acb7b4471f8a28b056ec2de737'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:18:48.211797 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1403/2799] 10.222.0.117 () {58 vars in 1228 bytes} [Tue Jan 25 03:18:48 2022] DELETE /identity/v3/users/a73d74acb7b4471f8a28b056ec2de737 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:18:48.216441 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da18818a-32a2-44e3-9507-a55b664c6cb6 None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:48.216956 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da18818a-32a2-44e3-9507-a55b664c6cb6 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:48.217097 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da18818a-32a2-44e3-9507-a55b664c6cb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:48.234703 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-da18818a-32a2-44e3-9507-a55b664c6cb6 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:18:48.235860 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-da18818a-32a2-44e3-9507-a55b664c6cb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:18:48.293598 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1397/2800] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 03:18:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 25 03:18:48.303187 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d1b55f-2c6a-4c51-ac44-c6e043677323 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:48.305406 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-68d1b55f-2c6a-4c51-ac44-c6e043677323 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:18:48.361278 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d1b55f-2c6a-4c51-ac44-c6e043677323 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:48.364951 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6170dc31-47e1-4279-8bca-1ee50570e4e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca4071c5f8f4a31b5edb81fa66a43a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:48.365585 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6170dc31-47e1-4279-8bca-1ee50570e4e8 service neutron] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:48.366740 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6170dc31-47e1-4279-8bca-1ee50570e4e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:48.367061 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6170dc31-47e1-4279-8bca-1ee50570e4e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:48.376189 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6170dc31-47e1-4279-8bca-1ee50570e4e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:48.377644 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6170dc31-47e1-4279-8bca-1ee50570e4e8 service neutron] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:48.386987 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1404/2801] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 03:18:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:18:48.652420 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da18818a-32a2-44e3-9507-a55b664c6cb6 None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:48.653942 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-da18818a-32a2-44e3-9507-a55b664c6cb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:18:48.667582 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da18818a-32a2-44e3-9507-a55b664c6cb6 None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:48.672179 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d57b73c-dd1d-4523-a5c4-e3c80afb7be3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:48.673013 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d57b73c-dd1d-4523-a5c4-e3c80afb7be3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:48.673294 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d57b73c-dd1d-4523-a5c4-e3c80afb7be3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:48.673570 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d57b73c-dd1d-4523-a5c4-e3c80afb7be3 admin admin] PATH_INFO: `/v3/projects/72bfe8a143bc4832a9f4b862126e2364` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:48.674759 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d57b73c-dd1d-4523-a5c4-e3c80afb7be3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=72bfe8a143bc4832a9f4b862126e2364)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:48.676735 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d57b73c-dd1d-4523-a5c4-e3c80afb7be3 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:48.722027 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-1d57b73c-dd1d-4523-a5c4-e3c80afb7be3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72bfe8a143bc4832a9f4b862126e2364', 'request_id': 'req-1d57b73c-dd1d-4523-a5c4-e3c80afb7be3'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:18:48.728024 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-1d57b73c-dd1d-4523-a5c4-e3c80afb7be3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72bfe8a143bc4832a9f4b862126e2364', 'request_id': 'req-1d57b73c-dd1d-4523-a5c4-e3c80afb7be3'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:18:48.733994 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-1d57b73c-dd1d-4523-a5c4-e3c80afb7be3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72bfe8a143bc4832a9f4b862126e2364', 'request_id': 'req-1d57b73c-dd1d-4523-a5c4-e3c80afb7be3'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:18:48.745821 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-1d57b73c-dd1d-4523-a5c4-e3c80afb7be3 admin admin] The token cache is being invalidate because project 72bfe8a143bc4832a9f4b862126e2364 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79120) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 25 03:18:48.746110 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-1d57b73c-dd1d-4523-a5c4-e3c80afb7be3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:18:48.746748 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-1d57b73c-dd1d-4523-a5c4-e3c80afb7be3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:18:48.748330 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1398/2802] 10.222.0.117 () {58 vars in 1237 bytes} [Tue Jan 25 03:18:48 2022] DELETE /identity/v3/projects/72bfe8a143bc4832a9f4b862126e2364 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:18:48.753956 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c58e40-46d8-4bf1-9b74-2f89543a3f29 None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:48.754252 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c58e40-46d8-4bf1-9b74-2f89543a3f29 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:48.754562 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c58e40-46d8-4bf1-9b74-2f89543a3f29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:48.773337 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-b7c58e40-46d8-4bf1-9b74-2f89543a3f29 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:18:48.774455 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-b7c58e40-46d8-4bf1-9b74-2f89543a3f29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:18:48.832275 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1405/2803] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 03:18:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:18:48.841172 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502bc72e-7241-47c4-82cd-777c8bd0ddda None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:48.841462 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502bc72e-7241-47c4-82cd-777c8bd0ddda None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:48.841738 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502bc72e-7241-47c4-82cd-777c8bd0ddda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:48.861581 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-502bc72e-7241-47c4-82cd-777c8bd0ddda None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:18:48.862791 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-502bc72e-7241-47c4-82cd-777c8bd0ddda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:18:48.870996 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1399/2804] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 03:18:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:18:48.875253 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c58e40-46d8-4bf1-9b74-2f89543a3f29 None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:48.885645 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c58e40-46d8-4bf1-9b74-2f89543a3f29 None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:48.890300 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65953bf9-5d7c-4a1b-958f-dc112cbf5412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:48.890954 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65953bf9-5d7c-4a1b-958f-dc112cbf5412 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:48.891243 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65953bf9-5d7c-4a1b-958f-dc112cbf5412 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:48.891522 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65953bf9-5d7c-4a1b-958f-dc112cbf5412 admin admin] PATH_INFO: `/v3/domains` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:48.892297 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65953bf9-5d7c-4a1b-958f-dc112cbf5412 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:18:48.892608 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65953bf9-5d7c-4a1b-958f-dc112cbf5412 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:48.894231 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65953bf9-5d7c-4a1b-958f-dc112cbf5412 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:48.906686 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1406/2805] 10.222.0.117 () {58 vars in 1157 bytes} [Tue Jan 25 03:18:48 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:18:48.911384 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502bc72e-7241-47c4-82cd-777c8bd0ddda None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:48.920871 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502bc72e-7241-47c4-82cd-777c8bd0ddda None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:48.925735 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06905ab1-6bfe-4d42-a897-178b7ee1cdf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:48.926388 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06905ab1-6bfe-4d42-a897-178b7ee1cdf5 admin admin] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:48.926671 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06905ab1-6bfe-4d42-a897-178b7ee1cdf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:48.926975 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06905ab1-6bfe-4d42-a897-178b7ee1cdf5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:48.927676 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06905ab1-6bfe-4d42-a897-178b7ee1cdf5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:48.929608 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06905ab1-6bfe-4d42-a897-178b7ee1cdf5 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:48.954669 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1400/2806] 10.222.0.117 () {60 vars in 1157 bytes} [Tue Jan 25 03:18:48 2022] POST /identity/v3/projects => generated 398 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 03:18:48.958819 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65953bf9-5d7c-4a1b-958f-dc112cbf5412 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:48.969239 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65953bf9-5d7c-4a1b-958f-dc112cbf5412 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:49.025318 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fbead9-556b-46a2-bcdf-c3349203f640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:49.025957 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fbead9-556b-46a2-bcdf-c3349203f640 admin admin] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:49.026245 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fbead9-556b-46a2-bcdf-c3349203f640 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:49.026527 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fbead9-556b-46a2-bcdf-c3349203f640 admin admin] PATH_INFO: `/v3/users` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:49.027232 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fbead9-556b-46a2-bcdf-c3349203f640 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:49.029467 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fbead9-556b-46a2-bcdf-c3349203f640 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:49.053048 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1407/2807] 10.222.0.117 () {60 vars in 1148 bytes} [Tue Jan 25 03:18:48 2022] POST /identity/v3/users => generated 300 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 03:18:49.061217 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06905ab1-6bfe-4d42-a897-178b7ee1cdf5 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:49.064996 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06905ab1-6bfe-4d42-a897-178b7ee1cdf5 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:49.070383 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4720362a-bd85-42f0-a5e7-d99ddd3eec02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:49.071082 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4720362a-bd85-42f0-a5e7-d99ddd3eec02 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:49.071319 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4720362a-bd85-42f0-a5e7-d99ddd3eec02 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:49.071662 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4720362a-bd85-42f0-a5e7-d99ddd3eec02 admin admin] PATH_INFO: `/v3/roles` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:49.072423 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4720362a-bd85-42f0-a5e7-d99ddd3eec02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:49.074019 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4720362a-bd85-42f0-a5e7-d99ddd3eec02 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:49.084239 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1401/2808] 10.222.0.117 () {58 vars in 1126 bytes} [Tue Jan 25 03:18:49 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 03:18:49.088878 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fbead9-556b-46a2-bcdf-c3349203f640 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:49.098836 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fbead9-556b-46a2-bcdf-c3349203f640 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:49.103626 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fcbd62-2a39-4a0a-872b-e3f1d653a8c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:49.104311 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fcbd62-2a39-4a0a-872b-e3f1d653a8c1 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:49.104597 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fcbd62-2a39-4a0a-872b-e3f1d653a8c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:49.104877 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fcbd62-2a39-4a0a-872b-e3f1d653a8c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:49.105615 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fcbd62-2a39-4a0a-872b-e3f1d653a8c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:49.107210 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fcbd62-2a39-4a0a-872b-e3f1d653a8c1 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:49.117181 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1408/2809] 10.222.0.117 () {58 vars in 1126 bytes} [Tue Jan 25 03:18:49 2022] GET /identity/v3/roles => generated 1427 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 03:18:49.121875 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4720362a-bd85-42f0-a5e7-d99ddd3eec02 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:49.132065 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4720362a-bd85-42f0-a5e7-d99ddd3eec02 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:49.136802 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7950558b-9000-47dd-8b4d-68e3594bd9be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:49.137693 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7950558b-9000-47dd-8b4d-68e3594bd9be admin admin] REQUEST_METHOD: `PUT` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:49.137973 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7950558b-9000-47dd-8b4d-68e3594bd9be admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:49.138247 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7950558b-9000-47dd-8b4d-68e3594bd9be admin admin] PATH_INFO: `/v3/projects/d85e548406cf42118536890811037ce9/users/a948f25325424b4c9d38e31ae25d2733/roles/33a8e87420ed423f9cb29e0084eab5d2` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:49.153115 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7950558b-9000-47dd-8b4d-68e3594bd9be admin admin] RBAC: Authorizing `identity:create_grant(project_id=d85e548406cf42118536890811037ce9, user_id=a948f25325424b4c9d38e31ae25d2733, role_id=33a8e87420ed423f9cb29e0084eab5d2)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:49.155773 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7950558b-9000-47dd-8b4d-68e3594bd9be admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:49.168905 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1402/2810] 10.222.0.117 () {60 vars in 1487 bytes} [Tue Jan 25 03:18:49 2022] PUT /identity/v3/projects/d85e548406cf42118536890811037ce9/users/a948f25325424b4c9d38e31ae25d2733/roles/33a8e87420ed423f9cb29e0084eab5d2 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:18:49.179681 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dac6dbd-bfff-4530-8d42-27a2a059d87b None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:49.180003 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dac6dbd-bfff-4530-8d42-27a2a059d87b None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:49.180279 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dac6dbd-bfff-4530-8d42-27a2a059d87b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:49.207991 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-1dac6dbd-bfff-4530-8d42-27a2a059d87b None None] MFA Rules not processed for user `a948f25325424b4c9d38e31ae25d2733`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:18:49.209221 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-1dac6dbd-bfff-4530-8d42-27a2a059d87b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:18:49.271136 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1409/2811] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 03:18:49 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:18:49.281567 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7950558b-9000-47dd-8b4d-68e3594bd9be admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:49.283257 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-7950558b-9000-47dd-8b4d-68e3594bd9be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:18:49.338896 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7950558b-9000-47dd-8b4d-68e3594bd9be admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:49.342580 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc2c35c-d8d9-4e5d-90f4-2a4754ceed46 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cc5249aea09430080e232cf17757f86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:49.343220 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc2c35c-d8d9-4e5d-90f4-2a4754ceed46 service cinder] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:49.343503 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc2c35c-d8d9-4e5d-90f4-2a4754ceed46 service cinder] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:49.343811 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc2c35c-d8d9-4e5d-90f4-2a4754ceed46 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:49.352092 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc2c35c-d8d9-4e5d-90f4-2a4754ceed46 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:49.353530 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc2c35c-d8d9-4e5d-90f4-2a4754ceed46 service cinder] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:49.362078 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1403/2812] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 03:18:49 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:18:58.365478 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dac6dbd-bfff-4530-8d42-27a2a059d87b None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:58.444991 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dac6dbd-bfff-4530-8d42-27a2a059d87b None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:58.449468 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52632b8-3f29-4652-94ed-d3de30a5ac11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:58.450380 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52632b8-3f29-4652-94ed-d3de30a5ac11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:58.450686 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52632b8-3f29-4652-94ed-d3de30a5ac11 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:58.450957 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52632b8-3f29-4652-94ed-d3de30a5ac11 admin admin] PATH_INFO: `/v3/users/a948f25325424b4c9d38e31ae25d2733` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:58.452187 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52632b8-3f29-4652-94ed-d3de30a5ac11 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a948f25325424b4c9d38e31ae25d2733)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:58.454183 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52632b8-3f29-4652-94ed-d3de30a5ac11 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:58.499057 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-f52632b8-3f29-4652-94ed-d3de30a5ac11 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a948f25325424b4c9d38e31ae25d2733'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:18:58.499732 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-f52632b8-3f29-4652-94ed-d3de30a5ac11 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a948f25325424b4c9d38e31ae25d2733'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:18:58.507089 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-f52632b8-3f29-4652-94ed-d3de30a5ac11 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a948f25325424b4c9d38e31ae25d2733'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:18:58.507791 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-f52632b8-3f29-4652-94ed-d3de30a5ac11 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a948f25325424b4c9d38e31ae25d2733'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:18:58.515071 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-f52632b8-3f29-4652-94ed-d3de30a5ac11 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a948f25325424b4c9d38e31ae25d2733'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:18:58.532192 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1410/2813] 10.222.0.117 () {58 vars in 1228 bytes} [Tue Jan 25 03:18:58 2022] DELETE /identity/v3/users/a948f25325424b4c9d38e31ae25d2733 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:18:58.536606 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a15ac4-07db-476e-be87-c213f093e224 None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:58.537127 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a15ac4-07db-476e-be87-c213f093e224 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:58.537309 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a15ac4-07db-476e-be87-c213f093e224 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:58.564722 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-13a15ac4-07db-476e-be87-c213f093e224 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:18:58.565947 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-13a15ac4-07db-476e-be87-c213f093e224 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:18:58.627407 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1404/2814] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 03:18:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:18:58.638008 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52632b8-3f29-4652-94ed-d3de30a5ac11 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:58.639453 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-f52632b8-3f29-4652-94ed-d3de30a5ac11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:18:58.704381 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52632b8-3f29-4652-94ed-d3de30a5ac11 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:58.708015 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cf3eb7-0308-4174-a90e-2bff763a95f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca4071c5f8f4a31b5edb81fa66a43a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:58.708657 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cf3eb7-0308-4174-a90e-2bff763a95f0 service neutron] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:58.708942 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cf3eb7-0308-4174-a90e-2bff763a95f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:58.709324 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cf3eb7-0308-4174-a90e-2bff763a95f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:58.718246 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cf3eb7-0308-4174-a90e-2bff763a95f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:58.719683 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cf3eb7-0308-4174-a90e-2bff763a95f0 service neutron] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:58.729035 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1411/2815] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 03:18:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:18:58.994609 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a15ac4-07db-476e-be87-c213f093e224 None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:58.996208 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-13a15ac4-07db-476e-be87-c213f093e224 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:18:59.009247 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a15ac4-07db-476e-be87-c213f093e224 None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:59.013829 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186a9857-bf3a-43e3-b289-6569e578acbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:59.014684 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186a9857-bf3a-43e3-b289-6569e578acbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:59.015100 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186a9857-bf3a-43e3-b289-6569e578acbb admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:59.015376 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186a9857-bf3a-43e3-b289-6569e578acbb admin admin] PATH_INFO: `/v3/projects/d85e548406cf42118536890811037ce9` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:59.016596 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186a9857-bf3a-43e3-b289-6569e578acbb admin admin] RBAC: Authorizing `identity:delete_project(project_id=d85e548406cf42118536890811037ce9)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:59.018725 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186a9857-bf3a-43e3-b289-6569e578acbb admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:59.067095 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-186a9857-bf3a-43e3-b289-6569e578acbb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd85e548406cf42118536890811037ce9', 'request_id': 'req-186a9857-bf3a-43e3-b289-6569e578acbb'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:18:59.072451 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-186a9857-bf3a-43e3-b289-6569e578acbb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd85e548406cf42118536890811037ce9', 'request_id': 'req-186a9857-bf3a-43e3-b289-6569e578acbb'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:18:59.078443 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-186a9857-bf3a-43e3-b289-6569e578acbb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd85e548406cf42118536890811037ce9', 'request_id': 'req-186a9857-bf3a-43e3-b289-6569e578acbb'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:18:59.090619 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-186a9857-bf3a-43e3-b289-6569e578acbb admin admin] The token cache is being invalidate because project d85e548406cf42118536890811037ce9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79120) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 25 03:18:59.090907 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-186a9857-bf3a-43e3-b289-6569e578acbb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:18:59.091530 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-186a9857-bf3a-43e3-b289-6569e578acbb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:18:59.093138 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1405/2816] 10.222.0.117 () {58 vars in 1237 bytes} [Tue Jan 25 03:18:58 2022] DELETE /identity/v3/projects/d85e548406cf42118536890811037ce9 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:18:59.099327 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6566fb6-ad0b-4bde-95c0-33b5401ab4d3 None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:59.099622 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6566fb6-ad0b-4bde-95c0-33b5401ab4d3 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:59.100610 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6566fb6-ad0b-4bde-95c0-33b5401ab4d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:59.118934 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-f6566fb6-ad0b-4bde-95c0-33b5401ab4d3 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:18:59.120171 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-f6566fb6-ad0b-4bde-95c0-33b5401ab4d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:18:59.176580 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1412/2817] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 03:18:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:18:59.184722 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad1c486-218f-488f-b65c-347812709e66 None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:59.185015 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad1c486-218f-488f-b65c-347812709e66 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:59.185293 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad1c486-218f-488f-b65c-347812709e66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:59.203481 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-0ad1c486-218f-488f-b65c-347812709e66 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:18:59.204829 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-0ad1c486-218f-488f-b65c-347812709e66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:18:59.213000 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1406/2818] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 03:18:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:18:59.217336 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6566fb6-ad0b-4bde-95c0-33b5401ab4d3 None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:59.228496 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6566fb6-ad0b-4bde-95c0-33b5401ab4d3 None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:59.233126 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7021ee-0461-4073-80a1-917d298d70e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:59.233776 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7021ee-0461-4073-80a1-917d298d70e7 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:59.234061 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7021ee-0461-4073-80a1-917d298d70e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:59.234337 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7021ee-0461-4073-80a1-917d298d70e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:59.235083 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7021ee-0461-4073-80a1-917d298d70e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:18:59.235390 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7021ee-0461-4073-80a1-917d298d70e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:59.237096 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7021ee-0461-4073-80a1-917d298d70e7 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:59.248856 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1413/2819] 10.222.0.117 () {58 vars in 1157 bytes} [Tue Jan 25 03:18:59 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:18:59.253079 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad1c486-218f-488f-b65c-347812709e66 None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:59.262461 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad1c486-218f-488f-b65c-347812709e66 None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:59.267064 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b431e7-572b-46e5-970c-3ddf298d4652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:59.267725 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b431e7-572b-46e5-970c-3ddf298d4652 admin admin] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:59.268015 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b431e7-572b-46e5-970c-3ddf298d4652 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:59.268286 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b431e7-572b-46e5-970c-3ddf298d4652 admin admin] PATH_INFO: `/v3/projects` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:59.268987 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b431e7-572b-46e5-970c-3ddf298d4652 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:59.270863 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b431e7-572b-46e5-970c-3ddf298d4652 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:59.296700 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1407/2820] 10.222.0.117 () {60 vars in 1157 bytes} [Tue Jan 25 03:18:59 2022] POST /identity/v3/projects => generated 370 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 25 03:18:59.300734 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7021ee-0461-4073-80a1-917d298d70e7 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:59.311128 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7021ee-0461-4073-80a1-917d298d70e7 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:59.365692 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2248841-3aac-44c8-bb62-3b36e144c962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:59.366486 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2248841-3aac-44c8-bb62-3b36e144c962 admin admin] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:59.366803 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2248841-3aac-44c8-bb62-3b36e144c962 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:59.367117 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2248841-3aac-44c8-bb62-3b36e144c962 admin admin] PATH_INFO: `/v3/users` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:59.367979 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2248841-3aac-44c8-bb62-3b36e144c962 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:59.369913 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2248841-3aac-44c8-bb62-3b36e144c962 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:59.389717 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1414/2821] 10.222.0.117 () {60 vars in 1148 bytes} [Tue Jan 25 03:18:59 2022] POST /identity/v3/users => generated 286 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 25 03:18:59.393717 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b431e7-572b-46e5-970c-3ddf298d4652 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:59.404686 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b431e7-572b-46e5-970c-3ddf298d4652 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:59.409363 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67b35b5-9820-45fe-a4f1-0f70e067736d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:59.410015 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67b35b5-9820-45fe-a4f1-0f70e067736d admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:59.410298 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67b35b5-9820-45fe-a4f1-0f70e067736d admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:59.410576 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67b35b5-9820-45fe-a4f1-0f70e067736d admin admin] PATH_INFO: `/v3/roles` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:59.411319 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67b35b5-9820-45fe-a4f1-0f70e067736d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:59.413721 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67b35b5-9820-45fe-a4f1-0f70e067736d admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:59.424100 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1408/2822] 10.222.0.117 () {58 vars in 1126 bytes} [Tue Jan 25 03:18:59 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 03:18:59.428189 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2248841-3aac-44c8-bb62-3b36e144c962 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:59.438092 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2248841-3aac-44c8-bb62-3b36e144c962 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:59.442983 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f872fa-8738-4b16-9bc4-e8ef5419098d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:59.443840 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f872fa-8738-4b16-9bc4-e8ef5419098d admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:59.444135 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f872fa-8738-4b16-9bc4-e8ef5419098d admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:59.444414 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f872fa-8738-4b16-9bc4-e8ef5419098d admin admin] PATH_INFO: `/v3/roles` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:59.445211 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f872fa-8738-4b16-9bc4-e8ef5419098d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:59.446883 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f872fa-8738-4b16-9bc4-e8ef5419098d admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:59.456598 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1415/2823] 10.222.0.117 () {58 vars in 1126 bytes} [Tue Jan 25 03:18:59 2022] GET /identity/v3/roles => generated 1427 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 03:18:59.461991 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67b35b5-9820-45fe-a4f1-0f70e067736d admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:59.471779 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67b35b5-9820-45fe-a4f1-0f70e067736d admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:59.477110 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c43cfe5-98a3-4162-9485-91251a5924e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:59.477995 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c43cfe5-98a3-4162-9485-91251a5924e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:59.478279 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c43cfe5-98a3-4162-9485-91251a5924e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:59.478555 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c43cfe5-98a3-4162-9485-91251a5924e6 admin admin] PATH_INFO: `/v3/projects/b49d1a0585ee4d0992125a806e46704f/users/db8e68548fea4f339d9efbb65128cf91/roles/33a8e87420ed423f9cb29e0084eab5d2` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:59.492718 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c43cfe5-98a3-4162-9485-91251a5924e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b49d1a0585ee4d0992125a806e46704f, user_id=db8e68548fea4f339d9efbb65128cf91, role_id=33a8e87420ed423f9cb29e0084eab5d2)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:59.495284 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c43cfe5-98a3-4162-9485-91251a5924e6 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:59.508877 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1409/2824] 10.222.0.117 () {60 vars in 1487 bytes} [Tue Jan 25 03:18:59 2022] PUT /identity/v3/projects/b49d1a0585ee4d0992125a806e46704f/users/db8e68548fea4f339d9efbb65128cf91/roles/33a8e87420ed423f9cb29e0084eab5d2 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:18:59.514603 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9400423a-bec8-44e5-9a7c-34f854a5b557 None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:59.514892 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9400423a-bec8-44e5-9a7c-34f854a5b557 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:59.515169 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9400423a-bec8-44e5-9a7c-34f854a5b557 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:59.534102 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-9400423a-bec8-44e5-9a7c-34f854a5b557 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:18:59.535300 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-9400423a-bec8-44e5-9a7c-34f854a5b557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:18:59.594101 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1416/2825] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 03:18:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:18:59.604519 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c43cfe5-98a3-4162-9485-91251a5924e6 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:18:59.606556 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-1c43cfe5-98a3-4162-9485-91251a5924e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:18:59.665939 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c43cfe5-98a3-4162-9485-91251a5924e6 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:18:59.669653 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91430d3-feb5-4b6c-8fd3-faef00b8b070 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca4071c5f8f4a31b5edb81fa66a43a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:18:59.670285 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91430d3-feb5-4b6c-8fd3-faef00b8b070 service neutron] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:18:59.670565 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91430d3-feb5-4b6c-8fd3-faef00b8b070 service neutron] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:18:59.670846 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91430d3-feb5-4b6c-8fd3-faef00b8b070 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:18:59.680447 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91430d3-feb5-4b6c-8fd3-faef00b8b070 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:18:59.681876 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91430d3-feb5-4b6c-8fd3-faef00b8b070 service neutron] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:18:59.690914 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1410/2826] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 03:18:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 25 03:19:03.922034 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2864c6ea-b478-4f64-8f1a-dc2d0d6e570b None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:19:03.922649 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2864c6ea-b478-4f64-8f1a-dc2d0d6e570b None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:19:03.922649 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2864c6ea-b478-4f64-8f1a-dc2d0d6e570b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:19:03.952442 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-2864c6ea-b478-4f64-8f1a-dc2d0d6e570b None None] MFA Rules not processed for user `db8e68548fea4f339d9efbb65128cf91`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:19:03.953654 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-2864c6ea-b478-4f64-8f1a-dc2d0d6e570b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:19:04.024563 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1417/2827] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 03:19:03 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 25 03:19:04.029114 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91430d3-feb5-4b6c-8fd3-faef00b8b070 service neutron] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:19:04.039035 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91430d3-feb5-4b6c-8fd3-faef00b8b070 service neutron] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:19:04.043952 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf7c3f0-821a-46cf-9cb9-bb834e9cbf84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:19:04.044617 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf7c3f0-821a-46cf-9cb9-bb834e9cbf84 admin admin] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:19:04.044898 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf7c3f0-821a-46cf-9cb9-bb834e9cbf84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:19:04.045175 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf7c3f0-821a-46cf-9cb9-bb834e9cbf84 admin admin] PATH_INFO: `/v3/projects` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:19:04.045884 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf7c3f0-821a-46cf-9cb9-bb834e9cbf84 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:19:04.047842 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf7c3f0-821a-46cf-9cb9-bb834e9cbf84 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:19:04.075670 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1411/2828] 10.222.0.117 () {60 vars in 1157 bytes} [Tue Jan 25 03:19:04 2022] POST /identity/v3/projects => generated 374 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 03:19:04.079636 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2864c6ea-b478-4f64-8f1a-dc2d0d6e570b None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:19:04.091047 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2864c6ea-b478-4f64-8f1a-dc2d0d6e570b None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:19:04.147968 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d906ef01-7a59-497a-8b4f-ad237516290f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:19:04.148651 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d906ef01-7a59-497a-8b4f-ad237516290f admin admin] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:19:04.148938 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d906ef01-7a59-497a-8b4f-ad237516290f admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:19:04.149212 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d906ef01-7a59-497a-8b4f-ad237516290f admin admin] PATH_INFO: `/v3/users` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:19:04.149942 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d906ef01-7a59-497a-8b4f-ad237516290f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:19:04.151953 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d906ef01-7a59-497a-8b4f-ad237516290f admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:19:04.173721 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1418/2829] 10.222.0.117 () {60 vars in 1148 bytes} [Tue Jan 25 03:19:04 2022] POST /identity/v3/users => generated 294 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 03:19:04.177227 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf7c3f0-821a-46cf-9cb9-bb834e9cbf84 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:19:04.189996 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf7c3f0-821a-46cf-9cb9-bb834e9cbf84 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:19:04.195458 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca79f14-48ba-402e-8a54-b2d4a037dc07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:19:04.196156 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca79f14-48ba-402e-8a54-b2d4a037dc07 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:19:04.196442 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca79f14-48ba-402e-8a54-b2d4a037dc07 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:19:04.196720 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca79f14-48ba-402e-8a54-b2d4a037dc07 admin admin] PATH_INFO: `/v3/roles` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:19:04.197463 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca79f14-48ba-402e-8a54-b2d4a037dc07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:19:04.199065 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca79f14-48ba-402e-8a54-b2d4a037dc07 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:19:04.214930 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1412/2830] 10.222.0.117 () {58 vars in 1126 bytes} [Tue Jan 25 03:19:04 2022] GET /identity/v3/roles => generated 1427 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 03:19:04.216133 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d906ef01-7a59-497a-8b4f-ad237516290f admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:19:04.227208 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d906ef01-7a59-497a-8b4f-ad237516290f admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:19:04.232065 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b0806a-0dee-4033-b74f-c8b5c1623f8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:19:04.232947 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b0806a-0dee-4033-b74f-c8b5c1623f8a admin admin] REQUEST_METHOD: `PUT` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:19:04.233234 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b0806a-0dee-4033-b74f-c8b5c1623f8a admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:19:04.233512 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b0806a-0dee-4033-b74f-c8b5c1623f8a admin admin] PATH_INFO: `/v3/projects/39ba7d0b3d8d406b9419ab681ab86381/users/4d2899f2598a4db0a73069365026a64c/roles/d8dbc6d83d9d41d28c3feb8b3485b291` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:19:04.248723 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b0806a-0dee-4033-b74f-c8b5c1623f8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=39ba7d0b3d8d406b9419ab681ab86381, user_id=4d2899f2598a4db0a73069365026a64c, role_id=d8dbc6d83d9d41d28c3feb8b3485b291)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:19:04.251393 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b0806a-0dee-4033-b74f-c8b5c1623f8a admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:19:04.265275 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1419/2831] 10.222.0.117 () {60 vars in 1487 bytes} [Tue Jan 25 03:19:04 2022] PUT /identity/v3/projects/39ba7d0b3d8d406b9419ab681ab86381/users/4d2899f2598a4db0a73069365026a64c/roles/d8dbc6d83d9d41d28c3feb8b3485b291 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:19:04.269209 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca79f14-48ba-402e-8a54-b2d4a037dc07 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:19:04.279636 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca79f14-48ba-402e-8a54-b2d4a037dc07 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:19:04.336769 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccbddf3-0575-4301-b71e-7dc03e9da288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:19:04.337390 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccbddf3-0575-4301-b71e-7dc03e9da288 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:19:04.337673 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccbddf3-0575-4301-b71e-7dc03e9da288 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:19:04.337949 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccbddf3-0575-4301-b71e-7dc03e9da288 admin admin] PATH_INFO: `/v3/roles` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:19:04.338690 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccbddf3-0575-4301-b71e-7dc03e9da288 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:19:04.341037 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccbddf3-0575-4301-b71e-7dc03e9da288 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:19:04.352879 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1413/2832] 10.222.0.117 () {58 vars in 1126 bytes} [Tue Jan 25 03:19:04 2022] GET /identity/v3/roles => generated 1427 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 03:19:04.357116 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b0806a-0dee-4033-b74f-c8b5c1623f8a admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:19:04.368252 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b0806a-0dee-4033-b74f-c8b5c1623f8a admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:19:04.372961 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c112ce-7446-4a32-80e6-182d64c4a12f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:19:04.373839 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c112ce-7446-4a32-80e6-182d64c4a12f admin admin] REQUEST_METHOD: `PUT` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:19:04.374122 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c112ce-7446-4a32-80e6-182d64c4a12f admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:19:04.374398 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c112ce-7446-4a32-80e6-182d64c4a12f admin admin] PATH_INFO: `/v3/projects/39ba7d0b3d8d406b9419ab681ab86381/users/4d2899f2598a4db0a73069365026a64c/roles/d8dbc6d83d9d41d28c3feb8b3485b291` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:19:04.376424 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c112ce-7446-4a32-80e6-182d64c4a12f admin admin] RBAC: Authorizing `identity:create_grant(project_id=39ba7d0b3d8d406b9419ab681ab86381, user_id=4d2899f2598a4db0a73069365026a64c, role_id=d8dbc6d83d9d41d28c3feb8b3485b291)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:19:04.379063 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c112ce-7446-4a32-80e6-182d64c4a12f admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:19:04.390660 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1420/2833] 10.222.0.117 () {60 vars in 1487 bytes} [Tue Jan 25 03:19:04 2022] PUT /identity/v3/projects/39ba7d0b3d8d406b9419ab681ab86381/users/4d2899f2598a4db0a73069365026a64c/roles/d8dbc6d83d9d41d28c3feb8b3485b291 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:19:04.491619 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccbddf3-0575-4301-b71e-7dc03e9da288 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:19:04.494181 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-fccbddf3-0575-4301-b71e-7dc03e9da288 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:19:04.618239 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccbddf3-0575-4301-b71e-7dc03e9da288 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:19:04.702680 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1acc8a3-f898-464c-a2a8-36a91e8a4d55 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '890151a6bf2840f0a0a00f45dd2d38a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:19:04.703558 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1acc8a3-f898-464c-a2a8-36a91e8a4d55 service placement] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:19:04.703751 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1acc8a3-f898-464c-a2a8-36a91e8a4d55 service placement] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:19:04.704015 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1acc8a3-f898-464c-a2a8-36a91e8a4d55 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:19:04.706707 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-a1acc8a3-f898-464c-a2a8-36a91e8a4d55 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:19:04.728857 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1acc8a3-f898-464c-a2a8-36a91e8a4d55 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:19:04.732577 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1acc8a3-f898-464c-a2a8-36a91e8a4d55 service placement] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:19:04.746779 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1414/2834] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 03:19:04 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:19:08.750260 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a035b7b4-a4b4-4339-9ff3-ea34817ea94b None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:19:08.751147 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a035b7b4-a4b4-4339-9ff3-ea34817ea94b None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:19:08.751590 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a035b7b4-a4b4-4339-9ff3-ea34817ea94b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:19:08.796462 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-a035b7b4-a4b4-4339-9ff3-ea34817ea94b None None] MFA Rules not processed for user `4d2899f2598a4db0a73069365026a64c`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:19:08.797953 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-a035b7b4-a4b4-4339-9ff3-ea34817ea94b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:19:08.887742 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1421/2835] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 03:19:08 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:19:08.901208 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1acc8a3-f898-464c-a2a8-36a91e8a4d55 service placement] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:19:08.902729 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-a1acc8a3-f898-464c-a2a8-36a91e8a4d55 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:19:09.039067 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1acc8a3-f898-464c-a2a8-36a91e8a4d55 service placement] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:19:09.045511 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f895ee4-0ee5-489c-b15f-a19e69bc5406 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9ad6269900346458050063c12cac299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:19:09.046261 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f895ee4-0ee5-489c-b15f-a19e69bc5406 service nova] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:19:09.046621 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f895ee4-0ee5-489c-b15f-a19e69bc5406 service nova] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:19:09.046961 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f895ee4-0ee5-489c-b15f-a19e69bc5406 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:19:09.123507 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f895ee4-0ee5-489c-b15f-a19e69bc5406 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:19:09.125260 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f895ee4-0ee5-489c-b15f-a19e69bc5406 service nova] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:19:09.135718 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1415/2836] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 03:19:08 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:19:10.287395 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e921835-d836-4b40-980d-359ca0225b60 None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:19:10.288696 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e921835-d836-4b40-980d-359ca0225b60 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:19:10.289008 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e921835-d836-4b40-980d-359ca0225b60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:19:10.307342 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-0e921835-d836-4b40-980d-359ca0225b60 None None] MFA Rules not processed for user `db8e68548fea4f339d9efbb65128cf91`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:19:10.308586 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-0e921835-d836-4b40-980d-359ca0225b60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:19:10.315462 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1422/2837] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 03:19:10 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:19:32.790913 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f895ee4-0ee5-489c-b15f-a19e69bc5406 service nova] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:19:32.792433 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-2f895ee4-0ee5-489c-b15f-a19e69bc5406 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:19:32.847460 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f895ee4-0ee5-489c-b15f-a19e69bc5406 service nova] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:19:32.851603 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1426d18-c49b-4715-81a9-9601c165ba0a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cc5249aea09430080e232cf17757f86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:19:32.852274 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1426d18-c49b-4715-81a9-9601c165ba0a service cinder] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:19:32.852559 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1426d18-c49b-4715-81a9-9601c165ba0a service cinder] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:19:32.852837 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1426d18-c49b-4715-81a9-9601c165ba0a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:19:32.854577 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-b1426d18-c49b-4715-81a9-9601c165ba0a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:19:32.868155 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1426d18-c49b-4715-81a9-9601c165ba0a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:19:32.869574 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1426d18-c49b-4715-81a9-9601c165ba0a service cinder] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:19:32.880192 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1416/2838] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 03:19:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:19:33.162236 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e921835-d836-4b40-980d-359ca0225b60 None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:19:33.164345 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-0e921835-d836-4b40-980d-359ca0225b60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:19:33.222087 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e921835-d836-4b40-980d-359ca0225b60 None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:19:33.226610 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e8ccf9-6556-4723-bae7-c16b58f3bb3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca4071c5f8f4a31b5edb81fa66a43a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:19:33.227256 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e8ccf9-6556-4723-bae7-c16b58f3bb3c service neutron] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:19:33.227538 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e8ccf9-6556-4723-bae7-c16b58f3bb3c service neutron] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:19:33.227845 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e8ccf9-6556-4723-bae7-c16b58f3bb3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:19:33.229598 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-d4e8ccf9-6556-4723-bae7-c16b58f3bb3c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:19:33.238656 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e8ccf9-6556-4723-bae7-c16b58f3bb3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:19:33.240122 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e8ccf9-6556-4723-bae7-c16b58f3bb3c service neutron] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:19:33.248189 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1423/2839] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 03:19:33 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:19:33.682449 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1426d18-c49b-4715-81a9-9601c165ba0a service cinder] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:19:33.683940 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-b1426d18-c49b-4715-81a9-9601c165ba0a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:19:33.692978 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e8ccf9-6556-4723-bae7-c16b58f3bb3c service neutron] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:19:33.700627 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1426d18-c49b-4715-81a9-9601c165ba0a service cinder] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:19:33.702153 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e8ccf9-6556-4723-bae7-c16b58f3bb3c service neutron] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:19:33.705720 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11648e7d-85e5-452b-b78e-617ef989098a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca4071c5f8f4a31b5edb81fa66a43a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:19:33.706116 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a60ad14-cfa0-4e10-b957-2029256733b0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '890151a6bf2840f0a0a00f45dd2d38a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:19:33.706354 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11648e7d-85e5-452b-b78e-617ef989098a service neutron] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:19:33.706633 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11648e7d-85e5-452b-b78e-617ef989098a service neutron] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:19:33.706759 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a60ad14-cfa0-4e10-b957-2029256733b0 service placement] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:19:33.707062 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a60ad14-cfa0-4e10-b957-2029256733b0 service placement] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:19:33.707344 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a60ad14-cfa0-4e10-b957-2029256733b0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:19:33.708037 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11648e7d-85e5-452b-b78e-617ef989098a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:19:33.709229 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-9a60ad14-cfa0-4e10-b957-2029256733b0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:19:33.709931 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-11648e7d-85e5-452b-b78e-617ef989098a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:19:33.721322 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a60ad14-cfa0-4e10-b957-2029256733b0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:19:33.722896 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a60ad14-cfa0-4e10-b957-2029256733b0 service placement] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:19:33.724255 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11648e7d-85e5-452b-b78e-617ef989098a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:19:33.726251 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11648e7d-85e5-452b-b78e-617ef989098a service neutron] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:19:33.734227 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1417/2840] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 03:19:33 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:19:33.737608 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1424/2841] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 03:19:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 25 03:19:35.456369 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a60ad14-cfa0-4e10-b957-2029256733b0 service placement] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:19:35.469060 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a60ad14-cfa0-4e10-b957-2029256733b0 service placement] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:19:35.472798 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2051966d-f89e-4a8b-8b35-da41a07bd8a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca4071c5f8f4a31b5edb81fa66a43a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:19:35.473437 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2051966d-f89e-4a8b-8b35-da41a07bd8a1 service neutron] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:19:35.473718 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2051966d-f89e-4a8b-8b35-da41a07bd8a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:19:35.473987 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2051966d-f89e-4a8b-8b35-da41a07bd8a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:19:35.476531 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-2051966d-f89e-4a8b-8b35-da41a07bd8a1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:19:35.487363 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2051966d-f89e-4a8b-8b35-da41a07bd8a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:19:35.488979 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2051966d-f89e-4a8b-8b35-da41a07bd8a1 service neutron] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:19:35.498097 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1418/2842] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 03:19:35 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:19:36.184848 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11648e7d-85e5-452b-b78e-617ef989098a service neutron] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:19:36.186286 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-11648e7d-85e5-452b-b78e-617ef989098a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:19:36.207288 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11648e7d-85e5-452b-b78e-617ef989098a service neutron] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:19:36.215113 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100f283b-e8bc-401d-aac9-e551f5be3cef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9ad6269900346458050063c12cac299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:19:36.215926 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100f283b-e8bc-401d-aac9-e551f5be3cef service nova] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:19:36.216311 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100f283b-e8bc-401d-aac9-e551f5be3cef service nova] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:19:36.216689 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100f283b-e8bc-401d-aac9-e551f5be3cef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:19:36.218633 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-100f283b-e8bc-401d-aac9-e551f5be3cef service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:19:36.236409 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100f283b-e8bc-401d-aac9-e551f5be3cef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:19:36.238053 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100f283b-e8bc-401d-aac9-e551f5be3cef service nova] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:19:36.249928 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1425/2843] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 03:19:36 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:19:46.264106 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2051966d-f89e-4a8b-8b35-da41a07bd8a1 service neutron] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:19:46.272545 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2051966d-f89e-4a8b-8b35-da41a07bd8a1 service neutron] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:19:46.276859 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3af6897-6a40-4209-8601-00d39c398f4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca4071c5f8f4a31b5edb81fa66a43a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:19:46.277492 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3af6897-6a40-4209-8601-00d39c398f4b service neutron] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:19:46.277774 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3af6897-6a40-4209-8601-00d39c398f4b service neutron] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:19:46.278049 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3af6897-6a40-4209-8601-00d39c398f4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:19:46.279842 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-e3af6897-6a40-4209-8601-00d39c398f4b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:19:46.340391 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3af6897-6a40-4209-8601-00d39c398f4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:19:46.341830 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3af6897-6a40-4209-8601-00d39c398f4b service neutron] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:19:46.351716 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1419/2844] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 03:19:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:19:47.305677 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100f283b-e8bc-401d-aac9-e551f5be3cef service nova] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:19:47.320036 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100f283b-e8bc-401d-aac9-e551f5be3cef service nova] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:19:47.327311 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbca8af2-3fa3-4bbc-896d-599fbefc177f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9ad6269900346458050063c12cac299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:19:47.328001 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbca8af2-3fa3-4bbc-896d-599fbefc177f service nova] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:19:47.328287 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbca8af2-3fa3-4bbc-896d-599fbefc177f service nova] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:19:47.328564 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbca8af2-3fa3-4bbc-896d-599fbefc177f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:19:47.330383 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-dbca8af2-3fa3-4bbc-896d-599fbefc177f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:19:47.344566 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbca8af2-3fa3-4bbc-896d-599fbefc177f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:19:47.346412 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbca8af2-3fa3-4bbc-896d-599fbefc177f service nova] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:19:47.359262 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1426/2845] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 03:19:47 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:19:49.886151 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3af6897-6a40-4209-8601-00d39c398f4b service neutron] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:19:49.887663 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-e3af6897-6a40-4209-8601-00d39c398f4b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:19:49.906406 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3af6897-6a40-4209-8601-00d39c398f4b service neutron] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:19:49.912098 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7e792f-4177-4c08-90fb-e000d943d197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:19:49.912969 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7e792f-4177-4c08-90fb-e000d943d197 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:19:49.913249 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7e792f-4177-4c08-90fb-e000d943d197 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:19:49.913523 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7e792f-4177-4c08-90fb-e000d943d197 admin admin] PATH_INFO: `/v3/users/8f9b0a291a2041aab799eef5bbf8f77b` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:19:49.914981 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7e792f-4177-4c08-90fb-e000d943d197 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f9b0a291a2041aab799eef5bbf8f77b)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:19:49.917521 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7e792f-4177-4c08-90fb-e000d943d197 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:19:49.963518 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-ed7e792f-4177-4c08-90fb-e000d943d197 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f9b0a291a2041aab799eef5bbf8f77b'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:19:49.969975 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-ed7e792f-4177-4c08-90fb-e000d943d197 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f9b0a291a2041aab799eef5bbf8f77b'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:19:49.970589 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-ed7e792f-4177-4c08-90fb-e000d943d197 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f9b0a291a2041aab799eef5bbf8f77b'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:19:49.971196 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-ed7e792f-4177-4c08-90fb-e000d943d197 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f9b0a291a2041aab799eef5bbf8f77b'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:19:49.983099 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-ed7e792f-4177-4c08-90fb-e000d943d197 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f9b0a291a2041aab799eef5bbf8f77b'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:19:49.995399 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1420/2846] 10.222.0.117 () {58 vars in 1228 bytes} [Tue Jan 25 03:19:49 2022] DELETE /identity/v3/users/8f9b0a291a2041aab799eef5bbf8f77b => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:19:50.168892 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbca8af2-3fa3-4bbc-896d-599fbefc177f service nova] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:19:50.186720 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbca8af2-3fa3-4bbc-896d-599fbefc177f service nova] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:19:50.244032 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085d5947-0c04-4e2e-8ade-b52c8d1440fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:19:50.245200 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085d5947-0c04-4e2e-8ade-b52c8d1440fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:19:50.245482 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085d5947-0c04-4e2e-8ade-b52c8d1440fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:19:50.245755 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085d5947-0c04-4e2e-8ade-b52c8d1440fd admin admin] PATH_INFO: `/v3/projects/334fc558eb7e4efb8031bd3f409ddfda` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:19:50.246928 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085d5947-0c04-4e2e-8ade-b52c8d1440fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=334fc558eb7e4efb8031bd3f409ddfda)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:19:50.248868 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085d5947-0c04-4e2e-8ade-b52c8d1440fd admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:19:50.293573 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-085d5947-0c04-4e2e-8ade-b52c8d1440fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '334fc558eb7e4efb8031bd3f409ddfda', 'request_id': 'req-085d5947-0c04-4e2e-8ade-b52c8d1440fd'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:19:50.298659 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-085d5947-0c04-4e2e-8ade-b52c8d1440fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '334fc558eb7e4efb8031bd3f409ddfda', 'request_id': 'req-085d5947-0c04-4e2e-8ade-b52c8d1440fd'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:19:50.305834 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-085d5947-0c04-4e2e-8ade-b52c8d1440fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '334fc558eb7e4efb8031bd3f409ddfda', 'request_id': 'req-085d5947-0c04-4e2e-8ade-b52c8d1440fd'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:19:50.317161 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-085d5947-0c04-4e2e-8ade-b52c8d1440fd admin admin] The token cache is being invalidate because project 334fc558eb7e4efb8031bd3f409ddfda was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79121) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 25 03:19:50.317458 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-085d5947-0c04-4e2e-8ade-b52c8d1440fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:19:50.318161 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-085d5947-0c04-4e2e-8ade-b52c8d1440fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:19:50.319765 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1427/2847] 10.222.0.117 () {58 vars in 1237 bytes} [Tue Jan 25 03:19:50 2022] DELETE /identity/v3/projects/334fc558eb7e4efb8031bd3f409ddfda => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:19:50.326756 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d3d311-52a0-4693-86f1-e06f88967088 None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:19:50.326878 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d3d311-52a0-4693-86f1-e06f88967088 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:19:50.327166 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d3d311-52a0-4693-86f1-e06f88967088 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:19:50.345486 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-76d3d311-52a0-4693-86f1-e06f88967088 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:19:50.346692 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-76d3d311-52a0-4693-86f1-e06f88967088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:19:50.406174 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1421/2848] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 03:19:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:19:50.414410 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c8c1bd-9b32-4c53-9f8a-8c3b0d619850 None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:19:50.414696 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c8c1bd-9b32-4c53-9f8a-8c3b0d619850 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:19:50.414981 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c8c1bd-9b32-4c53-9f8a-8c3b0d619850 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:19:50.436486 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-e7c8c1bd-9b32-4c53-9f8a-8c3b0d619850 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:19:50.437714 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-e7c8c1bd-9b32-4c53-9f8a-8c3b0d619850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:19:50.447591 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1428/2849] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 03:19:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:19:50.450911 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d3d311-52a0-4693-86f1-e06f88967088 None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:19:50.460554 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d3d311-52a0-4693-86f1-e06f88967088 None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:19:50.466537 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aef6ea7-bc96-4024-906e-27328392af6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:19:50.467301 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aef6ea7-bc96-4024-906e-27328392af6b admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:19:50.467649 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aef6ea7-bc96-4024-906e-27328392af6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:19:50.468027 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aef6ea7-bc96-4024-906e-27328392af6b admin admin] PATH_INFO: `/v3/domains` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:19:50.469955 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aef6ea7-bc96-4024-906e-27328392af6b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79120) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:19:50.470349 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aef6ea7-bc96-4024-906e-27328392af6b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:19:50.472973 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aef6ea7-bc96-4024-906e-27328392af6b admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:19:50.489217 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1422/2850] 10.222.0.117 () {58 vars in 1157 bytes} [Tue Jan 25 03:19:50 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:19:50.498809 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c8c1bd-9b32-4c53-9f8a-8c3b0d619850 None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:19:50.508142 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c8c1bd-9b32-4c53-9f8a-8c3b0d619850 None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:19:50.513375 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b592b1c4-4f06-4064-98fd-5df64ae04cf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:19:50.513917 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b592b1c4-4f06-4064-98fd-5df64ae04cf5 admin admin] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:19:50.514206 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b592b1c4-4f06-4064-98fd-5df64ae04cf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:19:50.514488 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b592b1c4-4f06-4064-98fd-5df64ae04cf5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:19:50.515197 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b592b1c4-4f06-4064-98fd-5df64ae04cf5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:19:50.517266 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b592b1c4-4f06-4064-98fd-5df64ae04cf5 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:19:50.549608 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1429/2851] 10.222.0.117 () {60 vars in 1157 bytes} [Tue Jan 25 03:19:50 2022] POST /identity/v3/projects => generated 370 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 03:19:50.550861 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aef6ea7-bc96-4024-906e-27328392af6b admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:19:50.562069 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aef6ea7-bc96-4024-906e-27328392af6b admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:19:50.621638 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17492fa5-a5dd-432a-acc5-97167aa28006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:19:50.622315 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17492fa5-a5dd-432a-acc5-97167aa28006 admin admin] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:19:50.622601 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17492fa5-a5dd-432a-acc5-97167aa28006 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:19:50.622877 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17492fa5-a5dd-432a-acc5-97167aa28006 admin admin] PATH_INFO: `/v3/users` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:19:50.623585 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17492fa5-a5dd-432a-acc5-97167aa28006 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:19:50.625551 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17492fa5-a5dd-432a-acc5-97167aa28006 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:19:50.645285 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1423/2852] 10.222.0.117 () {60 vars in 1148 bytes} [Tue Jan 25 03:19:50 2022] POST /identity/v3/users => generated 286 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 25 03:19:50.649467 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b592b1c4-4f06-4064-98fd-5df64ae04cf5 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:19:50.660012 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b592b1c4-4f06-4064-98fd-5df64ae04cf5 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:19:50.666347 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54daf05-f9d2-4163-9289-7cb0975b0522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:19:50.667088 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54daf05-f9d2-4163-9289-7cb0975b0522 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:19:50.667512 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54daf05-f9d2-4163-9289-7cb0975b0522 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:19:50.667846 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54daf05-f9d2-4163-9289-7cb0975b0522 admin admin] PATH_INFO: `/v3/roles` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:19:50.668837 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54daf05-f9d2-4163-9289-7cb0975b0522 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:19:50.669930 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17492fa5-a5dd-432a-acc5-97167aa28006 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:19:50.670670 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54daf05-f9d2-4163-9289-7cb0975b0522 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:19:50.671672 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-17492fa5-a5dd-432a-acc5-97167aa28006 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:19:50.682668 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1430/2853] 10.222.0.117 () {58 vars in 1126 bytes} [Tue Jan 25 03:19:50 2022] GET /identity/v3/roles => generated 1427 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 03:19:50.686566 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54daf05-f9d2-4163-9289-7cb0975b0522 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:19:50.697434 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54daf05-f9d2-4163-9289-7cb0975b0522 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:19:50.702139 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235ac60a-4413-4cd5-abbe-ec19a87b8169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:19:50.702800 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235ac60a-4413-4cd5-abbe-ec19a87b8169 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:19:50.703083 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235ac60a-4413-4cd5-abbe-ec19a87b8169 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:19:50.703389 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235ac60a-4413-4cd5-abbe-ec19a87b8169 admin admin] PATH_INFO: `/v3/roles` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:19:50.704168 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235ac60a-4413-4cd5-abbe-ec19a87b8169 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:19:50.705822 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235ac60a-4413-4cd5-abbe-ec19a87b8169 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:19:50.717062 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1431/2854] 10.222.0.117 () {58 vars in 1126 bytes} [Tue Jan 25 03:19:50 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 25 03:19:50.720991 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235ac60a-4413-4cd5-abbe-ec19a87b8169 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:19:50.731045 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235ac60a-4413-4cd5-abbe-ec19a87b8169 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:19:50.735487 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17492fa5-a5dd-432a-acc5-97167aa28006 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:19:50.735878 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e5e25d-8aa7-458a-9d1d-e7593b35710a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:19:50.736864 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e5e25d-8aa7-458a-9d1d-e7593b35710a admin admin] REQUEST_METHOD: `PUT` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:19:50.737155 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e5e25d-8aa7-458a-9d1d-e7593b35710a admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:19:50.737433 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e5e25d-8aa7-458a-9d1d-e7593b35710a admin admin] PATH_INFO: `/v3/projects/0da1a702c2a74dca8c43ec3b78f67311/users/3e73db0d4cf34cbf8a1160bfac166319/roles/33a8e87420ed423f9cb29e0084eab5d2` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:19:50.739407 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062e0478-074b-499b-9692-72852efb12fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca4071c5f8f4a31b5edb81fa66a43a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:19:50.740266 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062e0478-074b-499b-9692-72852efb12fa service neutron] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:19:50.740550 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062e0478-074b-499b-9692-72852efb12fa service neutron] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:19:50.740826 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062e0478-074b-499b-9692-72852efb12fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:19:50.742671 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-062e0478-074b-499b-9692-72852efb12fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:19:50.752707 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e5e25d-8aa7-458a-9d1d-e7593b35710a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0da1a702c2a74dca8c43ec3b78f67311, user_id=3e73db0d4cf34cbf8a1160bfac166319, role_id=33a8e87420ed423f9cb29e0084eab5d2)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:19:50.755348 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e5e25d-8aa7-458a-9d1d-e7593b35710a admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:19:50.768373 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1432/2855] 10.222.0.117 () {60 vars in 1487 bytes} [Tue Jan 25 03:19:50 2022] PUT /identity/v3/projects/0da1a702c2a74dca8c43ec3b78f67311/users/3e73db0d4cf34cbf8a1160bfac166319/roles/33a8e87420ed423f9cb29e0084eab5d2 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 25 03:19:50.778628 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530880c1-dea0-4c41-9cf3-e126ebcd944b None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:19:50.778919 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530880c1-dea0-4c41-9cf3-e126ebcd944b None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:19:50.779195 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530880c1-dea0-4c41-9cf3-e126ebcd944b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:19:50.804729 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062e0478-074b-499b-9692-72852efb12fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:19:50.806749 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062e0478-074b-499b-9692-72852efb12fa service neutron] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:19:50.807092 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-530880c1-dea0-4c41-9cf3-e126ebcd944b None None] MFA Rules not processed for user `3e73db0d4cf34cbf8a1160bfac166319`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:19:50.808604 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-530880c1-dea0-4c41-9cf3-e126ebcd944b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:19:50.816590 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1424/2856] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 03:19:50 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:19:50.885433 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1433/2857] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 03:19:50 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 25 03:19:50.896102 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062e0478-074b-499b-9692-72852efb12fa service neutron] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:19:50.897518 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-062e0478-074b-499b-9692-72852efb12fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:19:50.971222 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062e0478-074b-499b-9692-72852efb12fa service neutron] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:19:51.035642 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e25d31-0218-4ce8-8644-24aee0e73eb7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9ad6269900346458050063c12cac299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:19:51.036244 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e25d31-0218-4ce8-8644-24aee0e73eb7 service nova] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:19:51.036527 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e25d31-0218-4ce8-8644-24aee0e73eb7 service nova] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:19:51.036804 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e25d31-0218-4ce8-8644-24aee0e73eb7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:19:51.045594 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e25d31-0218-4ce8-8644-24aee0e73eb7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:19:51.047196 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e25d31-0218-4ce8-8644-24aee0e73eb7 service nova] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:19:51.056893 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1425/2858] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 03:19:50 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:19:53.757003 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530880c1-dea0-4c41-9cf3-e126ebcd944b None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:19:53.818079 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530880c1-dea0-4c41-9cf3-e126ebcd944b None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:19:53.823961 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a13981-e43a-4034-ac98-8ea1cbcd2f4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:19:53.824829 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a13981-e43a-4034-ac98-8ea1cbcd2f4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:19:53.825110 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a13981-e43a-4034-ac98-8ea1cbcd2f4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:19:53.825383 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a13981-e43a-4034-ac98-8ea1cbcd2f4e admin admin] PATH_INFO: `/v3/users/3e73db0d4cf34cbf8a1160bfac166319` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:19:53.826584 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a13981-e43a-4034-ac98-8ea1cbcd2f4e admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e73db0d4cf34cbf8a1160bfac166319)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:19:53.828567 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a13981-e43a-4034-ac98-8ea1cbcd2f4e admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:19:53.873424 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-b3a13981-e43a-4034-ac98-8ea1cbcd2f4e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e73db0d4cf34cbf8a1160bfac166319'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:19:53.874081 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-b3a13981-e43a-4034-ac98-8ea1cbcd2f4e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e73db0d4cf34cbf8a1160bfac166319'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:19:53.880604 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-b3a13981-e43a-4034-ac98-8ea1cbcd2f4e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e73db0d4cf34cbf8a1160bfac166319'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:19:53.881234 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-b3a13981-e43a-4034-ac98-8ea1cbcd2f4e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e73db0d4cf34cbf8a1160bfac166319'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:19:53.889308 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-b3a13981-e43a-4034-ac98-8ea1cbcd2f4e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e73db0d4cf34cbf8a1160bfac166319'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:19:53.906618 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1434/2859] 10.222.0.117 () {58 vars in 1228 bytes} [Tue Jan 25 03:19:53 2022] DELETE /identity/v3/users/3e73db0d4cf34cbf8a1160bfac166319 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:19:53.911299 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07bc038-630b-4a45-ba6f-4edffe30da15 None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:19:53.911805 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07bc038-630b-4a45-ba6f-4edffe30da15 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:19:53.911931 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07bc038-630b-4a45-ba6f-4edffe30da15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:19:53.929464 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-c07bc038-630b-4a45-ba6f-4edffe30da15 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:19:53.930620 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-c07bc038-630b-4a45-ba6f-4edffe30da15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:19:53.987746 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1426/2860] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 03:19:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:19:53.997943 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a13981-e43a-4034-ac98-8ea1cbcd2f4e admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:19:53.999354 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-b3a13981-e43a-4034-ac98-8ea1cbcd2f4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:19:54.055235 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a13981-e43a-4034-ac98-8ea1cbcd2f4e admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:19:54.059810 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e997bd5b-7810-4f34-a4ca-786e875c54bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca4071c5f8f4a31b5edb81fa66a43a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:19:54.060449 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e997bd5b-7810-4f34-a4ca-786e875c54bc service neutron] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:19:54.060738 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e997bd5b-7810-4f34-a4ca-786e875c54bc service neutron] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:19:54.061035 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e997bd5b-7810-4f34-a4ca-786e875c54bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:19:54.070051 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e997bd5b-7810-4f34-a4ca-786e875c54bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:19:54.072160 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e997bd5b-7810-4f34-a4ca-786e875c54bc service neutron] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:19:54.081307 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1435/2861] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 03:19:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:19:54.344125 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07bc038-630b-4a45-ba6f-4edffe30da15 None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:19:54.345649 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-c07bc038-630b-4a45-ba6f-4edffe30da15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:19:54.359120 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07bc038-630b-4a45-ba6f-4edffe30da15 None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:19:54.363995 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032b0658-a381-48a1-b74f-d9fe4653cec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:19:54.365380 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032b0658-a381-48a1-b74f-d9fe4653cec8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:19:54.365823 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032b0658-a381-48a1-b74f-d9fe4653cec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:19:54.366102 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032b0658-a381-48a1-b74f-d9fe4653cec8 admin admin] PATH_INFO: `/v3/projects/0da1a702c2a74dca8c43ec3b78f67311` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:19:54.367424 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032b0658-a381-48a1-b74f-d9fe4653cec8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0da1a702c2a74dca8c43ec3b78f67311)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:19:54.369423 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032b0658-a381-48a1-b74f-d9fe4653cec8 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:19:54.417264 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-032b0658-a381-48a1-b74f-d9fe4653cec8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0da1a702c2a74dca8c43ec3b78f67311', 'request_id': 'req-032b0658-a381-48a1-b74f-d9fe4653cec8'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:19:54.422870 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-032b0658-a381-48a1-b74f-d9fe4653cec8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0da1a702c2a74dca8c43ec3b78f67311', 'request_id': 'req-032b0658-a381-48a1-b74f-d9fe4653cec8'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:19:54.429013 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-032b0658-a381-48a1-b74f-d9fe4653cec8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0da1a702c2a74dca8c43ec3b78f67311', 'request_id': 'req-032b0658-a381-48a1-b74f-d9fe4653cec8'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:19:54.440517 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-032b0658-a381-48a1-b74f-d9fe4653cec8 admin admin] The token cache is being invalidate because project 0da1a702c2a74dca8c43ec3b78f67311 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79120) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 25 03:19:54.440805 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-032b0658-a381-48a1-b74f-d9fe4653cec8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:19:54.441422 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-032b0658-a381-48a1-b74f-d9fe4653cec8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:19:54.442940 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1427/2862] 10.222.0.117 () {58 vars in 1237 bytes} [Tue Jan 25 03:19:54 2022] DELETE /identity/v3/projects/0da1a702c2a74dca8c43ec3b78f67311 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 25 03:19:54.449394 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcad862-42cb-4b08-8dd1-ce4a2cf7a38d None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:19:54.449690 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcad862-42cb-4b08-8dd1-ce4a2cf7a38d None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:19:54.449972 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcad862-42cb-4b08-8dd1-ce4a2cf7a38d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:19:54.468240 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-fdcad862-42cb-4b08-8dd1-ce4a2cf7a38d None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:19:54.469395 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-fdcad862-42cb-4b08-8dd1-ce4a2cf7a38d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:19:54.526563 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1436/2863] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 03:19:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:19:54.534426 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4442d0a-bb8c-4933-9538-f80a0651ef49 None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:19:54.534717 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4442d0a-bb8c-4933-9538-f80a0651ef49 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:19:54.534995 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4442d0a-bb8c-4933-9538-f80a0651ef49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:19:54.553570 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-f4442d0a-bb8c-4933-9538-f80a0651ef49 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:19:54.554772 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-f4442d0a-bb8c-4933-9538-f80a0651ef49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:19:54.562678 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1428/2864] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 03:19:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:19:54.566755 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcad862-42cb-4b08-8dd1-ce4a2cf7a38d None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:19:54.576717 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcad862-42cb-4b08-8dd1-ce4a2cf7a38d None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:19:54.581326 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37787a19-39e9-420d-bcd9-366183e0162d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:19:54.581972 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37787a19-39e9-420d-bcd9-366183e0162d admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:19:54.582260 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37787a19-39e9-420d-bcd9-366183e0162d admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:19:54.582540 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37787a19-39e9-420d-bcd9-366183e0162d admin admin] PATH_INFO: `/v3/domains` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:19:54.583279 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37787a19-39e9-420d-bcd9-366183e0162d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:19:54.583588 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37787a19-39e9-420d-bcd9-366183e0162d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:19:54.585235 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37787a19-39e9-420d-bcd9-366183e0162d admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:19:54.597751 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1437/2865] 10.222.0.117 () {58 vars in 1157 bytes} [Tue Jan 25 03:19:54 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:19:54.601932 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4442d0a-bb8c-4933-9538-f80a0651ef49 None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:19:54.611169 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4442d0a-bb8c-4933-9538-f80a0651ef49 None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:19:54.615938 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4c0eb6-67f5-4dbf-b311-941bb14e2019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:19:54.616597 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4c0eb6-67f5-4dbf-b311-941bb14e2019 admin admin] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:19:54.616876 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4c0eb6-67f5-4dbf-b311-941bb14e2019 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:19:54.617151 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4c0eb6-67f5-4dbf-b311-941bb14e2019 admin admin] PATH_INFO: `/v3/projects` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:19:54.617872 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4c0eb6-67f5-4dbf-b311-941bb14e2019 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:19:54.620155 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4c0eb6-67f5-4dbf-b311-941bb14e2019 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:19:54.646443 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1429/2866] 10.222.0.117 () {60 vars in 1157 bytes} [Tue Jan 25 03:19:54 2022] POST /identity/v3/projects => generated 406 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 03:19:54.651220 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37787a19-39e9-420d-bcd9-366183e0162d admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:19:54.660963 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37787a19-39e9-420d-bcd9-366183e0162d admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:19:54.715597 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81f811c-72d6-4d54-940d-dee73eec048f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:19:54.716377 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81f811c-72d6-4d54-940d-dee73eec048f admin admin] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:19:54.716663 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81f811c-72d6-4d54-940d-dee73eec048f admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:19:54.716936 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81f811c-72d6-4d54-940d-dee73eec048f admin admin] PATH_INFO: `/v3/users` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:19:54.717631 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81f811c-72d6-4d54-940d-dee73eec048f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:19:54.719601 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81f811c-72d6-4d54-940d-dee73eec048f admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:19:54.740368 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1438/2867] 10.222.0.117 () {60 vars in 1148 bytes} [Tue Jan 25 03:19:54 2022] POST /identity/v3/users => generated 304 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 03:19:54.744822 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4c0eb6-67f5-4dbf-b311-941bb14e2019 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:19:54.754912 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4c0eb6-67f5-4dbf-b311-941bb14e2019 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:19:54.760288 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a0e251-1781-4c85-9107-b4bd45470075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:19:54.760957 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a0e251-1781-4c85-9107-b4bd45470075 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:19:54.761269 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a0e251-1781-4c85-9107-b4bd45470075 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:19:54.761549 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a0e251-1781-4c85-9107-b4bd45470075 admin admin] PATH_INFO: `/v3/roles` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:19:54.762295 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a0e251-1781-4c85-9107-b4bd45470075 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:19:54.763929 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a0e251-1781-4c85-9107-b4bd45470075 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:19:54.775009 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1430/2868] 10.222.0.117 () {58 vars in 1126 bytes} [Tue Jan 25 03:19:54 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 03:19:54.779115 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81f811c-72d6-4d54-940d-dee73eec048f admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:19:54.789235 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81f811c-72d6-4d54-940d-dee73eec048f admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:19:54.793919 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9339c0d5-eaa7-46d9-bc69-56e6e0b9c003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:19:54.794682 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9339c0d5-eaa7-46d9-bc69-56e6e0b9c003 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:19:54.794974 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9339c0d5-eaa7-46d9-bc69-56e6e0b9c003 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:19:54.795258 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9339c0d5-eaa7-46d9-bc69-56e6e0b9c003 admin admin] PATH_INFO: `/v3/roles` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:19:54.796069 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9339c0d5-eaa7-46d9-bc69-56e6e0b9c003 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:19:54.797758 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9339c0d5-eaa7-46d9-bc69-56e6e0b9c003 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:19:54.808054 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1439/2869] 10.222.0.117 () {58 vars in 1126 bytes} [Tue Jan 25 03:19:54 2022] GET /identity/v3/roles => generated 1427 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 03:19:54.812302 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a0e251-1781-4c85-9107-b4bd45470075 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:19:54.823047 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a0e251-1781-4c85-9107-b4bd45470075 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:19:54.827668 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd95afb-7df2-42cc-917b-2241b5622795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:19:54.828571 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd95afb-7df2-42cc-917b-2241b5622795 admin admin] REQUEST_METHOD: `PUT` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:19:54.828858 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd95afb-7df2-42cc-917b-2241b5622795 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:19:54.829135 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd95afb-7df2-42cc-917b-2241b5622795 admin admin] PATH_INFO: `/v3/projects/1953aa8c53c0449c95934e919982ca3f/users/a11f4abfbd73499db816cf8005ed3859/roles/33a8e87420ed423f9cb29e0084eab5d2` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:19:54.843357 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd95afb-7df2-42cc-917b-2241b5622795 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1953aa8c53c0449c95934e919982ca3f, user_id=a11f4abfbd73499db816cf8005ed3859, role_id=33a8e87420ed423f9cb29e0084eab5d2)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:19:54.846046 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd95afb-7df2-42cc-917b-2241b5622795 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:19:54.858886 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1431/2870] 10.222.0.117 () {60 vars in 1487 bytes} [Tue Jan 25 03:19:54 2022] PUT /identity/v3/projects/1953aa8c53c0449c95934e919982ca3f/users/a11f4abfbd73499db816cf8005ed3859/roles/33a8e87420ed423f9cb29e0084eab5d2 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:19:54.864161 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea5c5b4-d506-4c38-83c1-4f63e7ae11ef None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:19:54.864457 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea5c5b4-d506-4c38-83c1-4f63e7ae11ef None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:19:54.864753 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea5c5b4-d506-4c38-83c1-4f63e7ae11ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:19:54.883311 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-8ea5c5b4-d506-4c38-83c1-4f63e7ae11ef None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:19:54.885129 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-8ea5c5b4-d506-4c38-83c1-4f63e7ae11ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:19:54.941858 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1440/2871] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 03:19:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:19:54.952119 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd95afb-7df2-42cc-917b-2241b5622795 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:19:54.953935 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-bfd95afb-7df2-42cc-917b-2241b5622795 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:19:55.008549 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd95afb-7df2-42cc-917b-2241b5622795 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:19:55.012728 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a946e57-bd62-44b7-a00d-9775e4c4e31d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca4071c5f8f4a31b5edb81fa66a43a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:19:55.013395 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a946e57-bd62-44b7-a00d-9775e4c4e31d service neutron] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:19:55.013682 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a946e57-bd62-44b7-a00d-9775e4c4e31d service neutron] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:19:55.013961 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a946e57-bd62-44b7-a00d-9775e4c4e31d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:19:55.022834 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a946e57-bd62-44b7-a00d-9775e4c4e31d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:19:55.024344 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a946e57-bd62-44b7-a00d-9775e4c4e31d service neutron] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:19:55.033883 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1432/2872] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 03:19:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:19:55.622931 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68249f7-4b4e-47fc-946a-ed243a1e877a None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:19:55.623222 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68249f7-4b4e-47fc-946a-ed243a1e877a None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:19:55.623502 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68249f7-4b4e-47fc-946a-ed243a1e877a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:19:55.650146 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-e68249f7-4b4e-47fc-946a-ed243a1e877a None None] MFA Rules not processed for user `a11f4abfbd73499db816cf8005ed3859`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:19:55.651362 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-e68249f7-4b4e-47fc-946a-ed243a1e877a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:19:55.717682 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1441/2873] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 03:19:55 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:19:55.722120 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a946e57-bd62-44b7-a00d-9775e4c4e31d service neutron] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:19:55.731917 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a946e57-bd62-44b7-a00d-9775e4c4e31d service neutron] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:19:55.737791 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1ec245-99e4-4b95-b4ba-e9c027e52d52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:19:55.738555 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1ec245-99e4-4b95-b4ba-e9c027e52d52 admin admin] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:19:55.738902 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1ec245-99e4-4b95-b4ba-e9c027e52d52 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:19:55.739251 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1ec245-99e4-4b95-b4ba-e9c027e52d52 admin admin] PATH_INFO: `/v3/projects` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:19:55.740079 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1ec245-99e4-4b95-b4ba-e9c027e52d52 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:19:55.741975 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1ec245-99e4-4b95-b4ba-e9c027e52d52 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:19:55.770245 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1433/2874] 10.222.0.117 () {60 vars in 1157 bytes} [Tue Jan 25 03:19:55 2022] POST /identity/v3/projects => generated 406 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 25 03:19:55.774544 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68249f7-4b4e-47fc-946a-ed243a1e877a None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:19:55.785682 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68249f7-4b4e-47fc-946a-ed243a1e877a None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:19:55.841731 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d99f806-d4a1-4a87-906a-1bf11ea0c1b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:19:55.842326 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d99f806-d4a1-4a87-906a-1bf11ea0c1b1 admin admin] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:19:55.842611 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d99f806-d4a1-4a87-906a-1bf11ea0c1b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:19:55.842886 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d99f806-d4a1-4a87-906a-1bf11ea0c1b1 admin admin] PATH_INFO: `/v3/users` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:19:55.843602 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d99f806-d4a1-4a87-906a-1bf11ea0c1b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:19:55.847158 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d99f806-d4a1-4a87-906a-1bf11ea0c1b1 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:19:55.870732 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1442/2875] 10.222.0.117 () {60 vars in 1148 bytes} [Tue Jan 25 03:19:55 2022] POST /identity/v3/users => generated 310 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 03:19:55.874404 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1ec245-99e4-4b95-b4ba-e9c027e52d52 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:19:55.884594 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1ec245-99e4-4b95-b4ba-e9c027e52d52 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:19:55.889219 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac6bafd-9799-495d-9308-75edde017788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:19:55.889873 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac6bafd-9799-495d-9308-75edde017788 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:19:55.890161 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac6bafd-9799-495d-9308-75edde017788 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:19:55.890441 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac6bafd-9799-495d-9308-75edde017788 admin admin] PATH_INFO: `/v3/roles` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:19:55.891188 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac6bafd-9799-495d-9308-75edde017788 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:19:55.892829 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac6bafd-9799-495d-9308-75edde017788 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:19:55.903682 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1434/2876] 10.222.0.117 () {58 vars in 1126 bytes} [Tue Jan 25 03:19:55 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 03:19:55.907896 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d99f806-d4a1-4a87-906a-1bf11ea0c1b1 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:19:55.919524 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d99f806-d4a1-4a87-906a-1bf11ea0c1b1 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:19:55.924460 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ed4b08-e4fc-46ab-b993-71b8325a62f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:19:55.925344 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ed4b08-e4fc-46ab-b993-71b8325a62f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:19:55.925630 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ed4b08-e4fc-46ab-b993-71b8325a62f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:19:55.925906 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ed4b08-e4fc-46ab-b993-71b8325a62f3 admin admin] PATH_INFO: `/v3/projects/5ebecd0c27704502bc37f36d38e866c5/users/231705656a4e4b1c944db67b5a5aeaec/roles/d8dbc6d83d9d41d28c3feb8b3485b291` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:19:55.941750 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ed4b08-e4fc-46ab-b993-71b8325a62f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ebecd0c27704502bc37f36d38e866c5, user_id=231705656a4e4b1c944db67b5a5aeaec, role_id=d8dbc6d83d9d41d28c3feb8b3485b291)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:19:55.944454 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ed4b08-e4fc-46ab-b993-71b8325a62f3 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:19:55.958985 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1443/2877] 10.222.0.117 () {60 vars in 1487 bytes} [Tue Jan 25 03:19:55 2022] PUT /identity/v3/projects/5ebecd0c27704502bc37f36d38e866c5/users/231705656a4e4b1c944db67b5a5aeaec/roles/d8dbc6d83d9d41d28c3feb8b3485b291 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 25 03:19:55.963574 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac6bafd-9799-495d-9308-75edde017788 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:19:55.973354 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac6bafd-9799-495d-9308-75edde017788 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:19:56.028322 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc40cb9-82bd-4430-a8ff-1e3ca6a58a37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:19:56.028985 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc40cb9-82bd-4430-a8ff-1e3ca6a58a37 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:19:56.029270 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc40cb9-82bd-4430-a8ff-1e3ca6a58a37 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:19:56.029548 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc40cb9-82bd-4430-a8ff-1e3ca6a58a37 admin admin] PATH_INFO: `/v3/roles` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:19:56.030286 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc40cb9-82bd-4430-a8ff-1e3ca6a58a37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:19:56.031922 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc40cb9-82bd-4430-a8ff-1e3ca6a58a37 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:19:56.041786 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1435/2878] 10.222.0.117 () {58 vars in 1126 bytes} [Tue Jan 25 03:19:55 2022] GET /identity/v3/roles => generated 1427 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 25 03:19:56.045881 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ed4b08-e4fc-46ab-b993-71b8325a62f3 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:19:56.055998 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ed4b08-e4fc-46ab-b993-71b8325a62f3 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:19:56.060852 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d746fcd9-9a9a-4b22-abef-bd1d33f18664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:19:56.061728 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d746fcd9-9a9a-4b22-abef-bd1d33f18664 admin admin] REQUEST_METHOD: `PUT` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:19:56.062012 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d746fcd9-9a9a-4b22-abef-bd1d33f18664 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:19:56.062288 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d746fcd9-9a9a-4b22-abef-bd1d33f18664 admin admin] PATH_INFO: `/v3/projects/5ebecd0c27704502bc37f36d38e866c5/users/231705656a4e4b1c944db67b5a5aeaec/roles/d8dbc6d83d9d41d28c3feb8b3485b291` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:19:56.064339 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d746fcd9-9a9a-4b22-abef-bd1d33f18664 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ebecd0c27704502bc37f36d38e866c5, user_id=231705656a4e4b1c944db67b5a5aeaec, role_id=d8dbc6d83d9d41d28c3feb8b3485b291)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:19:56.067003 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d746fcd9-9a9a-4b22-abef-bd1d33f18664 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:19:56.077555 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1444/2879] 10.222.0.117 () {60 vars in 1487 bytes} [Tue Jan 25 03:19:56 2022] PUT /identity/v3/projects/5ebecd0c27704502bc37f36d38e866c5/users/231705656a4e4b1c944db67b5a5aeaec/roles/d8dbc6d83d9d41d28c3feb8b3485b291 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:19:56.668935 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5263a1c6-bb67-49c5-aa57-dd09ea3db958 None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:19:56.669308 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5263a1c6-bb67-49c5-aa57-dd09ea3db958 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:19:56.669590 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5263a1c6-bb67-49c5-aa57-dd09ea3db958 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:19:56.701991 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-5263a1c6-bb67-49c5-aa57-dd09ea3db958 None None] MFA Rules not processed for user `231705656a4e4b1c944db67b5a5aeaec`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:19:56.703215 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-5263a1c6-bb67-49c5-aa57-dd09ea3db958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:19:56.771017 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1436/2880] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 03:19:56 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:19:57.785445 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d746fcd9-9a9a-4b22-abef-bd1d33f18664 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:19:57.848193 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d746fcd9-9a9a-4b22-abef-bd1d33f18664 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:19:57.853395 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45f698f-f4a2-4f53-b2ba-92a295a18038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:19:57.854394 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45f698f-f4a2-4f53-b2ba-92a295a18038 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:19:57.854674 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45f698f-f4a2-4f53-b2ba-92a295a18038 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:19:57.854947 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45f698f-f4a2-4f53-b2ba-92a295a18038 admin admin] PATH_INFO: `/v3/users/a11f4abfbd73499db816cf8005ed3859` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:19:57.856174 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45f698f-f4a2-4f53-b2ba-92a295a18038 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a11f4abfbd73499db816cf8005ed3859)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:19:57.858090 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45f698f-f4a2-4f53-b2ba-92a295a18038 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:19:57.902223 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-b45f698f-f4a2-4f53-b2ba-92a295a18038 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a11f4abfbd73499db816cf8005ed3859'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:19:57.902870 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-b45f698f-f4a2-4f53-b2ba-92a295a18038 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a11f4abfbd73499db816cf8005ed3859'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:19:57.909492 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-b45f698f-f4a2-4f53-b2ba-92a295a18038 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a11f4abfbd73499db816cf8005ed3859'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:19:57.910285 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-b45f698f-f4a2-4f53-b2ba-92a295a18038 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a11f4abfbd73499db816cf8005ed3859'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:19:57.918395 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-b45f698f-f4a2-4f53-b2ba-92a295a18038 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a11f4abfbd73499db816cf8005ed3859'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:19:57.936269 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1445/2881] 10.222.0.117 () {58 vars in 1228 bytes} [Tue Jan 25 03:19:57 2022] DELETE /identity/v3/users/a11f4abfbd73499db816cf8005ed3859 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:19:58.104923 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5263a1c6-bb67-49c5-aa57-dd09ea3db958 None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:19:58.116220 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5263a1c6-bb67-49c5-aa57-dd09ea3db958 None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:19:58.175079 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5235b303-4278-476e-a495-dd24ea2c5d1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:19:58.175967 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5235b303-4278-476e-a495-dd24ea2c5d1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:19:58.176248 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5235b303-4278-476e-a495-dd24ea2c5d1a admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:19:58.176520 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5235b303-4278-476e-a495-dd24ea2c5d1a admin admin] PATH_INFO: `/v3/projects/1953aa8c53c0449c95934e919982ca3f` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:19:58.177707 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5235b303-4278-476e-a495-dd24ea2c5d1a admin admin] RBAC: Authorizing `identity:delete_project(project_id=1953aa8c53c0449c95934e919982ca3f)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:19:58.179595 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5235b303-4278-476e-a495-dd24ea2c5d1a admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:19:58.225897 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-5235b303-4278-476e-a495-dd24ea2c5d1a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1953aa8c53c0449c95934e919982ca3f', 'request_id': 'req-5235b303-4278-476e-a495-dd24ea2c5d1a'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:19:58.231227 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-5235b303-4278-476e-a495-dd24ea2c5d1a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1953aa8c53c0449c95934e919982ca3f', 'request_id': 'req-5235b303-4278-476e-a495-dd24ea2c5d1a'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:19:58.237311 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-5235b303-4278-476e-a495-dd24ea2c5d1a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1953aa8c53c0449c95934e919982ca3f', 'request_id': 'req-5235b303-4278-476e-a495-dd24ea2c5d1a'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:19:58.251743 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-5235b303-4278-476e-a495-dd24ea2c5d1a admin admin] The token cache is being invalidate because project 1953aa8c53c0449c95934e919982ca3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79120) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 25 03:19:58.252057 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-5235b303-4278-476e-a495-dd24ea2c5d1a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:19:58.252693 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-5235b303-4278-476e-a495-dd24ea2c5d1a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:19:58.254265 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1437/2882] 10.222.0.117 () {58 vars in 1237 bytes} [Tue Jan 25 03:19:58 2022] DELETE /identity/v3/projects/1953aa8c53c0449c95934e919982ca3f => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:19:58.258422 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45f698f-f4a2-4f53-b2ba-92a295a18038 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:19:58.260446 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-b45f698f-f4a2-4f53-b2ba-92a295a18038 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:19:58.273184 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45f698f-f4a2-4f53-b2ba-92a295a18038 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:19:58.328682 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33b407d-63da-4070-bdc4-da0e64e43d4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:19:58.330185 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33b407d-63da-4070-bdc4-da0e64e43d4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:19:58.330473 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33b407d-63da-4070-bdc4-da0e64e43d4c admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:19:58.330752 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33b407d-63da-4070-bdc4-da0e64e43d4c admin admin] PATH_INFO: `/v3/users/231705656a4e4b1c944db67b5a5aeaec` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:19:58.331988 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33b407d-63da-4070-bdc4-da0e64e43d4c admin admin] RBAC: Authorizing `identity:delete_user(user_id=231705656a4e4b1c944db67b5a5aeaec)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:19:58.333918 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33b407d-63da-4070-bdc4-da0e64e43d4c admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:19:58.376938 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-f33b407d-63da-4070-bdc4-da0e64e43d4c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '231705656a4e4b1c944db67b5a5aeaec'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:19:58.377585 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-f33b407d-63da-4070-bdc4-da0e64e43d4c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '231705656a4e4b1c944db67b5a5aeaec'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:19:58.384907 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-f33b407d-63da-4070-bdc4-da0e64e43d4c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '231705656a4e4b1c944db67b5a5aeaec'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:19:58.385553 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-f33b407d-63da-4070-bdc4-da0e64e43d4c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '231705656a4e4b1c944db67b5a5aeaec'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:19:58.392452 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-f33b407d-63da-4070-bdc4-da0e64e43d4c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '231705656a4e4b1c944db67b5a5aeaec'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:19:58.409867 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1446/2883] 10.222.0.117 () {58 vars in 1228 bytes} [Tue Jan 25 03:19:58 2022] DELETE /identity/v3/users/231705656a4e4b1c944db67b5a5aeaec => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:19:58.578676 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5235b303-4278-476e-a495-dd24ea2c5d1a admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:19:58.580197 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-5235b303-4278-476e-a495-dd24ea2c5d1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:19:58.593284 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5235b303-4278-476e-a495-dd24ea2c5d1a admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:19:58.649262 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771d438b-50e7-4df8-9976-ce7b67725e9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:19:58.650798 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771d438b-50e7-4df8-9976-ce7b67725e9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:19:58.651084 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771d438b-50e7-4df8-9976-ce7b67725e9e admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:19:58.651391 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771d438b-50e7-4df8-9976-ce7b67725e9e admin admin] PATH_INFO: `/v3/projects/5ebecd0c27704502bc37f36d38e866c5` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:19:58.652639 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771d438b-50e7-4df8-9976-ce7b67725e9e admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ebecd0c27704502bc37f36d38e866c5)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:19:58.654553 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771d438b-50e7-4df8-9976-ce7b67725e9e admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:19:58.701867 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-771d438b-50e7-4df8-9976-ce7b67725e9e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ebecd0c27704502bc37f36d38e866c5', 'request_id': 'req-771d438b-50e7-4df8-9976-ce7b67725e9e'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:19:58.707177 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-771d438b-50e7-4df8-9976-ce7b67725e9e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ebecd0c27704502bc37f36d38e866c5', 'request_id': 'req-771d438b-50e7-4df8-9976-ce7b67725e9e'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:19:58.713860 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-771d438b-50e7-4df8-9976-ce7b67725e9e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ebecd0c27704502bc37f36d38e866c5', 'request_id': 'req-771d438b-50e7-4df8-9976-ce7b67725e9e'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:19:58.725424 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-771d438b-50e7-4df8-9976-ce7b67725e9e admin admin] The token cache is being invalidate because project 5ebecd0c27704502bc37f36d38e866c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79120) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 25 03:19:58.725710 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-771d438b-50e7-4df8-9976-ce7b67725e9e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:19:58.726322 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-771d438b-50e7-4df8-9976-ce7b67725e9e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:19:58.728517 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1438/2884] 10.222.0.117 () {58 vars in 1237 bytes} [Tue Jan 25 03:19:58 2022] DELETE /identity/v3/projects/5ebecd0c27704502bc37f36d38e866c5 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:19:58.734254 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1c5ca6-a20f-4633-b24c-42db0c6167c1 None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:19:58.734551 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1c5ca6-a20f-4633-b24c-42db0c6167c1 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:19:58.734835 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1c5ca6-a20f-4633-b24c-42db0c6167c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:19:58.752279 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-ce1c5ca6-a20f-4633-b24c-42db0c6167c1 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:19:58.753423 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-ce1c5ca6-a20f-4633-b24c-42db0c6167c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:19:58.811470 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1447/2885] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 03:19:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 25 03:19:58.819335 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f5bb1b-aea1-4cd1-868b-7bf66b56b13f None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:19:58.819628 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f5bb1b-aea1-4cd1-868b-7bf66b56b13f None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:19:58.819934 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f5bb1b-aea1-4cd1-868b-7bf66b56b13f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:19:58.839205 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-d5f5bb1b-aea1-4cd1-868b-7bf66b56b13f None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:19:58.840455 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-d5f5bb1b-aea1-4cd1-868b-7bf66b56b13f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:19:58.848296 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1439/2886] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 03:19:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:19:58.852489 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1c5ca6-a20f-4633-b24c-42db0c6167c1 None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:19:58.862710 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1c5ca6-a20f-4633-b24c-42db0c6167c1 None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:19:58.867266 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332c7499-1f82-4860-abef-f153a447ae64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:19:58.867951 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332c7499-1f82-4860-abef-f153a447ae64 admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:19:58.868239 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332c7499-1f82-4860-abef-f153a447ae64 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:19:58.868545 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332c7499-1f82-4860-abef-f153a447ae64 admin admin] PATH_INFO: `/v3/domains` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:19:58.869314 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332c7499-1f82-4860-abef-f153a447ae64 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:19:58.869626 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332c7499-1f82-4860-abef-f153a447ae64 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:19:58.871243 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332c7499-1f82-4860-abef-f153a447ae64 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:19:58.882479 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1448/2887] 10.222.0.117 () {58 vars in 1157 bytes} [Tue Jan 25 03:19:58 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:19:58.886859 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f5bb1b-aea1-4cd1-868b-7bf66b56b13f None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:19:58.895933 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f5bb1b-aea1-4cd1-868b-7bf66b56b13f None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:19:58.901194 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dd698c-a775-439c-8247-2b73db4df93a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:19:58.901843 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dd698c-a775-439c-8247-2b73db4df93a admin admin] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:19:58.902128 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dd698c-a775-439c-8247-2b73db4df93a admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:19:58.902404 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dd698c-a775-439c-8247-2b73db4df93a admin admin] PATH_INFO: `/v3/projects` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:19:58.903135 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dd698c-a775-439c-8247-2b73db4df93a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:19:58.905091 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dd698c-a775-439c-8247-2b73db4df93a admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:19:58.930242 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1440/2888] 10.222.0.117 () {60 vars in 1157 bytes} [Tue Jan 25 03:19:58 2022] POST /identity/v3/projects => generated 382 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 03:19:58.934779 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332c7499-1f82-4860-abef-f153a447ae64 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:19:58.944860 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332c7499-1f82-4860-abef-f153a447ae64 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:19:58.999545 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf55816-c9fc-44eb-913d-871b876f06d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:19:59.000269 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf55816-c9fc-44eb-913d-871b876f06d2 admin admin] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:19:59.000557 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf55816-c9fc-44eb-913d-871b876f06d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:19:59.000838 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf55816-c9fc-44eb-913d-871b876f06d2 admin admin] PATH_INFO: `/v3/users` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:19:59.001540 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf55816-c9fc-44eb-913d-871b876f06d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:19:59.003530 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf55816-c9fc-44eb-913d-871b876f06d2 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:19:59.024074 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1449/2889] 10.222.0.117 () {60 vars in 1148 bytes} [Tue Jan 25 03:19:58 2022] POST /identity/v3/users => generated 292 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 03:19:59.028972 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dd698c-a775-439c-8247-2b73db4df93a admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:19:59.039244 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dd698c-a775-439c-8247-2b73db4df93a admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:19:59.043962 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c39e44-ec5b-40d3-88a7-f51b74b2e406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:19:59.044612 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c39e44-ec5b-40d3-88a7-f51b74b2e406 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:19:59.044904 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c39e44-ec5b-40d3-88a7-f51b74b2e406 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:19:59.045182 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c39e44-ec5b-40d3-88a7-f51b74b2e406 admin admin] PATH_INFO: `/v3/roles` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:19:59.045923 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c39e44-ec5b-40d3-88a7-f51b74b2e406 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:19:59.047527 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c39e44-ec5b-40d3-88a7-f51b74b2e406 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:19:59.058124 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1441/2890] 10.222.0.117 () {58 vars in 1126 bytes} [Tue Jan 25 03:19:59 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 03:19:59.062034 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf55816-c9fc-44eb-913d-871b876f06d2 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:19:59.072425 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf55816-c9fc-44eb-913d-871b876f06d2 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:19:59.077197 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2781ced2-f0e0-4ae8-9e56-3b94a13bea6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:19:59.077845 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2781ced2-f0e0-4ae8-9e56-3b94a13bea6a admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:19:59.078133 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2781ced2-f0e0-4ae8-9e56-3b94a13bea6a admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:19:59.078413 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2781ced2-f0e0-4ae8-9e56-3b94a13bea6a admin admin] PATH_INFO: `/v3/roles` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:19:59.079159 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2781ced2-f0e0-4ae8-9e56-3b94a13bea6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:19:59.080802 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2781ced2-f0e0-4ae8-9e56-3b94a13bea6a admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:19:59.090970 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1450/2891] 10.222.0.117 () {58 vars in 1126 bytes} [Tue Jan 25 03:19:59 2022] GET /identity/v3/roles => generated 1427 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 03:19:59.094893 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c39e44-ec5b-40d3-88a7-f51b74b2e406 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:19:59.104743 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c39e44-ec5b-40d3-88a7-f51b74b2e406 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:19:59.109399 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c548ae6-cc25-4224-bf52-7a71c610216a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:19:59.110290 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c548ae6-cc25-4224-bf52-7a71c610216a admin admin] REQUEST_METHOD: `PUT` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:19:59.110574 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c548ae6-cc25-4224-bf52-7a71c610216a admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:19:59.110846 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c548ae6-cc25-4224-bf52-7a71c610216a admin admin] PATH_INFO: `/v3/projects/ae26a54bbce240abb8e06c8e5b1c5bc7/users/2dc5c9e4eaf54680a4f93d5c1bf71aaf/roles/33a8e87420ed423f9cb29e0084eab5d2` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:19:59.125085 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c548ae6-cc25-4224-bf52-7a71c610216a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae26a54bbce240abb8e06c8e5b1c5bc7, user_id=2dc5c9e4eaf54680a4f93d5c1bf71aaf, role_id=33a8e87420ed423f9cb29e0084eab5d2)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:19:59.127767 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c548ae6-cc25-4224-bf52-7a71c610216a admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:19:59.141634 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1442/2892] 10.222.0.117 () {60 vars in 1487 bytes} [Tue Jan 25 03:19:59 2022] PUT /identity/v3/projects/ae26a54bbce240abb8e06c8e5b1c5bc7/users/2dc5c9e4eaf54680a4f93d5c1bf71aaf/roles/33a8e87420ed423f9cb29e0084eab5d2 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 25 03:19:59.153512 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1e759e-2b84-412c-9900-6dba7a2b1da7 None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:19:59.153805 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1e759e-2b84-412c-9900-6dba7a2b1da7 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:19:59.154087 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1e759e-2b84-412c-9900-6dba7a2b1da7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:19:59.179798 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-7d1e759e-2b84-412c-9900-6dba7a2b1da7 None None] MFA Rules not processed for user `2dc5c9e4eaf54680a4f93d5c1bf71aaf`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:19:59.181132 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-7d1e759e-2b84-412c-9900-6dba7a2b1da7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:19:59.243540 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1451/2893] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 03:19:59 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:19:59.248196 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c548ae6-cc25-4224-bf52-7a71c610216a admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:19:59.310157 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c548ae6-cc25-4224-bf52-7a71c610216a admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:19:59.314656 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0c2564-bea6-446c-b87d-70095c93f1cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:19:59.315328 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0c2564-bea6-446c-b87d-70095c93f1cd admin admin] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:19:59.315609 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0c2564-bea6-446c-b87d-70095c93f1cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:19:59.315979 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0c2564-bea6-446c-b87d-70095c93f1cd admin admin] PATH_INFO: `/v3/projects` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:19:59.316681 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0c2564-bea6-446c-b87d-70095c93f1cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:19:59.318604 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0c2564-bea6-446c-b87d-70095c93f1cd admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:19:59.343858 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1443/2894] 10.222.0.117 () {60 vars in 1157 bytes} [Tue Jan 25 03:19:59 2022] POST /identity/v3/projects => generated 382 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 03:19:59.347605 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1e759e-2b84-412c-9900-6dba7a2b1da7 None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:19:59.358212 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1e759e-2b84-412c-9900-6dba7a2b1da7 None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:19:59.411877 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab75a0d0-b54e-4d6e-956a-3c234dcbc658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:19:59.412539 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab75a0d0-b54e-4d6e-956a-3c234dcbc658 admin admin] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:19:59.412826 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab75a0d0-b54e-4d6e-956a-3c234dcbc658 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:19:59.413105 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab75a0d0-b54e-4d6e-956a-3c234dcbc658 admin admin] PATH_INFO: `/v3/users` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:19:59.414066 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab75a0d0-b54e-4d6e-956a-3c234dcbc658 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:19:59.416211 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab75a0d0-b54e-4d6e-956a-3c234dcbc658 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:19:59.435590 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1452/2895] 10.222.0.117 () {60 vars in 1148 bytes} [Tue Jan 25 03:19:59 2022] POST /identity/v3/users => generated 298 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 03:19:59.439610 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0c2564-bea6-446c-b87d-70095c93f1cd admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:19:59.450515 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0c2564-bea6-446c-b87d-70095c93f1cd admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:19:59.455173 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca73ca0-dd2d-4ed2-a339-6687952c476c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:19:59.455870 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca73ca0-dd2d-4ed2-a339-6687952c476c admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:19:59.456155 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca73ca0-dd2d-4ed2-a339-6687952c476c admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:19:59.456460 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca73ca0-dd2d-4ed2-a339-6687952c476c admin admin] PATH_INFO: `/v3/roles` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:19:59.457198 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca73ca0-dd2d-4ed2-a339-6687952c476c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:19:59.458798 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca73ca0-dd2d-4ed2-a339-6687952c476c admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:19:59.469058 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1444/2896] 10.222.0.117 () {58 vars in 1126 bytes} [Tue Jan 25 03:19:59 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 25 03:19:59.473071 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab75a0d0-b54e-4d6e-956a-3c234dcbc658 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:19:59.482865 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab75a0d0-b54e-4d6e-956a-3c234dcbc658 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:19:59.487548 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d809cb9-2c2c-460c-89f2-43d442e1f1c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:19:59.488454 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d809cb9-2c2c-460c-89f2-43d442e1f1c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:19:59.488742 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d809cb9-2c2c-460c-89f2-43d442e1f1c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:19:59.489021 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d809cb9-2c2c-460c-89f2-43d442e1f1c2 admin admin] PATH_INFO: `/v3/projects/f1e9c63c39854969bf605d904fe94876/users/dd044a02c8b24cacac93ae384a31084d/roles/d8dbc6d83d9d41d28c3feb8b3485b291` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:19:59.503707 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d809cb9-2c2c-460c-89f2-43d442e1f1c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1e9c63c39854969bf605d904fe94876, user_id=dd044a02c8b24cacac93ae384a31084d, role_id=d8dbc6d83d9d41d28c3feb8b3485b291)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:19:59.506409 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d809cb9-2c2c-460c-89f2-43d442e1f1c2 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:19:59.519506 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1453/2897] 10.222.0.117 () {60 vars in 1487 bytes} [Tue Jan 25 03:19:59 2022] PUT /identity/v3/projects/f1e9c63c39854969bf605d904fe94876/users/dd044a02c8b24cacac93ae384a31084d/roles/d8dbc6d83d9d41d28c3feb8b3485b291 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:19:59.523479 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca73ca0-dd2d-4ed2-a339-6687952c476c admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:19:59.533752 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca73ca0-dd2d-4ed2-a339-6687952c476c admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:19:59.588030 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503a8232-1f10-4b70-8def-8377a5c91c3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:19:59.588612 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503a8232-1f10-4b70-8def-8377a5c91c3b admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:19:59.588892 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503a8232-1f10-4b70-8def-8377a5c91c3b admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:19:59.589164 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503a8232-1f10-4b70-8def-8377a5c91c3b admin admin] PATH_INFO: `/v3/roles` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:19:59.589893 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503a8232-1f10-4b70-8def-8377a5c91c3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:19:59.591485 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503a8232-1f10-4b70-8def-8377a5c91c3b admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:19:59.601444 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1445/2898] 10.222.0.117 () {58 vars in 1126 bytes} [Tue Jan 25 03:19:59 2022] GET /identity/v3/roles => generated 1427 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 03:19:59.605562 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d809cb9-2c2c-460c-89f2-43d442e1f1c2 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:19:59.615747 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d809cb9-2c2c-460c-89f2-43d442e1f1c2 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:19:59.621219 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dc83ce-ce58-434d-9c6d-f9967076e29d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:19:59.622097 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dc83ce-ce58-434d-9c6d-f9967076e29d admin admin] REQUEST_METHOD: `PUT` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:19:59.622389 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dc83ce-ce58-434d-9c6d-f9967076e29d admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:19:59.622690 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dc83ce-ce58-434d-9c6d-f9967076e29d admin admin] PATH_INFO: `/v3/projects/f1e9c63c39854969bf605d904fe94876/users/dd044a02c8b24cacac93ae384a31084d/roles/d8dbc6d83d9d41d28c3feb8b3485b291` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:19:59.624759 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dc83ce-ce58-434d-9c6d-f9967076e29d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1e9c63c39854969bf605d904fe94876, user_id=dd044a02c8b24cacac93ae384a31084d, role_id=d8dbc6d83d9d41d28c3feb8b3485b291)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:19:59.627464 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dc83ce-ce58-434d-9c6d-f9967076e29d admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:19:59.638302 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1454/2899] 10.222.0.117 () {60 vars in 1487 bytes} [Tue Jan 25 03:19:59 2022] PUT /identity/v3/projects/f1e9c63c39854969bf605d904fe94876/users/dd044a02c8b24cacac93ae384a31084d/roles/d8dbc6d83d9d41d28c3feb8b3485b291 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:19:59.648333 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b159cb-b83d-4522-a18c-cab41e5e7c14 None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:19:59.648624 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b159cb-b83d-4522-a18c-cab41e5e7c14 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:19:59.648901 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b159cb-b83d-4522-a18c-cab41e5e7c14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:19:59.676398 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-68b159cb-b83d-4522-a18c-cab41e5e7c14 None None] MFA Rules not processed for user `dd044a02c8b24cacac93ae384a31084d`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:19:59.677601 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-68b159cb-b83d-4522-a18c-cab41e5e7c14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:19:59.744230 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1446/2900] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 03:19:59 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:19:59.753720 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dc83ce-ce58-434d-9c6d-f9967076e29d admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:19:59.755433 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-d1dc83ce-ce58-434d-9c6d-f9967076e29d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:19:59.811600 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dc83ce-ce58-434d-9c6d-f9967076e29d admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:19:59.815554 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326058c3-8e85-45a4-8877-e20d71e1615b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cc5249aea09430080e232cf17757f86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:19:59.816227 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326058c3-8e85-45a4-8877-e20d71e1615b service cinder] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:19:59.816517 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326058c3-8e85-45a4-8877-e20d71e1615b service cinder] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:19:59.816796 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326058c3-8e85-45a4-8877-e20d71e1615b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:19:59.825791 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326058c3-8e85-45a4-8877-e20d71e1615b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:19:59.827244 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326058c3-8e85-45a4-8877-e20d71e1615b service cinder] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:19:59.836525 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1455/2901] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 03:19:59 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 25 03:19:59.928388 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b159cb-b83d-4522-a18c-cab41e5e7c14 None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:19:59.937948 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b159cb-b83d-4522-a18c-cab41e5e7c14 None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:19:59.941570 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b1b39d-265c-44dd-8282-138f328d0135 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cc5249aea09430080e232cf17757f86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:19:59.942200 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b1b39d-265c-44dd-8282-138f328d0135 service cinder] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:19:59.942481 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b1b39d-265c-44dd-8282-138f328d0135 service cinder] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:19:59.942752 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b1b39d-265c-44dd-8282-138f328d0135 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:19:59.997525 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b1b39d-265c-44dd-8282-138f328d0135 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:19:59.998967 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b1b39d-265c-44dd-8282-138f328d0135 service cinder] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:20:00.007748 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1447/2902] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 03:19:59 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:20:02.538195 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326058c3-8e85-45a4-8877-e20d71e1615b service cinder] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:20:02.599837 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326058c3-8e85-45a4-8877-e20d71e1615b service cinder] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:20:02.604723 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e231c4b-44fa-496d-addd-c3b529e51f46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:20:02.605587 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e231c4b-44fa-496d-addd-c3b529e51f46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:20:02.605866 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e231c4b-44fa-496d-addd-c3b529e51f46 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:20:02.606136 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e231c4b-44fa-496d-addd-c3b529e51f46 admin admin] PATH_INFO: `/v3/users/2dc5c9e4eaf54680a4f93d5c1bf71aaf` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:20:02.607327 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e231c4b-44fa-496d-addd-c3b529e51f46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2dc5c9e4eaf54680a4f93d5c1bf71aaf)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:20:02.609323 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e231c4b-44fa-496d-addd-c3b529e51f46 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:20:02.656558 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-6e231c4b-44fa-496d-addd-c3b529e51f46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2dc5c9e4eaf54680a4f93d5c1bf71aaf'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:20:02.657212 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-6e231c4b-44fa-496d-addd-c3b529e51f46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2dc5c9e4eaf54680a4f93d5c1bf71aaf'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:20:02.664155 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-6e231c4b-44fa-496d-addd-c3b529e51f46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2dc5c9e4eaf54680a4f93d5c1bf71aaf'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:20:02.664779 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-6e231c4b-44fa-496d-addd-c3b529e51f46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2dc5c9e4eaf54680a4f93d5c1bf71aaf'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:20:02.671920 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-6e231c4b-44fa-496d-addd-c3b529e51f46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2dc5c9e4eaf54680a4f93d5c1bf71aaf'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:20:02.690482 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1456/2903] 10.222.0.117 () {58 vars in 1228 bytes} [Tue Jan 25 03:20:02 2022] DELETE /identity/v3/users/2dc5c9e4eaf54680a4f93d5c1bf71aaf => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:20:02.694999 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d08e19-a87a-44ef-b573-dd8e0916e303 None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:20:02.695475 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d08e19-a87a-44ef-b573-dd8e0916e303 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:20:02.695590 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d08e19-a87a-44ef-b573-dd8e0916e303 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:20:02.714272 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-37d08e19-a87a-44ef-b573-dd8e0916e303 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:20:02.715465 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-37d08e19-a87a-44ef-b573-dd8e0916e303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:20:02.772731 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1448/2904] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 03:20:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:20:02.782372 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e231c4b-44fa-496d-addd-c3b529e51f46 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:20:02.783820 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-6e231c4b-44fa-496d-addd-c3b529e51f46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:20:02.840695 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e231c4b-44fa-496d-addd-c3b529e51f46 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:20:02.844264 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25dda2d-465e-4ed9-a732-7976ea2951f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca4071c5f8f4a31b5edb81fa66a43a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:20:02.844896 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25dda2d-465e-4ed9-a732-7976ea2951f8 service neutron] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:20:02.845177 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25dda2d-465e-4ed9-a732-7976ea2951f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:20:02.845448 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25dda2d-465e-4ed9-a732-7976ea2951f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:20:02.854563 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25dda2d-465e-4ed9-a732-7976ea2951f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:20:02.856036 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25dda2d-465e-4ed9-a732-7976ea2951f8 service neutron] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:20:02.865050 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1457/2905] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 03:20:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:20:03.124666 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d08e19-a87a-44ef-b573-dd8e0916e303 None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:20:03.126181 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-37d08e19-a87a-44ef-b573-dd8e0916e303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:20:03.138380 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d08e19-a87a-44ef-b573-dd8e0916e303 None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:20:03.143497 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bd4012-4afe-41c7-81eb-db6aa9d4ac9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:20:03.144477 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bd4012-4afe-41c7-81eb-db6aa9d4ac9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:20:03.144845 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bd4012-4afe-41c7-81eb-db6aa9d4ac9a admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:20:03.145195 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bd4012-4afe-41c7-81eb-db6aa9d4ac9a admin admin] PATH_INFO: `/v3/projects/ae26a54bbce240abb8e06c8e5b1c5bc7` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:20:03.146450 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bd4012-4afe-41c7-81eb-db6aa9d4ac9a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae26a54bbce240abb8e06c8e5b1c5bc7)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:20:03.148467 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bd4012-4afe-41c7-81eb-db6aa9d4ac9a admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:20:03.198435 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-60bd4012-4afe-41c7-81eb-db6aa9d4ac9a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae26a54bbce240abb8e06c8e5b1c5bc7', 'request_id': 'req-60bd4012-4afe-41c7-81eb-db6aa9d4ac9a'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:20:03.203833 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-60bd4012-4afe-41c7-81eb-db6aa9d4ac9a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae26a54bbce240abb8e06c8e5b1c5bc7', 'request_id': 'req-60bd4012-4afe-41c7-81eb-db6aa9d4ac9a'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:20:03.210162 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-60bd4012-4afe-41c7-81eb-db6aa9d4ac9a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae26a54bbce240abb8e06c8e5b1c5bc7', 'request_id': 'req-60bd4012-4afe-41c7-81eb-db6aa9d4ac9a'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:20:03.223196 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-60bd4012-4afe-41c7-81eb-db6aa9d4ac9a admin admin] The token cache is being invalidate because project ae26a54bbce240abb8e06c8e5b1c5bc7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79120) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 25 03:20:03.223484 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-60bd4012-4afe-41c7-81eb-db6aa9d4ac9a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:20:03.224158 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-60bd4012-4afe-41c7-81eb-db6aa9d4ac9a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:20:03.225762 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1449/2906] 10.222.0.117 () {58 vars in 1237 bytes} [Tue Jan 25 03:20:03 2022] DELETE /identity/v3/projects/ae26a54bbce240abb8e06c8e5b1c5bc7 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:20:03.230523 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25dda2d-465e-4ed9-a732-7976ea2951f8 service neutron] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:20:03.239918 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25dda2d-465e-4ed9-a732-7976ea2951f8 service neutron] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:20:03.293501 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77835e75-8430-4790-ad49-8b934ea792e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:20:03.294359 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77835e75-8430-4790-ad49-8b934ea792e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:20:03.294644 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77835e75-8430-4790-ad49-8b934ea792e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:20:03.294920 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77835e75-8430-4790-ad49-8b934ea792e4 admin admin] PATH_INFO: `/v3/users/dd044a02c8b24cacac93ae384a31084d` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:20:03.296126 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77835e75-8430-4790-ad49-8b934ea792e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd044a02c8b24cacac93ae384a31084d)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:20:03.298049 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77835e75-8430-4790-ad49-8b934ea792e4 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:20:03.343386 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-77835e75-8430-4790-ad49-8b934ea792e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd044a02c8b24cacac93ae384a31084d'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:20:03.344361 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-77835e75-8430-4790-ad49-8b934ea792e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd044a02c8b24cacac93ae384a31084d'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:20:03.351020 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-77835e75-8430-4790-ad49-8b934ea792e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd044a02c8b24cacac93ae384a31084d'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:20:03.351643 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-77835e75-8430-4790-ad49-8b934ea792e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd044a02c8b24cacac93ae384a31084d'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:20:03.359441 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-77835e75-8430-4790-ad49-8b934ea792e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd044a02c8b24cacac93ae384a31084d'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:20:03.376401 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1458/2907] 10.222.0.117 () {58 vars in 1228 bytes} [Tue Jan 25 03:20:03 2022] DELETE /identity/v3/users/dd044a02c8b24cacac93ae384a31084d => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:20:03.638969 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bd4012-4afe-41c7-81eb-db6aa9d4ac9a admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:20:03.640501 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-60bd4012-4afe-41c7-81eb-db6aa9d4ac9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:20:03.654397 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bd4012-4afe-41c7-81eb-db6aa9d4ac9a admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:20:03.710690 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c256228-c68b-4422-86f5-ad1c35568cda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:20:03.711581 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c256228-c68b-4422-86f5-ad1c35568cda admin admin] REQUEST_METHOD: `DELETE` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:20:03.712439 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c256228-c68b-4422-86f5-ad1c35568cda admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:20:03.712750 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c256228-c68b-4422-86f5-ad1c35568cda admin admin] PATH_INFO: `/v3/projects/f1e9c63c39854969bf605d904fe94876` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:20:03.713944 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c256228-c68b-4422-86f5-ad1c35568cda admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1e9c63c39854969bf605d904fe94876)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:20:03.715885 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c256228-c68b-4422-86f5-ad1c35568cda admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:20:03.760230 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-3c256228-c68b-4422-86f5-ad1c35568cda admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1e9c63c39854969bf605d904fe94876', 'request_id': 'req-3c256228-c68b-4422-86f5-ad1c35568cda'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:20:03.765479 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-3c256228-c68b-4422-86f5-ad1c35568cda admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1e9c63c39854969bf605d904fe94876', 'request_id': 'req-3c256228-c68b-4422-86f5-ad1c35568cda'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:20:03.771369 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-3c256228-c68b-4422-86f5-ad1c35568cda admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1e9c63c39854969bf605d904fe94876', 'request_id': 'req-3c256228-c68b-4422-86f5-ad1c35568cda'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:20:03.783833 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-3c256228-c68b-4422-86f5-ad1c35568cda admin admin] The token cache is being invalidate because project f1e9c63c39854969bf605d904fe94876 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79120) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 25 03:20:03.784123 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-3c256228-c68b-4422-86f5-ad1c35568cda admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:20:03.784739 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-3c256228-c68b-4422-86f5-ad1c35568cda admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:20:03.786279 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1450/2908] 10.222.0.117 () {58 vars in 1237 bytes} [Tue Jan 25 03:20:03 2022] DELETE /identity/v3/projects/f1e9c63c39854969bf605d904fe94876 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:20:03.792992 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5ab185-eb3c-470a-969b-2e089da03bda None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:20:03.793475 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5ab185-eb3c-470a-969b-2e089da03bda None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:20:03.793596 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5ab185-eb3c-470a-969b-2e089da03bda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:20:03.810913 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-6e5ab185-eb3c-470a-969b-2e089da03bda None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:20:03.812248 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-6e5ab185-eb3c-470a-969b-2e089da03bda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:20:03.868866 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1459/2909] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 03:20:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:20:03.878074 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f5068d-f52e-4f19-8bf9-1a3487144578 None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:20:03.878369 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f5068d-f52e-4f19-8bf9-1a3487144578 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:20:03.878655 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f5068d-f52e-4f19-8bf9-1a3487144578 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:20:03.897169 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-b4f5068d-f52e-4f19-8bf9-1a3487144578 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:20:03.898298 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-b4f5068d-f52e-4f19-8bf9-1a3487144578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:20:03.907020 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1451/2910] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 03:20:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:20:03.911197 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5ab185-eb3c-470a-969b-2e089da03bda None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:20:03.921170 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5ab185-eb3c-470a-969b-2e089da03bda None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:20:03.925825 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f7ab5c-5043-4068-9634-3b412aaac39b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:20:03.926470 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f7ab5c-5043-4068-9634-3b412aaac39b admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:20:03.926753 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f7ab5c-5043-4068-9634-3b412aaac39b admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:20:03.927028 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f7ab5c-5043-4068-9634-3b412aaac39b admin admin] PATH_INFO: `/v3/domains` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:20:03.927800 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f7ab5c-5043-4068-9634-3b412aaac39b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79121) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 25 03:20:03.928108 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f7ab5c-5043-4068-9634-3b412aaac39b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:20:03.929713 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f7ab5c-5043-4068-9634-3b412aaac39b admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:20:03.941234 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1460/2911] 10.222.0.117 () {58 vars in 1157 bytes} [Tue Jan 25 03:20:03 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 25 03:20:03.945550 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f5068d-f52e-4f19-8bf9-1a3487144578 None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:20:03.955202 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f5068d-f52e-4f19-8bf9-1a3487144578 None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:20:03.959859 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776ceefb-1b7e-4e14-9cf9-7145dcb3fbc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:20:03.960502 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776ceefb-1b7e-4e14-9cf9-7145dcb3fbc6 admin admin] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:20:03.960785 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776ceefb-1b7e-4e14-9cf9-7145dcb3fbc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:20:03.961084 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776ceefb-1b7e-4e14-9cf9-7145dcb3fbc6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:20:03.961777 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776ceefb-1b7e-4e14-9cf9-7145dcb3fbc6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:20:03.964144 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776ceefb-1b7e-4e14-9cf9-7145dcb3fbc6 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:20:03.988928 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1452/2912] 10.222.0.117 () {60 vars in 1157 bytes} [Tue Jan 25 03:20:03 2022] POST /identity/v3/projects => generated 408 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 03:20:03.993057 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f7ab5c-5043-4068-9634-3b412aaac39b admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:20:04.003759 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f7ab5c-5043-4068-9634-3b412aaac39b admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:20:04.058628 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9aa5fa4-fbbf-4ce1-9910-1de41d5d8456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:20:04.059294 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aa5fa4-fbbf-4ce1-9910-1de41d5d8456 admin admin] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:20:04.059578 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aa5fa4-fbbf-4ce1-9910-1de41d5d8456 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:20:04.059891 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aa5fa4-fbbf-4ce1-9910-1de41d5d8456 admin admin] PATH_INFO: `/v3/users` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:20:04.060590 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9aa5fa4-fbbf-4ce1-9910-1de41d5d8456 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:20:04.062511 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9aa5fa4-fbbf-4ce1-9910-1de41d5d8456 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:20:04.081468 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1461/2913] 10.222.0.117 () {60 vars in 1148 bytes} [Tue Jan 25 03:20:03 2022] POST /identity/v3/users => generated 305 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 25 03:20:04.085795 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776ceefb-1b7e-4e14-9cf9-7145dcb3fbc6 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:20:04.096351 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776ceefb-1b7e-4e14-9cf9-7145dcb3fbc6 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:20:04.100882 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ef2b47-e485-4399-8768-5917a2a0aa6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:20:04.101524 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ef2b47-e485-4399-8768-5917a2a0aa6b admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:20:04.101804 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ef2b47-e485-4399-8768-5917a2a0aa6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:20:04.102079 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ef2b47-e485-4399-8768-5917a2a0aa6b admin admin] PATH_INFO: `/v3/roles` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:20:04.103558 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ef2b47-e485-4399-8768-5917a2a0aa6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:20:04.105254 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ef2b47-e485-4399-8768-5917a2a0aa6b admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:20:04.115296 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1453/2914] 10.222.0.117 () {58 vars in 1126 bytes} [Tue Jan 25 03:20:04 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 25 03:20:04.120150 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9aa5fa4-fbbf-4ce1-9910-1de41d5d8456 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:20:04.130690 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9aa5fa4-fbbf-4ce1-9910-1de41d5d8456 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:20:04.135456 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ebde8e-38bb-4f61-8435-0c0ab629edac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:20:04.136144 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ebde8e-38bb-4f61-8435-0c0ab629edac admin admin] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:20:04.136433 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ebde8e-38bb-4f61-8435-0c0ab629edac admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:20:04.136713 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ebde8e-38bb-4f61-8435-0c0ab629edac admin admin] PATH_INFO: `/v3/roles` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:20:04.137459 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ebde8e-38bb-4f61-8435-0c0ab629edac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:20:04.139067 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ebde8e-38bb-4f61-8435-0c0ab629edac admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:20:04.148875 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1462/2915] 10.222.0.117 () {58 vars in 1126 bytes} [Tue Jan 25 03:20:04 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 03:20:04.153162 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ef2b47-e485-4399-8768-5917a2a0aa6b admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:20:04.162951 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ef2b47-e485-4399-8768-5917a2a0aa6b admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:20:04.168727 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc631fd-dd7c-4eca-97ff-fd097e4a3ad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:20:04.169607 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc631fd-dd7c-4eca-97ff-fd097e4a3ad2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:20:04.169891 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc631fd-dd7c-4eca-97ff-fd097e4a3ad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:20:04.170170 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc631fd-dd7c-4eca-97ff-fd097e4a3ad2 admin admin] PATH_INFO: `/v3/projects/fbeaca40df5e4399952d6c829ee03dc6/users/73c522363c10406b960a0023345efa09/roles/33a8e87420ed423f9cb29e0084eab5d2` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:20:04.185248 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc631fd-dd7c-4eca-97ff-fd097e4a3ad2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbeaca40df5e4399952d6c829ee03dc6, user_id=73c522363c10406b960a0023345efa09, role_id=33a8e87420ed423f9cb29e0084eab5d2)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:20:04.187942 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc631fd-dd7c-4eca-97ff-fd097e4a3ad2 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:20:04.202332 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1454/2916] 10.222.0.117 () {60 vars in 1487 bytes} [Tue Jan 25 03:20:04 2022] PUT /identity/v3/projects/fbeaca40df5e4399952d6c829ee03dc6/users/73c522363c10406b960a0023345efa09/roles/33a8e87420ed423f9cb29e0084eab5d2 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:20:04.260714 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac05cd5-9686-4159-907a-8f980d739a06 None None] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:20:04.261032 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac05cd5-9686-4159-907a-8f980d739a06 None None] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:20:04.261311 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac05cd5-9686-4159-907a-8f980d739a06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:20:04.288307 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.auth.core [None req-aac05cd5-9686-4159-907a-8f980d739a06 None None] MFA Rules not processed for user `73c522363c10406b960a0023345efa09`. Rule list: `[]` (Enabled: `True`). {{(pid=79121) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:20:04.289795 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-aac05cd5-9686-4159-907a-8f980d739a06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:20:04.362378 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1463/2917] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 03:20:04 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:20:04.363661 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc631fd-dd7c-4eca-97ff-fd097e4a3ad2 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:20:04.424533 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc631fd-dd7c-4eca-97ff-fd097e4a3ad2 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:20:04.429493 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb45501-e439-4a96-9f01-3c316eeada67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:20:04.430315 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb45501-e439-4a96-9f01-3c316eeada67 admin admin] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:20:04.430644 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb45501-e439-4a96-9f01-3c316eeada67 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:20:04.430952 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb45501-e439-4a96-9f01-3c316eeada67 admin admin] PATH_INFO: `/v3/projects` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:20:04.432308 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb45501-e439-4a96-9f01-3c316eeada67 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:20:04.433875 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb45501-e439-4a96-9f01-3c316eeada67 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:20:04.459142 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1455/2918] 10.222.0.117 () {60 vars in 1157 bytes} [Tue Jan 25 03:20:04 2022] POST /identity/v3/projects => generated 410 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 03:20:04.464126 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac05cd5-9686-4159-907a-8f980d739a06 None None] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:20:04.474754 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac05cd5-9686-4159-907a-8f980d739a06 None None] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:20:04.531125 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eec88dc-b351-45ab-9ffa-1ab314ba5f2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:20:04.531830 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eec88dc-b351-45ab-9ffa-1ab314ba5f2c admin admin] REQUEST_METHOD: `POST` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:20:04.532119 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eec88dc-b351-45ab-9ffa-1ab314ba5f2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:20:04.532395 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eec88dc-b351-45ab-9ffa-1ab314ba5f2c admin admin] PATH_INFO: `/v3/users` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:20:04.533099 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eec88dc-b351-45ab-9ffa-1ab314ba5f2c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:20:04.535144 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eec88dc-b351-45ab-9ffa-1ab314ba5f2c admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:20:04.557388 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1464/2919] 10.222.0.117 () {60 vars in 1148 bytes} [Tue Jan 25 03:20:04 2022] POST /identity/v3/users => generated 312 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 25 03:20:04.561466 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb45501-e439-4a96-9f01-3c316eeada67 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:20:04.572134 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb45501-e439-4a96-9f01-3c316eeada67 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:20:04.576979 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca81a5de-7996-4c33-972f-ca395925fe33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:20:04.577639 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca81a5de-7996-4c33-972f-ca395925fe33 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:20:04.577928 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca81a5de-7996-4c33-972f-ca395925fe33 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:20:04.578205 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca81a5de-7996-4c33-972f-ca395925fe33 admin admin] PATH_INFO: `/v3/roles` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:20:04.578942 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca81a5de-7996-4c33-972f-ca395925fe33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:20:04.580566 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca81a5de-7996-4c33-972f-ca395925fe33 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:20:04.591643 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1456/2920] 10.222.0.117 () {58 vars in 1126 bytes} [Tue Jan 25 03:20:04 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 25 03:20:04.595869 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eec88dc-b351-45ab-9ffa-1ab314ba5f2c admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:20:04.606410 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eec88dc-b351-45ab-9ffa-1ab314ba5f2c admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:20:04.611078 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d95104e-8049-42e9-b600-1a2f115118bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:20:04.611986 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d95104e-8049-42e9-b600-1a2f115118bb admin admin] REQUEST_METHOD: `PUT` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:20:04.612270 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d95104e-8049-42e9-b600-1a2f115118bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:20:04.612570 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d95104e-8049-42e9-b600-1a2f115118bb admin admin] PATH_INFO: `/v3/projects/cfa171779f5442aea53963a84749ba99/users/bb3ef1e7a0d74d3cabb04b24ebe77cb1/roles/d8dbc6d83d9d41d28c3feb8b3485b291` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:20:04.628291 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d95104e-8049-42e9-b600-1a2f115118bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfa171779f5442aea53963a84749ba99, user_id=bb3ef1e7a0d74d3cabb04b24ebe77cb1, role_id=d8dbc6d83d9d41d28c3feb8b3485b291)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:20:04.630980 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d95104e-8049-42e9-b600-1a2f115118bb admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:20:04.643803 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1465/2921] 10.222.0.117 () {60 vars in 1487 bytes} [Tue Jan 25 03:20:04 2022] PUT /identity/v3/projects/cfa171779f5442aea53963a84749ba99/users/bb3ef1e7a0d74d3cabb04b24ebe77cb1/roles/d8dbc6d83d9d41d28c3feb8b3485b291 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:20:04.647687 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca81a5de-7996-4c33-972f-ca395925fe33 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:20:04.657870 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca81a5de-7996-4c33-972f-ca395925fe33 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:20:04.721928 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a319adb-aa8c-49e0-84dd-1732885a3f03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:20:04.722639 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a319adb-aa8c-49e0-84dd-1732885a3f03 admin admin] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:20:04.722854 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a319adb-aa8c-49e0-84dd-1732885a3f03 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:20:04.723125 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a319adb-aa8c-49e0-84dd-1732885a3f03 admin admin] PATH_INFO: `/v3/roles` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:20:04.723885 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a319adb-aa8c-49e0-84dd-1732885a3f03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:20:04.725488 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a319adb-aa8c-49e0-84dd-1732885a3f03 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:20:04.738102 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1457/2922] 10.222.0.117 () {58 vars in 1126 bytes} [Tue Jan 25 03:20:04 2022] GET /identity/v3/roles => generated 1427 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 25 03:20:04.742537 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d95104e-8049-42e9-b600-1a2f115118bb admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:20:04.755161 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d95104e-8049-42e9-b600-1a2f115118bb admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:20:04.761051 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba721a8b-edba-49b2-91e2-3deeb1d491e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:20:04.761944 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba721a8b-edba-49b2-91e2-3deeb1d491e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:20:04.762377 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba721a8b-edba-49b2-91e2-3deeb1d491e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:20:04.762790 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba721a8b-edba-49b2-91e2-3deeb1d491e8 admin admin] PATH_INFO: `/v3/projects/cfa171779f5442aea53963a84749ba99/users/bb3ef1e7a0d74d3cabb04b24ebe77cb1/roles/d8dbc6d83d9d41d28c3feb8b3485b291` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:20:04.765733 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba721a8b-edba-49b2-91e2-3deeb1d491e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfa171779f5442aea53963a84749ba99, user_id=bb3ef1e7a0d74d3cabb04b24ebe77cb1, role_id=d8dbc6d83d9d41d28c3feb8b3485b291)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:20:04.770006 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba721a8b-edba-49b2-91e2-3deeb1d491e8 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:20:04.783079 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1466/2923] 10.222.0.117 () {60 vars in 1487 bytes} [Tue Jan 25 03:20:04 2022] PUT /identity/v3/projects/cfa171779f5442aea53963a84749ba99/users/bb3ef1e7a0d74d3cabb04b24ebe77cb1/roles/d8dbc6d83d9d41d28c3feb8b3485b291 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 25 03:20:04.794164 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74638548-92b0-4470-b515-7d1c91cfb769 None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:20:04.794454 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74638548-92b0-4470-b515-7d1c91cfb769 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:20:04.794731 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74638548-92b0-4470-b515-7d1c91cfb769 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:20:04.821163 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-74638548-92b0-4470-b515-7d1c91cfb769 None None] MFA Rules not processed for user `bb3ef1e7a0d74d3cabb04b24ebe77cb1`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:20:04.822748 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-74638548-92b0-4470-b515-7d1c91cfb769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:20:04.890438 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1458/2924] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 03:20:04 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 25 03:20:04.900240 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba721a8b-edba-49b2-91e2-3deeb1d491e8 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:20:04.901960 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-ba721a8b-edba-49b2-91e2-3deeb1d491e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:20:04.958639 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba721a8b-edba-49b2-91e2-3deeb1d491e8 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:20:04.962877 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3dbb7d-d25a-4376-8619-c463b1b01bf7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cc5249aea09430080e232cf17757f86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:20:04.963508 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3dbb7d-d25a-4376-8619-c463b1b01bf7 service cinder] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:20:04.963836 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3dbb7d-d25a-4376-8619-c463b1b01bf7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:20:04.964121 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3dbb7d-d25a-4376-8619-c463b1b01bf7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:20:04.973039 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3dbb7d-d25a-4376-8619-c463b1b01bf7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:20:04.974491 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3dbb7d-d25a-4376-8619-c463b1b01bf7 service cinder] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:20:04.984658 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1467/2925] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 03:20:04 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:20:05.131898 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74638548-92b0-4470-b515-7d1c91cfb769 None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:20:05.141490 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74638548-92b0-4470-b515-7d1c91cfb769 None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:20:05.145127 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e9de66-275a-47ba-981b-bdd4976b4156 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cc5249aea09430080e232cf17757f86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:20:05.145771 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e9de66-275a-47ba-981b-bdd4976b4156 service cinder] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:20:05.146041 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e9de66-275a-47ba-981b-bdd4976b4156 service cinder] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:20:05.146312 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e9de66-275a-47ba-981b-bdd4976b4156 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:20:05.201737 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e9de66-275a-47ba-981b-bdd4976b4156 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:20:05.203178 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e9de66-275a-47ba-981b-bdd4976b4156 service cinder] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:20:05.213317 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1459/2926] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 03:20:05 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:20:14.645291 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3dbb7d-d25a-4376-8619-c463b1b01bf7 service cinder] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:20:14.707157 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3dbb7d-d25a-4376-8619-c463b1b01bf7 service cinder] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:20:14.711685 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533d4792-50d9-49c4-8dbf-87b49ad61b4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:20:14.712580 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533d4792-50d9-49c4-8dbf-87b49ad61b4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:20:14.712858 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533d4792-50d9-49c4-8dbf-87b49ad61b4a admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:20:14.713248 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533d4792-50d9-49c4-8dbf-87b49ad61b4a admin admin] PATH_INFO: `/v3/users/73c522363c10406b960a0023345efa09` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:20:14.715122 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533d4792-50d9-49c4-8dbf-87b49ad61b4a admin admin] RBAC: Authorizing `identity:delete_user(user_id=73c522363c10406b960a0023345efa09)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:20:14.717103 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533d4792-50d9-49c4-8dbf-87b49ad61b4a admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:20:14.761797 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-533d4792-50d9-49c4-8dbf-87b49ad61b4a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73c522363c10406b960a0023345efa09'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:20:14.762451 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-533d4792-50d9-49c4-8dbf-87b49ad61b4a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73c522363c10406b960a0023345efa09'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:20:14.769047 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-533d4792-50d9-49c4-8dbf-87b49ad61b4a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73c522363c10406b960a0023345efa09'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:20:14.769666 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-533d4792-50d9-49c4-8dbf-87b49ad61b4a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73c522363c10406b960a0023345efa09'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:20:14.777016 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-533d4792-50d9-49c4-8dbf-87b49ad61b4a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73c522363c10406b960a0023345efa09'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:20:14.794139 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1468/2927] 10.222.0.117 () {58 vars in 1228 bytes} [Tue Jan 25 03:20:14 2022] DELETE /identity/v3/users/73c522363c10406b960a0023345efa09 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:20:14.798653 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc221f8-10a0-4d0a-9765-3995140a92c8 None None] REQUEST_METHOD: `POST` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:20:14.799152 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc221f8-10a0-4d0a-9765-3995140a92c8 None None] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:20:14.799270 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc221f8-10a0-4d0a-9765-3995140a92c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:20:14.816308 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.auth.core [None req-dbc221f8-10a0-4d0a-9765-3995140a92c8 None None] MFA Rules not processed for user `3db97686d01f422cb62642c302e35e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79120) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 25 03:20:14.817511 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-dbc221f8-10a0-4d0a-9765-3995140a92c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:20:14.874065 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1460/2928] 10.222.0.117 () {58 vars in 962 bytes} [Tue Jan 25 03:20:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 25 03:20:14.883581 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533d4792-50d9-49c4-8dbf-87b49ad61b4a admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:20:14.885613 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-533d4792-50d9-49c4-8dbf-87b49ad61b4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:20:14.940618 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533d4792-50d9-49c4-8dbf-87b49ad61b4a admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:20:14.944274 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804346f5-c71a-4d1f-9d2f-10bbac0b99a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca4071c5f8f4a31b5edb81fa66a43a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:20:14.944895 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804346f5-c71a-4d1f-9d2f-10bbac0b99a5 service neutron] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:20:14.945179 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804346f5-c71a-4d1f-9d2f-10bbac0b99a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:20:14.945455 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804346f5-c71a-4d1f-9d2f-10bbac0b99a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:20:14.955225 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804346f5-c71a-4d1f-9d2f-10bbac0b99a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:20:14.956699 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804346f5-c71a-4d1f-9d2f-10bbac0b99a5 service neutron] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:20:14.966199 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1469/2929] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 03:20:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:20:15.224754 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc221f8-10a0-4d0a-9765-3995140a92c8 None None] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:20:15.226213 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-dbc221f8-10a0-4d0a-9765-3995140a92c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:20:15.239737 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc221f8-10a0-4d0a-9765-3995140a92c8 None None] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:20:15.245156 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37af2c47-a5fd-4742-bc38-c7561508c494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:20:15.246033 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37af2c47-a5fd-4742-bc38-c7561508c494 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:20:15.246314 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37af2c47-a5fd-4742-bc38-c7561508c494 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:20:15.247258 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37af2c47-a5fd-4742-bc38-c7561508c494 admin admin] PATH_INFO: `/v3/projects/fbeaca40df5e4399952d6c829ee03dc6` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:20:15.248765 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37af2c47-a5fd-4742-bc38-c7561508c494 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fbeaca40df5e4399952d6c829ee03dc6)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:20:15.250710 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37af2c47-a5fd-4742-bc38-c7561508c494 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:20:15.298074 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-37af2c47-a5fd-4742-bc38-c7561508c494 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fbeaca40df5e4399952d6c829ee03dc6', 'request_id': 'req-37af2c47-a5fd-4742-bc38-c7561508c494'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:20:15.303480 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-37af2c47-a5fd-4742-bc38-c7561508c494 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fbeaca40df5e4399952d6c829ee03dc6', 'request_id': 'req-37af2c47-a5fd-4742-bc38-c7561508c494'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:20:15.309968 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-37af2c47-a5fd-4742-bc38-c7561508c494 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fbeaca40df5e4399952d6c829ee03dc6', 'request_id': 'req-37af2c47-a5fd-4742-bc38-c7561508c494'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:20:15.321291 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-37af2c47-a5fd-4742-bc38-c7561508c494 admin admin] The token cache is being invalidate because project fbeaca40df5e4399952d6c829ee03dc6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79120) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 25 03:20:15.321576 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-37af2c47-a5fd-4742-bc38-c7561508c494 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:20:15.322181 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-37af2c47-a5fd-4742-bc38-c7561508c494 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:20:15.324587 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1461/2930] 10.222.0.117 () {58 vars in 1237 bytes} [Tue Jan 25 03:20:15 2022] DELETE /identity/v3/projects/fbeaca40df5e4399952d6c829ee03dc6 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:20:15.328573 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804346f5-c71a-4d1f-9d2f-10bbac0b99a5 service neutron] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:20:15.338758 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804346f5-c71a-4d1f-9d2f-10bbac0b99a5 service neutron] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:20:15.392340 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278896a8-417f-4775-8cf2-ea59925713dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:20:15.393208 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278896a8-417f-4775-8cf2-ea59925713dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:20:15.393494 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278896a8-417f-4775-8cf2-ea59925713dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:20:15.393772 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278896a8-417f-4775-8cf2-ea59925713dd admin admin] PATH_INFO: `/v3/users/bb3ef1e7a0d74d3cabb04b24ebe77cb1` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:20:15.394964 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278896a8-417f-4775-8cf2-ea59925713dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb3ef1e7a0d74d3cabb04b24ebe77cb1)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:20:15.396929 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278896a8-417f-4775-8cf2-ea59925713dd admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:20:15.442211 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-278896a8-417f-4775-8cf2-ea59925713dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb3ef1e7a0d74d3cabb04b24ebe77cb1'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:20:15.442859 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-278896a8-417f-4775-8cf2-ea59925713dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb3ef1e7a0d74d3cabb04b24ebe77cb1'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:20:15.452537 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-278896a8-417f-4775-8cf2-ea59925713dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb3ef1e7a0d74d3cabb04b24ebe77cb1'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:20:15.454188 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-278896a8-417f-4775-8cf2-ea59925713dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb3ef1e7a0d74d3cabb04b24ebe77cb1'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:20:15.461289 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-278896a8-417f-4775-8cf2-ea59925713dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb3ef1e7a0d74d3cabb04b24ebe77cb1'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:20:15.477706 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1470/2931] 10.222.0.117 () {58 vars in 1228 bytes} [Tue Jan 25 03:20:15 2022] DELETE /identity/v3/users/bb3ef1e7a0d74d3cabb04b24ebe77cb1 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:20:15.743486 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37af2c47-a5fd-4742-bc38-c7561508c494 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:20:15.745721 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-37af2c47-a5fd-4742-bc38-c7561508c494 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:20:15.758711 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37af2c47-a5fd-4742-bc38-c7561508c494 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:20:15.816886 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2b834c-e361-44a6-88ce-64c0b323b29d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:20:15.817743 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2b834c-e361-44a6-88ce-64c0b323b29d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:20:15.818022 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2b834c-e361-44a6-88ce-64c0b323b29d admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:20:15.818301 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2b834c-e361-44a6-88ce-64c0b323b29d admin admin] PATH_INFO: `/v3/projects/cfa171779f5442aea53963a84749ba99` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:20:15.820121 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2b834c-e361-44a6-88ce-64c0b323b29d admin admin] RBAC: Authorizing `identity:delete_project(project_id=cfa171779f5442aea53963a84749ba99)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:20:15.822694 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2b834c-e361-44a6-88ce-64c0b323b29d admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:20:15.867488 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-0c2b834c-e361-44a6-88ce-64c0b323b29d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cfa171779f5442aea53963a84749ba99', 'request_id': 'req-0c2b834c-e361-44a6-88ce-64c0b323b29d'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:20:15.873265 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-0c2b834c-e361-44a6-88ce-64c0b323b29d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cfa171779f5442aea53963a84749ba99', 'request_id': 'req-0c2b834c-e361-44a6-88ce-64c0b323b29d'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:20:15.879167 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-0c2b834c-e361-44a6-88ce-64c0b323b29d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cfa171779f5442aea53963a84749ba99', 'request_id': 'req-0c2b834c-e361-44a6-88ce-64c0b323b29d'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:20:15.891328 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-0c2b834c-e361-44a6-88ce-64c0b323b29d admin admin] The token cache is being invalidate because project cfa171779f5442aea53963a84749ba99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79120) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 25 03:20:15.891867 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-0c2b834c-e361-44a6-88ce-64c0b323b29d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:20:15.892651 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-0c2b834c-e361-44a6-88ce-64c0b323b29d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:20:15.894209 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1462/2932] 10.222.0.117 () {58 vars in 1237 bytes} [Tue Jan 25 03:20:15 2022] DELETE /identity/v3/projects/cfa171779f5442aea53963a84749ba99 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:22:26.142393 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278896a8-417f-4775-8cf2-ea59925713dd admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:22:26.143920 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-278896a8-417f-4775-8cf2-ea59925713dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:22:26.212143 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278896a8-417f-4775-8cf2-ea59925713dd admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:22:26.257593 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6d5238-0b0b-417b-831c-af2ddaac0735 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca4071c5f8f4a31b5edb81fa66a43a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:22:26.258225 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6d5238-0b0b-417b-831c-af2ddaac0735 service neutron] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:22:26.258505 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6d5238-0b0b-417b-831c-af2ddaac0735 service neutron] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:22:26.258778 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6d5238-0b0b-417b-831c-af2ddaac0735 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:22:26.260524 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-7a6d5238-0b0b-417b-831c-af2ddaac0735 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:22:26.270356 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6d5238-0b0b-417b-831c-af2ddaac0735 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:22:26.271827 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6d5238-0b0b-417b-831c-af2ddaac0735 service neutron] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:22:26.279504 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1471/2933] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 03:22:26 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:22:26.379477 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2b834c-e361-44a6-88ce-64c0b323b29d admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:22:26.381487 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-0c2b834c-e361-44a6-88ce-64c0b323b29d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:22:26.401309 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2b834c-e361-44a6-88ce-64c0b323b29d admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:22:26.408091 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92172b15-cb7f-4127-93d9-e9b67f0208e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca4071c5f8f4a31b5edb81fa66a43a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:22:26.408772 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92172b15-cb7f-4127-93d9-e9b67f0208e9 service neutron] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:22:26.409053 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92172b15-cb7f-4127-93d9-e9b67f0208e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:22:26.409326 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92172b15-cb7f-4127-93d9-e9b67f0208e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:22:26.411092 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-92172b15-cb7f-4127-93d9-e9b67f0208e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:22:26.421991 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92172b15-cb7f-4127-93d9-e9b67f0208e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:22:26.423427 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92172b15-cb7f-4127-93d9-e9b67f0208e9 service neutron] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:22:26.431671 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1463/2934] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 03:22:26 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:24:09.613839 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6d5238-0b0b-417b-831c-af2ddaac0735 service neutron] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:24:09.622422 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6d5238-0b0b-417b-831c-af2ddaac0735 service neutron] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:24:09.626927 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae08338-71ec-4861-9c7e-a01d9173bd4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca4071c5f8f4a31b5edb81fa66a43a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:24:09.627548 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae08338-71ec-4861-9c7e-a01d9173bd4e service neutron] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:24:09.627871 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae08338-71ec-4861-9c7e-a01d9173bd4e service neutron] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:24:09.628146 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae08338-71ec-4861-9c7e-a01d9173bd4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:24:09.629883 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-aae08338-71ec-4861-9c7e-a01d9173bd4e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:24:09.686451 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae08338-71ec-4861-9c7e-a01d9173bd4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:24:09.688542 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae08338-71ec-4861-9c7e-a01d9173bd4e service neutron] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:24:09.698638 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1472/2935] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 03:24:09 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:24:11.527714 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92172b15-cb7f-4127-93d9-e9b67f0208e9 service neutron] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:24:11.529247 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-92172b15-cb7f-4127-93d9-e9b67f0208e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:24:11.610575 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92172b15-cb7f-4127-93d9-e9b67f0208e9 service neutron] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:24:11.615676 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de82a60f-4f13-4792-80d8-5847a8dc221c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '890151a6bf2840f0a0a00f45dd2d38a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:24:11.616365 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de82a60f-4f13-4792-80d8-5847a8dc221c service placement] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:24:11.616640 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de82a60f-4f13-4792-80d8-5847a8dc221c service placement] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:24:11.616915 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de82a60f-4f13-4792-80d8-5847a8dc221c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:24:11.618705 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-de82a60f-4f13-4792-80d8-5847a8dc221c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:24:11.631215 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de82a60f-4f13-4792-80d8-5847a8dc221c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:24:11.632851 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de82a60f-4f13-4792-80d8-5847a8dc221c service placement] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:24:11.643161 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1464/2936] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 03:24:11 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:24:14.617659 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae08338-71ec-4861-9c7e-a01d9173bd4e service neutron] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:24:14.627168 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae08338-71ec-4861-9c7e-a01d9173bd4e service neutron] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:24:14.634096 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231c0891-346f-432d-b77c-d9ed687c182f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ca4071c5f8f4a31b5edb81fa66a43a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:24:14.634748 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231c0891-346f-432d-b77c-d9ed687c182f service neutron] REQUEST_METHOD: `GET` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:24:14.635033 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231c0891-346f-432d-b77c-d9ed687c182f service neutron] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:24:14.635309 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231c0891-346f-432d-b77c-d9ed687c182f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:24:14.637143 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-231c0891-346f-432d-b77c-d9ed687c182f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:24:14.719908 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231c0891-346f-432d-b77c-d9ed687c182f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:24:14.721365 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231c0891-346f-432d-b77c-d9ed687c182f service neutron] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:24:14.739728 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1473/2937] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 03:24:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 25 03:24:21.119896 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de82a60f-4f13-4792-80d8-5847a8dc221c service placement] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:24:21.121467 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-de82a60f-4f13-4792-80d8-5847a8dc221c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:24:21.138438 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de82a60f-4f13-4792-80d8-5847a8dc221c service placement] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:24:21.143775 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359ad0bd-d91d-4646-8fc8-e3673e40b094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:24:21.144650 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359ad0bd-d91d-4646-8fc8-e3673e40b094 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:24:21.144933 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359ad0bd-d91d-4646-8fc8-e3673e40b094 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:24:21.145211 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359ad0bd-d91d-4646-8fc8-e3673e40b094 admin admin] PATH_INFO: `/v3/users/db8e68548fea4f339d9efbb65128cf91` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:24:21.146422 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359ad0bd-d91d-4646-8fc8-e3673e40b094 admin admin] RBAC: Authorizing `identity:delete_user(user_id=db8e68548fea4f339d9efbb65128cf91)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:24:21.152554 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359ad0bd-d91d-4646-8fc8-e3673e40b094 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:24:21.199472 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-359ad0bd-d91d-4646-8fc8-e3673e40b094 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db8e68548fea4f339d9efbb65128cf91'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:24:21.206954 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-359ad0bd-d91d-4646-8fc8-e3673e40b094 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db8e68548fea4f339d9efbb65128cf91'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:24:21.207608 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-359ad0bd-d91d-4646-8fc8-e3673e40b094 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db8e68548fea4f339d9efbb65128cf91'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:24:21.208244 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-359ad0bd-d91d-4646-8fc8-e3673e40b094 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db8e68548fea4f339d9efbb65128cf91'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:24:21.220200 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-359ad0bd-d91d-4646-8fc8-e3673e40b094 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db8e68548fea4f339d9efbb65128cf91'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:24:21.232155 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1465/2938] 10.222.0.117 () {58 vars in 1228 bytes} [Tue Jan 25 03:24:21 2022] DELETE /identity/v3/users/db8e68548fea4f339d9efbb65128cf91 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:24:21.405001 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231c0891-346f-432d-b77c-d9ed687c182f service neutron] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:24:21.417506 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231c0891-346f-432d-b77c-d9ed687c182f service neutron] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:24:21.481439 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65e6b64-d517-43bd-9ee3-7a854f69c7f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:24:21.482350 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65e6b64-d517-43bd-9ee3-7a854f69c7f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:24:21.482640 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65e6b64-d517-43bd-9ee3-7a854f69c7f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:24:21.482918 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65e6b64-d517-43bd-9ee3-7a854f69c7f2 admin admin] PATH_INFO: `/v3/projects/b49d1a0585ee4d0992125a806e46704f` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:24:21.484250 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65e6b64-d517-43bd-9ee3-7a854f69c7f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b49d1a0585ee4d0992125a806e46704f)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:24:21.486992 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65e6b64-d517-43bd-9ee3-7a854f69c7f2 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:24:21.536369 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-e65e6b64-d517-43bd-9ee3-7a854f69c7f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b49d1a0585ee4d0992125a806e46704f', 'request_id': 'req-e65e6b64-d517-43bd-9ee3-7a854f69c7f2'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:24:21.542534 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-e65e6b64-d517-43bd-9ee3-7a854f69c7f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b49d1a0585ee4d0992125a806e46704f', 'request_id': 'req-e65e6b64-d517-43bd-9ee3-7a854f69c7f2'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:24:21.550951 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-e65e6b64-d517-43bd-9ee3-7a854f69c7f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b49d1a0585ee4d0992125a806e46704f', 'request_id': 'req-e65e6b64-d517-43bd-9ee3-7a854f69c7f2'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:24:21.565025 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-e65e6b64-d517-43bd-9ee3-7a854f69c7f2 admin admin] The token cache is being invalidate because project b49d1a0585ee4d0992125a806e46704f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79121) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 25 03:24:21.565324 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-e65e6b64-d517-43bd-9ee3-7a854f69c7f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:24:21.565991 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-e65e6b64-d517-43bd-9ee3-7a854f69c7f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:24:21.567851 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1474/2939] 10.222.0.117 () {58 vars in 1237 bytes} [Tue Jan 25 03:24:21 2022] DELETE /identity/v3/projects/b49d1a0585ee4d0992125a806e46704f => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:24:21.571606 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359ad0bd-d91d-4646-8fc8-e3673e40b094 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:24:21.573161 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-359ad0bd-d91d-4646-8fc8-e3673e40b094 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:24:21.586740 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359ad0bd-d91d-4646-8fc8-e3673e40b094 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:24:21.643537 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b62c8cb-b3a8-4f9f-8706-49a548aa9b46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:24:21.644437 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b62c8cb-b3a8-4f9f-8706-49a548aa9b46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:24:21.644728 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b62c8cb-b3a8-4f9f-8706-49a548aa9b46 admin admin] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:24:21.645002 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b62c8cb-b3a8-4f9f-8706-49a548aa9b46 admin admin] PATH_INFO: `/v3/users/4d2899f2598a4db0a73069365026a64c` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:24:21.646199 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b62c8cb-b3a8-4f9f-8706-49a548aa9b46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d2899f2598a4db0a73069365026a64c)` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:24:21.648203 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b62c8cb-b3a8-4f9f-8706-49a548aa9b46 admin admin] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:24:21.694155 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-7b62c8cb-b3a8-4f9f-8706-49a548aa9b46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d2899f2598a4db0a73069365026a64c'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:24:21.700853 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-7b62c8cb-b3a8-4f9f-8706-49a548aa9b46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d2899f2598a4db0a73069365026a64c'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:24:21.701469 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-7b62c8cb-b3a8-4f9f-8706-49a548aa9b46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d2899f2598a4db0a73069365026a64c'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:24:21.702089 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-7b62c8cb-b3a8-4f9f-8706-49a548aa9b46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d2899f2598a4db0a73069365026a64c'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:24:21.714320 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.notifications [None req-7b62c8cb-b3a8-4f9f-8706-49a548aa9b46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d2899f2598a4db0a73069365026a64c'} {{(pid=79120) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:24:21.727486 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1466/2940] 10.222.0.117 () {58 vars in 1228 bytes} [Tue Jan 25 03:24:21 2022] DELETE /identity/v3/users/4d2899f2598a4db0a73069365026a64c => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:24:21.896501 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65e6b64-d517-43bd-9ee3-7a854f69c7f2 admin admin] Authenticating user token {{(pid=79121) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:24:21.898015 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.fernet_utils [None req-e65e6b64-d517-43bd-9ee3-7a854f69c7f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79121) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:24:21.913335 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65e6b64-d517-43bd-9ee3-7a854f69c7f2 admin admin] Validating token access rules against request {{(pid=79121) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:24:21.980252 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eae020f-d9f3-46cb-84a9-def6127ac1e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db97686d01f422cb62642c302e35e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '705a3c6650674528a0096768eea3fe81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79121) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:24:21.981108 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eae020f-d9f3-46cb-84a9-def6127ac1e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:24:21.981395 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eae020f-d9f3-46cb-84a9-def6127ac1e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:24:21.981675 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eae020f-d9f3-46cb-84a9-def6127ac1e8 admin admin] PATH_INFO: `/v3/projects/39ba7d0b3d8d406b9419ab681ab86381` {{(pid=79121) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:24:21.982861 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eae020f-d9f3-46cb-84a9-def6127ac1e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=39ba7d0b3d8d406b9419ab681ab86381)` {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:24:21.984858 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eae020f-d9f3-46cb-84a9-def6127ac1e8 admin admin] RBAC: Authorization granted {{(pid=79121) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:24:22.028292 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-4eae020f-d9f3-46cb-84a9-def6127ac1e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39ba7d0b3d8d406b9419ab681ab86381', 'request_id': 'req-4eae020f-d9f3-46cb-84a9-def6127ac1e8'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:24:22.034137 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-4eae020f-d9f3-46cb-84a9-def6127ac1e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39ba7d0b3d8d406b9419ab681ab86381', 'request_id': 'req-4eae020f-d9f3-46cb-84a9-def6127ac1e8'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:24:22.041405 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-4eae020f-d9f3-46cb-84a9-def6127ac1e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39ba7d0b3d8d406b9419ab681ab86381', 'request_id': 'req-4eae020f-d9f3-46cb-84a9-def6127ac1e8'} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:24:22.052312 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-4eae020f-d9f3-46cb-84a9-def6127ac1e8 admin admin] The token cache is being invalidate because project 39ba7d0b3d8d406b9419ab681ab86381 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79121) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 25 03:24:22.052616 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-4eae020f-d9f3-46cb-84a9-def6127ac1e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:24:22.053239 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: DEBUG keystone.notifications [None req-4eae020f-d9f3-46cb-84a9-def6127ac1e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79121) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 25 03:24:22.054738 dv-cinder-819778-6-iscsi devstack@keystone.service[79121]: [pid: 79121|app: 0|req: 1475/2941] 10.222.0.117 () {58 vars in 1237 bytes} [Tue Jan 25 03:24:21 2022] DELETE /identity/v3/projects/39ba7d0b3d8d406b9419ab681ab86381 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 25 03:29:17.488471 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b62c8cb-b3a8-4f9f-8706-49a548aa9b46 admin admin] Authenticating user token {{(pid=79120) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 25 03:29:17.489880 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-7b62c8cb-b3a8-4f9f-8706-49a548aa9b46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:29:17.618554 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b62c8cb-b3a8-4f9f-8706-49a548aa9b46 admin admin] Validating token access rules against request {{(pid=79120) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 25 03:29:17.675572 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bab2c2f-1b48-4273-8085-91a7c7fcd13f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '890151a6bf2840f0a0a00f45dd2d38a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61a6fe9d4c914755bb0a64c392bd16aa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79120) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 25 03:29:17.676254 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bab2c2f-1b48-4273-8085-91a7c7fcd13f service placement] REQUEST_METHOD: `GET` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 25 03:29:17.676539 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bab2c2f-1b48-4273-8085-91a7c7fcd13f service placement] SCRIPT_NAME: `/identity` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 25 03:29:17.676815 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bab2c2f-1b48-4273-8085-91a7c7fcd13f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79120) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 25 03:29:17.679543 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.fernet_utils [None req-8bab2c2f-1b48-4273-8085-91a7c7fcd13f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79120) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 25 03:29:17.690798 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bab2c2f-1b48-4273-8085-91a7c7fcd13f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 25 03:29:17.692413 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bab2c2f-1b48-4273-8085-91a7c7fcd13f service placement] RBAC: Authorization granted {{(pid=79120) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 25 03:29:17.703012 dv-cinder-819778-6-iscsi devstack@keystone.service[79120]: [pid: 79120|app: 0|req: 1467/2942] 10.222.0.117 () {60 vars in 1370 bytes} [Tue Jan 25 03:29:17 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)